00000001:02000400:0.0F:1787892798.911760:0:3305:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg235-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1787892809.082743:0:3507:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg235-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1787892810.996137:0:3551:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 613 MB/s 00000001:01000000:0.0:1787892811.249477:0:3551:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 648 MB/s 00000001:01000000:3.0:1787892811.505626:0:3551:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3262 MB/s 00000020:02000000:1.0:1787892812.194805:0:3599:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_84_ga3423c7 00000400:02000000:0.0:1787892812.971031:0:3614:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.202.135@tcp [8/256/0/180] 00008000:02000000:2.0F:1787892816.663966:0:3763:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1787892883.046361:0:5732:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg235-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787892898.294940:0:6482:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787892898.294944:0:6482:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1787892898.294946:0:6482:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787892898.295078:0:6482:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000007f58b6c0 00000080:02000400:2.0:1787892898.295089:0:6482:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1787892898.303912:0:6482:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1787892898.303926:0:6482:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787892898.303955:0:6482:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000571d38d5) 00000020:00000080:2.0:1787892898.303972:0:6482:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787892898.375314:0:6482:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1787892898.375374:0:6482:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:1.0:1787892898.386350:0:6482:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787892898.386714:0:6482:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1787892898.386721:0:6482:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787892898.386743:0:6482:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9232577658cf06fe 00000020:01000004:1.0:1787892898.386748:0:6482:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1787892898.386752:0:6482:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1787892898.386756:0:6482:0:(tgt_mount.c:101:server_register_mount()) register mount 000000007f58b6c0 from MGS 00000020:01000004:1.0:1787892898.386759:0:6482:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1787892898.386868:0:6482:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000c91e11d7) 00000020:00000080:1.0:1787892898.386879:0:6482:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1787892898.386962:0:6482:0:(tgt_mount.c:153:server_get_mount()) get mount 000000007f58b6c0 from MGS, refs=2 00080000:01000000:1.0:1787892898.386965:0:6482:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787892898.386969:0:6482:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9232577658cf070c 00000100:00100000:1.0:1787892898.387039:0:6482:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1787892898.387123:0:6482:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1787892898.387127:0:6482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787892898.387448:0:6482:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787892898.387452:0:6482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787892898.388349:0:6482:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787892898.388466:0:6482:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787892898.388469:0:6482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787892898.388980:0:6482:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787892898.388985:0:6482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787892898.389378:0:6482:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787892898.389383:0:6482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787892898.389917:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892898.389920:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892898.389922:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892898.390071:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892898.390073:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892898.390075:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892898.390406:0:6482:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787892898.391645:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1787892898.640944:0:6482:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2533 MB/s 00000001:01000000:1.0:1787892898.890591:0:6482:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2387 MB/s 00000001:01000000:2.0:1787892899.142459:0:6482:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 589 MB/s 00000001:01000000:2.0:1787892899.394205:0:6482:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 555 MB/s 00080000:10000000:2.0:1787892899.407405:0:6482:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00010000:00010000:3.0:1787892899.442991:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787892899.453860:0:6482:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1787892899.462646:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1787892899.462760:0:6482:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1787892899.462819:0:6482:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1787892899.463048:0:6482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787892899.463076:0:6482:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787892899.463398:0:6482:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787892899.463575:0:6482:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1787892899.463580:0:6482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787892899.481682:0:6482:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787892899.481700:0:6482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787892899.483870:0:6482:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787892899.483883:0:6482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787892899.484566:0:6482:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787892899.484589:0:6482:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.135@tcp' 00000020:01000004:0.0:1787892899.484591:0:6482:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787892899.485065:0:6482:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.135@tcp (typ=mgc) 00000020:00000080:0.0:1787892899.485084:0:6482:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.135@tcp (00000000fd869c00) 00000020:00000080:0.0:1787892899.485100:0:6482:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787892899.485214:0:6482:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000000b1e524@MGC192.168.202.135@tcp: add connection 192.168.202.135@tcp at head 00010000:00010000:0.0:1787892899.486531:0:6482:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.135@tcp-0 is initialized 00000040:01000000:0.0:1787892899.486540:0:6482:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.135@tcp ctxt 1 is initialized 00000100:00080000:2.0:1787892899.486899:0:6501:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1787892899.497478:0:6502:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1787892899.497695:0:6482:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.135@tcp (uuid 19ad7764-cf95-4087-88aa-57e4229a8397) 00000020:00000080:0.0:1787892899.497717:0:6482:0:(genops.c:1385:class_connect()) connect: client 19ad7764-cf95-4087-88aa-57e4229a8397, cookie 0x9232577658cf071a 00000100:00080000:0.0:1787892899.497728:0:6482:0:(import.c:510:import_select_connection()) MGC192.168.202.135@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787892899.497733:0:6482:0:(import.c:624:import_select_connection()) MGC192.168.202.135@tcp: import 0000000000b1e524 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:0.0:1787892899.497778:0:6482:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003a2b5e68 x1874741493235840/t0(0) o250->MGC192.168.202.135@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787892899.497803:0:6482:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 19ad7764-cf95-4087-88aa-57e4229a8397->MGS 00000020:01000004:0.0:1787892899.497821:0:6482:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1787892899.497841:0:6482:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1787892899.497855:0:6482:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000b57c8109) 00000020:00000080:0.0:1787892899.497868:0:6482:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1787892899.501837:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003a2b5e68 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:19ad7764-cf95-4087-88aa-57e4229a8397:3629:1874741493235840:0@lo:250: 00000100:00100000:1.0:1787892899.501927:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892899.502018:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493235840 00000100:00100000:1.0:1787892899.502034:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493235840 00000100:00100000:1.0:1787892899.502078:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787892899.502085:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6b37205 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3629:x1874741493235840:12345-0@lo:250: 00010000:00080000:1.0:1787892899.502110:0:6499:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 19ad7764-cf95-4087-88aa-57e4229a8397@0@lo t0 exp 0000000000000000 cur 143 last 0 00000020:00000080:1.0:1787892899.502151:0:6499:0:(genops.c:1385:class_connect()) connect: client 19ad7764-cf95-4087-88aa-57e4229a8397, cookie 0x9232577658cf0728 00000100:00080000:1.0:1787892899.502300:0:6499:0:(import.c:65:import_set_state_nolock()) 00000000daf82cca : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787892899.502347:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6b37205 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+5:3629:x1874741493235840:12345-0@lo:250: Request processed in 261us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892899.502354:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787892899.502398:0:3629:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.135@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1787892899.502408:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.135@tcp: connect to target with instance 0 00000100:00080000:1.0:1787892899.502414:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.135@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1787892899.502419:0:3629:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1787892899.502421:0:3629:0:(import.c:65:import_set_state_nolock()) 0000000000b1e524 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1787892899.502424:0:3629:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1787892899.502430:0:3629:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1787892899.502435:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003a2b5e68 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:19ad7764-cf95-4087-88aa-57e4229a8397:3629:1874741493235840:0@lo:250: 00000100:00100000:0.0:1787892899.525798:0:6482:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787892899.526027:0:6482:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787892899.526034:0:6482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787892899.527876:0:6482:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787892899.527887:0:6482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787892899.528363:0:6482:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787892899.528370:0:6482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787892899.529203:0:6482:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787892899.529698:0:6482:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787892899.529711:0:6482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787892899.533273:0:6482:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787892899.533366:0:6482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787892899.582248:0:6482:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787892899.582485:0:6482:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787892899.582545:0:6482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787892899.584881:0:6482:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787892899.584896:0:6482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787892899.585962:0:6482:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787892899.586183:0:6482:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787892899.586195:0:6482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787892899.587026:0:6482:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787892899.587032:0:6482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787892899.590899:0:6482:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787892899.591102:0:6482:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787892899.591109:0:6482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787892899.592020:0:6482:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787892899.592029:0:6482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787892899.592895:0:6482:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787892899.593062:0:6482:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787892899.593068:0:6482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787892899.594181:0:6482:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787892899.594190:0:6482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787892899.618844:0:6482:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787892899.619059:0:6482:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787892899.619066:0:6482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787892899.622010:0:6482:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787892899.622027:0:6482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787892899.622988:0:6482:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787892899.623004:0:6482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787892899.626057:0:6482:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787892899.626092:0:6482:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1787892899.626097:0:6482:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.135@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787892899.626216:0:6482:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.135@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787892899.626250:0:6482:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.135@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1787892899.626254:0:6482:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787892899.626256:0:6482:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787892899.626257:0:6482:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787892899.626258:0:6482:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787892899.626260:0:6482:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787892899.626261:0:6482:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787892899.626262:0:6482:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787892899.626263:0:6482:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787892899.626265:0:6482:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787892899.626266:0:6482:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787892899.626268:0:6482:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787892899.626269:0:6482:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787892899.626271:0:6482:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1787892899.626273:0:6482:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787892899.626274:0:6482:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787892899.626275:0:6482:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787892899.626276:0:6482:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787892899.626277:0:6482:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787892899.626280:0:6482:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787892899.626281:0:6482:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787892899.626282:0:6482:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787892899.626283:0:6482:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787892899.626284:0:6482:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787892899.626359:0:6482:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787892899.626361:0:6482:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787892899.626404:0:6482:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787892899.626424:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008e69a66d pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:6482:1874741493235968:0@lo:253: 00000100:00100000:2.0:1787892899.626719:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892899.626850:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493235968 00000100:00100000:0.0:1787892899.626859:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493235968 00000100:00100000:0.0:1787892899.626956:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787892899.626964:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e018bac8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+5:6482:x1874741493235968:12345-0@lo:253: 20000000:01000000:0.0:1787892899.627007:0:6500:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787892899.627011:0:6500:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 00000100:00100000:2.0:1787892899.627117:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set 00000000df595296 going to sleep for 11 seconds 10000000:01000000:2.0:1787892899.627650:0:6520:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787892899.627709:0:6500:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1787892899.628085:0:6500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787892899.632870:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1787892899.633158:0:6500:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787892899.633162:0:6500:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1787892899.633168:0:6500:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1787892899.633172:0:6500:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1787892899.633186:0:6500:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1787892899.633852:0:6500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787892899.634075:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1787892899.634089:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787892899.634136:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1787892899.634156:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1787892899.634171:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1787892899.634225:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1787892899.634233:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1787892899.634246:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1787892899.634251:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1787892899.634262:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1787892899.634267:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1787892899.634373:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1787892899.634392:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1787892899.634425:0:6500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787892899.634442:0:6500:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1787892899.634451:0:6500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787892899.634852:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1787892899.634863:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787892899.634877:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1787892899.634892:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1787892899.634909:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1787892899.634918:0:6500:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1787892899.634944:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1787892899.634951:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787892899.634961:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1787892899.634973:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1787892899.634986:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1787892899.634994:0:6500:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1787892899.635017:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1787892899.635024:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1787892899.635038:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1787892899.635053:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1787892899.635104:0:6500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1787892899.635132:0:6500:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1787892899.635144:0:6500:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1787892899.635934:0:6522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1787892899.636146:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1787892899.636167:0:6500:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.135@tcp for mdt 20000000:01000000:0.0:1787892899.636170:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.135@tcp (null) (null) (null) 00000040:00080000:0.0:1787892899.636184:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1787892899.636190:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787892899.636204:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1787892899.636209:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.135@tcp (null) (null) 00000040:00080000:0.0:1787892899.636235:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1787892899.636243:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1787892899.636255:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1787892899.636269:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1787892899.636377:0:6500:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787892899.636381:0:6500:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787892899.636384:0:6500:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787892899.636670:0:6500:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787892899.636673:0:6500:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787892899.637041:0:6523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1787892899.637230:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1787892899.637253:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1787892899.637268:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:0.0:1787892899.637278:0:6500:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787892899.637280:0:6500:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787892899.638193:0:6524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1787892899.638696:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1787892899.638717:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1787892899.638729:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1787892899.638810:0:6500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787892899.638813:0:6500:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1787892899.638818:0:6500:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787892899.638820:0:6500:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787892899.638826:0:6500:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1787892899.638832:0:6500:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1787892899.639131:0:6525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1787892899.639249:0:6500:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1787892899.648713:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1787892899.648839:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1787892899.648857:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1787892899.648878:0:6500:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787892899.648899:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000df3051c2/0x9232577658cf072f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892899.648917:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000df3051c2/0x9232577658cf072f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892899.648926:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000df3051c2/0x9232577658cf072f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892899.648932:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000df3051c2/0x9232577658cf072f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892899.648938:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000df3051c2/0x9232577658cf072f lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892899.648943:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000df3051c2/0x9232577658cf072f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892899.648950:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000df3051c2 already unused, calling callback (0000000010b23f3a) 00010000:00010000:0.0:1787892899.648955:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000df3051c2/0x9232577658cf072f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892899.648962:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000df3051c2/0x9232577658cf072f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892899.648981:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000df3051c2/0x9232577658cf072f lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892899.649006:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000df3051c2/0x9232577658cf072f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892899.649012:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000df3051c2/0x9232577658cf072f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787892899.649042:0:6500:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787892899.663247:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e018bac8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+5:6482:x1874741493235968:12345-0@lo:253: Request processed in 36276us (36520us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892899.663263:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787892899.663269:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008e69a66d pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:6482:1874741493235968:0@lo:253: 10000000:01000000:2.0:1787892899.663283:0:6482:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787892899.663351:0:6482:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787892899.663353:0:6482:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787892899.663354:0:6482:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787892899.663355:0:6482:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1787892899.663357:0:6482:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787892899.663358:0:6482:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787892899.663359:0:6482:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787892899.663361:0:6482:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787892899.663362:0:6482:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787892899.663364:0:6482:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787892899.663365:0:6482:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787892899.663386:0:6482:0:(tgt_mount.c:101:server_register_mount()) register mount 000000007f58b6c0 from lustre-MDT0000 10000000:01000000:2.0:1787892899.663418:0:6482:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787892899.663421:0:6482:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787892899.663484:0:6482:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9fc9e2e3b370 10000000:01000000:2.0:1787892899.663703:0:6482:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787892899.663721:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fc9e2e3b370 from 1 10000000:01000000:2.0:1787892899.663724:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787892899.663837:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: 00000000b76c75bd/0x9232577658cf0736 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892899.663849:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: 00000000b76c75bd/0x9232577658cf0736 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892899.663858:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: 00000000b76c75bd/0x9232577658cf0736 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892899.663875:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008e69a66d pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:6482:1874741493236096:0@lo:101: 00000100:00100000:2.0:1787892899.663926:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892899.664015:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set 0000000045ad891a going to sleep for 11 seconds 00000100:00100000:0.0:1787892899.664783:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493236096 00000100:00100000:0.0:1787892899.664793:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493236096 00000100:00100000:0.0:1787892899.664906:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787892899.664916:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041312074 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+5:6482:x1874741493236096:12345-0@lo:101: 00010000:00010000:0.0:1787892899.664931:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787892899.664944:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000df3051c2/0x9232577658cf073d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0736 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892899.664967:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000df3051c2/0x9232577658cf073d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0736 expref: 6 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892899.664989:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000df3051c2/0x9232577658cf073d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0736 expref: 6 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892899.664998:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000df3051c2, rc 0) 00000100:00100000:0.0:1787892899.665063:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041312074 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+6:6482:x1874741493236096:12345-0@lo:101: Request processed in 150us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892899.665070:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787892899.665220:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008e69a66d pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:6482:1874741493236096:0@lo:101: 00010000:00010000:2.0:1787892899.665237:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: 00000000b76c75bd/0x9232577658cf0736 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf073d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892899.665246:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: 00000000b76c75bd/0x9232577658cf0736 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf073d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892899.665314:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008e69a66d pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:6482:1874741493236224:0@lo:501: 00000100:00100000:2.0:1787892899.665346:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892899.668947:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set 0000000045ad891a going to sleep for 11 seconds 00000100:00100000:1.0:1787892899.671272:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493236224 00000100:00100000:1.0:1787892899.671293:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493236224 00000100:00100000:1.0:1787892899.671391:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787892899.671402:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b795f78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+6:6482:x1874741493236224:12345-0@lo:501: 00000100:00100000:1.0:1787892899.671573:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b795f78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+6:6482:x1874741493236224:12345-0@lo:501: Request processed in 174us (6227us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787892899.671583:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787892899.674159:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008e69a66d pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:6482:1874741493236224:0@lo:501: 10000000:01000000:2.0:1787892899.674226:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787892899.674290:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: 00000000b76c75bd/0x9232577658cf0736 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf073d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892899.674327:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: 00000000b76c75bd/0x9232577658cf0736 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf073d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892899.674337:0:6482:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fc9d909c800 10000000:01000000:2.0:1787892899.674343:0:6482:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787892899.674348:0:6482:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9fc9d909c800 10000000:01000000:2.0:1787892899.674351:0:6482:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787892899.674354:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9fc9d909c800 from 1 10000000:01000000:2.0:1787892899.674358:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787892899.674406:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: 000000008706372d/0x9232577658cf0744 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892899.674414:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: 000000008706372d/0x9232577658cf0744 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892899.674424:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: 000000008706372d/0x9232577658cf0744 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892899.674444:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008e69a66d pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:6482:1874741493236352:0@lo:101: 00000100:00100000:2.0:1787892899.674541:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892899.674585:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set 0000000045ad891a going to sleep for 11 seconds 00000100:00100000:0.0:1787892899.675356:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493236352 00000100:00100000:0.0:1787892899.675367:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493236352 00000100:00100000:0.0:1787892899.675434:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787892899.675444:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a03b5c64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+6:6482:x1874741493236352:12345-0@lo:101: 00010000:00010000:0.0:1787892899.675458:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787892899.675471:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bff01c2a/0x9232577658cf074b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0744 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892899.675513:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bff01c2a/0x9232577658cf074b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0744 expref: 7 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892899.675522:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bff01c2a/0x9232577658cf074b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0744 expref: 7 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892899.675530:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bff01c2a, rc 0) 00000100:00100000:0.0:1787892899.675577:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a03b5c64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+7:6482:x1874741493236352:12345-0@lo:101: Request processed in 135us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892899.675583:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787892899.676239:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008e69a66d pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:6482:1874741493236352:0@lo:101: 00010000:00010000:2.0:1787892899.676255:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: 000000008706372d/0x9232577658cf0744 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf074b expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892899.676263:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: 000000008706372d/0x9232577658cf0744 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf074b expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892899.676296:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787892899.680572:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: 000000008706372d/0x9232577658cf0744 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf074b expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892899.680591:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: 000000008706372d/0x9232577658cf0744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf074b expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892899.680600:0:6482:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787892899.680621:0:6482:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787892899.680628:0:6482:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9fc9d909c800 10000000:01000000:2.0:1787892899.680633:0:6482:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787892899.680637:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787892899.680639:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787892899.680676:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: 00000000bdb19d19/0x9232577658cf0752 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892899.680684:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: 00000000bdb19d19/0x9232577658cf0752 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892899.680694:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: 00000000bdb19d19/0x9232577658cf0752 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892899.680715:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008e69a66d pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:6482:1874741493236480:0@lo:101: 00000100:00100000:2.0:1787892899.680780:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892899.680832:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set 0000000045ad891a going to sleep for 11 seconds 00000100:00100000:0.0:1787892899.681616:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493236480 00000100:00100000:0.0:1787892899.681627:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493236480 00000100:00100000:0.0:1787892899.681677:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787892899.681686:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ad060d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+7:6482:x1874741493236480:12345-0@lo:101: 00010000:00010000:0.0:1787892899.681701:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787892899.681714:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009efa6137/0x9232577658cf0759 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0752 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892899.681738:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009efa6137/0x9232577658cf0759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0752 expref: 8 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892899.681748:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009efa6137/0x9232577658cf0759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0752 expref: 8 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892899.681771:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009efa6137, rc 0) 00000100:00100000:0.0:1787892899.681829:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ad060d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+8:6482:x1874741493236480:12345-0@lo:101: Request processed in 145us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892899.681836:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787892899.683321:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008e69a66d pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:6482:1874741493236480:0@lo:101: 00010000:00010000:2.0:1787892899.683343:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: 00000000bdb19d19/0x9232577658cf0752 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0759 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892899.683369:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: 00000000bdb19d19/0x9232577658cf0752 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0759 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892899.683471:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008e69a66d pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:6482:1874741493236608:0@lo:501: 00000100:00100000:2.0:1787892899.683553:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892899.683592:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set 0000000045ad891a going to sleep for 11 seconds 00000100:00100000:0.0:1787892899.683849:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493236608 00000100:00100000:0.0:1787892899.683856:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493236608 00000100:00100000:0.0:1787892899.683905:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787892899.683914:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f8edefa5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+8:6482:x1874741493236608:12345-0@lo:501: 00000100:00100000:0.0:1787892899.684044:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f8edefa5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+9:6482:x1874741493236608:12345-0@lo:501: Request processed in 131us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892899.684052:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787892899.684156:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008e69a66d pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:6482:1874741493236608:0@lo:501: 00000100:00100000:3.0:1787892899.684199:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000aecbd066 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:6482:1874741493236736:0@lo:503: 00000100:00100000:3.0:1787892899.684246:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892899.684280:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c79ab6ec going to sleep for 11 seconds 00000100:00100000:2.0:1787892899.684543:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493236736 00000100:00100000:2.0:1787892899.684547:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493236736 00000100:00100000:2.0:1787892899.684584:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787892899.684591:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b24708fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+9:6482:x1874741493236736:12345-0@lo:503: 00000100:00100000:2.0:1787892899.684687:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b24708fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+9:6482:x1874741493236736:12345-0@lo:503: Request processed in 97us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892899.684693:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787892899.684817:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000aecbd066 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:6482:1874741493236736:0@lo:503: 00000100:00100000:0.0:1787892899.685249:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001233f7e5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:6526:1874741493236864:0@lo:502: 00000100:00100000:0.0:1787892899.685280:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892899.685306:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c6caca95 going to sleep for 11 seconds 00000100:00100000:2.0:1787892899.685397:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493236864 00000100:00100000:2.0:1787892899.685402:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493236864 00000100:00100000:2.0:1787892899.685427:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787892899.685432:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000548fb427 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+9:6526:x1874741493236864:12345-0@lo:502: 00000100:00100000:2.0:1787892899.685533:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000548fb427 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+9:6526:x1874741493236864:12345-0@lo:502: Request processed in 100us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892899.685540:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787892899.685716:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001233f7e5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:6526:1874741493236864:0@lo:502: 00000020:01000000:0.0:1787892899.685731:0:6526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787892899.685741:0:6526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787892899.685745:0:6526:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787892899.685750:0:6526:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787892899.685752:0:6526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787892899.685765:0:6526:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000b2302f10) 00000020:00000080:0.0:1787892899.685782:0:6526:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787892899.685787:0:6526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787892899.685841:0:6526:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787892899.685846:0:6526:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9232577658cf0767 00000020:00000080:0.0:1787892899.686073:0:6526:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787892899.686077:0:6526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787892899.686086:0:6526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787892899.686087:0:6526:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787892899.686090:0:6526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787892899.686093:0:6526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787892899.686094:0:6526:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787892899.686096:0:6526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787892899.686101:0:6526:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000000dbb8593) 00000020:00000080:0.0:1787892899.686108:0:6526:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787892899.686110:0:6526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787892899.686111:0:6526:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787892899.686114:0:6526:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787892899.686118:0:6526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787892899.686175:0:6526:0:(tgt_mount.c:153:server_get_mount()) get mount 000000007f58b6c0 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787892899.686194:0:6526:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000a69d1e56) 00000020:00000080:0.0:1787892899.686203:0:6526:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787892899.686268:0:6526:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787892899.686274:0:6526:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9232577658cf077c 00000020:00000080:0.0:1787892899.686364:0:6526:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787892899.686471:0:6526:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787892899.686478:0:6526:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9232577658cf0783 00080000:01000000:0.0:1787892899.686484:0:6526:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787892899.686487:0:6526:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9232577658cf078a 00080000:10000000:0.0:1787892899.689475:0:6526:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1787892899.689782:0:6526:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1787892899.693194:0:6526:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1787892899.845437:0:6526:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1787892899.845771:0:6526:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1787892899.847960:0:6526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1787892899.850548:0:6526:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787892899.855703:0:6526:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000041124d9b) 00000020:00000080:0.0:1787892899.855726:0:6526:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1787892899.855803:0:6526:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787892899.855815:0:6526:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9232577658cf0798 00000020:00000080:1.0:1787892899.863271:0:6526:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1787892899.864758:0:6526:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:1.0:1787892899.877532:0:6526:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:0.0:1787892899.888042:0:6526:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:0.0:1787892899.893453:0:6526:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:2.0:1787892899.904551:0:6526:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:2.0:1787892899.910340:0:6526:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:2.0:1787892899.918419:0:6526:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9232577658cf079f 00000020:00000080:2.0:1787892899.919359:0:6526:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787892899.919372:0:6526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787892899.919379:0:6526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787892899.919386:0:6526:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787892899.919389:0:6526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787892899.919393:0:6526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787892899.919394:0:6526:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787892899.919397:0:6526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787892899.919399:0:6526:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787892899.919402:0:6526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787892899.919404:0:6526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787892899.919405:0:6526:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787892899.919407:0:6526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787892899.919411:0:6526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787892899.919412:0:6526:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787892899.919416:0:6526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787892899.919455:0:6526:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1787892899.919532:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000162ec1ef pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:6526:1874741493236992:0@lo:502: 00000100:00100000:2.0:1787892899.919610:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892899.919720:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set 0000000026653780 going to sleep for 11 seconds 00000100:00100000:3.0:1787892899.919774:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493236992 00000100:00100000:3.0:1787892899.919781:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493236992 00000100:00100000:3.0:1787892899.919833:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787892899.919840:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ccc02095 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+9:6526:x1874741493236992:12345-0@lo:502: 00000100:00100000:3.0:1787892899.919943:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ccc02095 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+9:6526:x1874741493236992:12345-0@lo:502: Request processed in 104us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892899.919950:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787892899.920525:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000162ec1ef pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:6526:1874741493236992:0@lo:502: 00000020:01000000:1.0:1787892899.920559:0:6526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787892899.920564:0:6526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787892899.920566:0:6526:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1787892899.920570:0:6526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1787892899.920838:0:6482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1787892899.920869:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787892899.920909:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: 00000000bdb19d19/0x9232577658cf0752 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0759 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892899.920920:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: 00000000bdb19d19/0x9232577658cf0752 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0759 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787892899.920928:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc9d909c800 from 1 10000000:01000000:3.0:1787892899.920931:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787892899.920958:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: 00000000d02c30bd/0x9232577658cf07a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892899.920970:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: 00000000d02c30bd/0x9232577658cf07a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892899.920979:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: 00000000d02c30bd/0x9232577658cf07a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892899.920994:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000aecbd066 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:6482:1874741493237120:0@lo:101: 00000100:00100000:3.0:1787892899.921032:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892899.921063:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set 00000000973b8a27 going to sleep for 11 seconds 00000100:00100000:0.0:1787892899.921129:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493237120 00000100:00100000:0.0:1787892899.921134:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493237120 00000100:00100000:0.0:1787892899.921171:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787892899.921179:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a9edf531 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+9:6482:x1874741493237120:12345-0@lo:101: 00010000:00010000:0.0:1787892899.921188:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787892899.921200:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f66a0dc2/0x9232577658cf07ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf07a6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892899.921219:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f66a0dc2/0x9232577658cf07ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf07a6 expref: 10 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892899.921227:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f66a0dc2/0x9232577658cf07ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf07a6 expref: 10 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892899.921235:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f66a0dc2, rc 0) 00000100:00100000:0.0:1787892899.921316:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a9edf531 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+10:6482:x1874741493237120:12345-0@lo:101: Request processed in 138us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892899.921323:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787892899.921419:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000aecbd066 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:6482:1874741493237120:0@lo:101: 00010000:00010000:2.0:1787892899.921671:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: 00000000d02c30bd/0x9232577658cf07a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf07ad expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892899.921680:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: 00000000d02c30bd/0x9232577658cf07a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf07ad expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892899.922220:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a6f4fd46 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:6482:1874741493237248:0@lo:256: 00000100:00100000:3.0:1787892899.922258:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892899.922331:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set 000000009a625fdf going to sleep for 11 seconds 00000100:00100000:2.0:1787892899.922377:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493237248 00000100:00100000:2.0:1787892899.922382:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493237248 00000100:00100000:2.0:1787892899.922562:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787892899.922570:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000085d87140 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+10:6482:x1874741493237248:12345-0@lo:256: 20000000:01000000:2.0:1787892899.922596:0:6499:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787892899.922602:0:6499:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787892899.922684:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000085d87140 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+10:6482:x1874741493237248:12345-0@lo:256: Request processed in 115us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892899.922691:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787892899.922757:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a6f4fd46 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:6482:1874741493237248:0@lo:256: 10000000:01000000:3.0:1787892899.923258:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787892899.923273:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: 00000000d02c30bd/0x9232577658cf07a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf07ad expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892899.923283:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: 00000000d02c30bd/0x9232577658cf07a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf07ad expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787892899.923290:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc9d909c800 from 1 10000000:01000000:3.0:1787892899.923293:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787892899.923313:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: 0000000049ea5268/0x9232577658cf07b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892899.923320:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: 0000000049ea5268/0x9232577658cf07b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892899.923338:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: 0000000049ea5268/0x9232577658cf07b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892899.923349:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a6f4fd46 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:6482:1874741493237376:0@lo:101: 00000100:00100000:3.0:1787892899.923377:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892899.923811:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set 000000009a625fdf going to sleep for 11 seconds 00000100:00100000:0.0:1787892899.923902:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493237376 00000100:00100000:0.0:1787892899.923909:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493237376 00000100:00100000:0.0:1787892899.923935:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787892899.923941:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000757fcf38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+10:6482:x1874741493237376:12345-0@lo:101: 00010000:00010000:0.0:1787892899.923949:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787892899.923960:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000005cdc76c/0x9232577658cf07bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf07b4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892899.923978:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000005cdc76c/0x9232577658cf07bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf07b4 expref: 11 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892899.923994:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000005cdc76c/0x9232577658cf07bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf07b4 expref: 11 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892899.924001:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000005cdc76c, rc 0) 00000100:00100000:0.0:1787892899.924039:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000757fcf38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+11:6482:x1874741493237376:12345-0@lo:101: Request processed in 98us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892899.924045:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787892899.924135:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a6f4fd46 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:6482:1874741493237376:0@lo:101: 00010000:00010000:3.0:1787892899.924145:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: 0000000049ea5268/0x9232577658cf07b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf07bb expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892899.924153:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: 0000000049ea5268/0x9232577658cf07b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf07bb expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892899.924198:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a6f4fd46 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:6482:1874741493237504:0@lo:501: 00000100:00100000:3.0:1787892899.924219:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892899.924236:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set 000000009a625fdf going to sleep for 11 seconds 00000100:00100000:0.0:1787892899.924280:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493237504 00000100:00100000:0.0:1787892899.924284:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493237504 00000100:00100000:0.0:1787892899.924309:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787892899.924313:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000030d6513d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+11:6482:x1874741493237504:12345-0@lo:501: 00000100:00100000:0.0:1787892899.924460:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000030d6513d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+11:6482:x1874741493237504:12345-0@lo:501: Request processed in 147us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892899.924467:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787892899.924666:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a6f4fd46 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:6482:1874741493237504:0@lo:501: 00000100:00100000:3.0:1787892899.924688:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a6f4fd46 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:6482:1874741493237632:0@lo:503: 00000100:00100000:3.0:1787892899.924720:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892899.924744:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set 000000009a625fdf going to sleep for 11 seconds 00000100:00100000:0.0:1787892899.924783:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493237632 00000100:00100000:0.0:1787892899.924787:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493237632 00000100:00100000:0.0:1787892899.924802:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787892899.924806:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000996896a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+11:6482:x1874741493237632:12345-0@lo:503: 00000040:00080000:0.0:1787892899.924830:0:6497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787892899.924866:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000996896a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+11:6482:x1874741493237632:12345-0@lo:503: Request processed in 60us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892899.924872:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787892899.924941:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a6f4fd46 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:6482:1874741493237632:0@lo:503: 00000040:00080000:3.0:1787892899.926069:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1787892899.926306:0:6482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1787892899.926326:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787892899.926346:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: 0000000049ea5268/0x9232577658cf07b4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf07bb expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892899.926372:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: 0000000049ea5268/0x9232577658cf07b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf07bb expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787892899.926419:0:6482:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787892899.926422:0:6482:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fc9d909c800 10000000:01000000:0.0:1787892899.926425:0:6482:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fc9d909c800 10000000:01000000:0.0:1787892899.926428:0:6482:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787892899.926433:0:6482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc9d909c800 from 1 10000000:01000000:0.0:1787892899.926435:0:6482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787892899.926464:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: 000000006127e5fc/0x9232577658cf07c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892899.926471:0:6482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: 000000006127e5fc/0x9232577658cf07c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892899.926481:0:6482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: 000000006127e5fc/0x9232577658cf07c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892899.926516:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001233f7e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:6482:1874741493237760:0@lo:101: 00000100:00100000:0.0:1787892899.926566:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892899.926595:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set 000000002d831075 going to sleep for 11 seconds 00000100:00100000:0.0:1787892899.926613:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493237760 00000100:00100000:0.0:1787892899.926619:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493237760 00000100:00100000:0.0:1787892899.926645:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787892899.926651:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c05dbfb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+11:6482:x1874741493237760:12345-0@lo:101: 00010000:00010000:0.0:1787892899.926661:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787892899.926670:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006ea533e4/0x9232577658cf07c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf07c2 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892899.926698:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006ea533e4/0x9232577658cf07c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf07c2 expref: 12 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892899.926707:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006ea533e4/0x9232577658cf07c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf07c2 expref: 12 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892899.926715:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006ea533e4, rc 0) 00000100:00100000:0.0:1787892899.926741:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c05dbfb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+12:6482:x1874741493237760:12345-0@lo:101: Request processed in 91us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892899.926747:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787892899.926783:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001233f7e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:6482:1874741493237760:0@lo:101: 00010000:00010000:0.0:1787892899.926795:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: 000000006127e5fc/0x9232577658cf07c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf07c9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892899.926803:0:6482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: 000000006127e5fc/0x9232577658cf07c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf07c9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892899.926848:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001233f7e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:6482:1874741493237888:0@lo:501: 00000100:00100000:0.0:1787892899.926867:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892899.926878:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set 000000002d831075 going to sleep for 11 seconds 00000100:00100000:0.0:1787892899.926887:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493237888 00000100:00100000:0.0:1787892899.926891:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493237888 00000100:00100000:0.0:1787892899.926904:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787892899.926908:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ce3d658 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+12:6482:x1874741493237888:12345-0@lo:501: 00000100:00100000:0.0:1787892899.927000:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ce3d658 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+12:6482:x1874741493237888:12345-0@lo:501: Request processed in 92us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892899.927007:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787892899.927040:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001233f7e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:6482:1874741493237888:0@lo:501: 00000100:00100000:0.0:1787892899.927061:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001233f7e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:6482:1874741493238016:0@lo:503: 00000100:00100000:0.0:1787892899.927090:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892899.927101:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set 000000002d831075 going to sleep for 11 seconds 00000100:00100000:0.0:1787892899.927111:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493238016 00000100:00100000:0.0:1787892899.927114:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493238016 00000100:00100000:0.0:1787892899.927141:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787892899.927146:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fed24f04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+12:6482:x1874741493238016:12345-0@lo:503: 00000100:00100000:0.0:1787892899.927213:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fed24f04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+12:6482:x1874741493238016:12345-0@lo:503: Request processed in 67us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892899.927218:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787892899.927254:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001233f7e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:6482:1874741493238016:0@lo:503: 00000100:00100000:1.0:1787892899.928395:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009161a6c8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:6531:1874741493238144:0@lo:502: 00000100:00100000:1.0:1787892899.928793:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892899.928833:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set 00000000075673f4 going to sleep for 11 seconds 00000100:00100000:2.0:1787892899.928879:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493238144 00000100:00100000:2.0:1787892899.928884:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493238144 00000100:00100000:2.0:1787892899.928932:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787892899.928940:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045fe7c5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+12:6531:x1874741493238144:12345-0@lo:502: 00000100:00100000:2.0:1787892899.929064:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045fe7c5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+12:6531:x1874741493238144:12345-0@lo:502: Request processed in 124us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892899.929070:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787892899.929157:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009161a6c8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:6531:1874741493238144:0@lo:502: 00000020:01000004:1.0:1787892899.929216:0:6531:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787892899.929230:0:6531:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000001692c128) 00000020:00000080:1.0:1787892899.929246:0:6531:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1787892899.929343:0:6531:0:(tgt_mount.c:153:server_get_mount()) get mount 000000007f58b6c0 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787892899.929348:0:6531:0:(tgt_mount.c:187:server_put_mount()) put mount 000000007f58b6c0 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787892899.929350:0:6531:0:(obd_mount.c:710:lustre_put_lsi()) put 000000007f58b6c0 4 00010000:00080000:1.0:1787892899.929376:0:6531:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000097ecf013@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.135@tcp at head 00010000:00010000:1.0:1787892899.931785:0:6531:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1787892899.932045:0:6531:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787892899.932092:0:6531:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787892899.932108:0:6531:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9232577658cf07d7 00000100:00080000:1.0:1787892899.932130:0:6531:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787892899.932137:0:6531:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000097ecf013 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:1.0:1787892899.932176:0:6531:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000009161a6c8 x1874741493238272/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787892899.932208:0:6531:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787892899.932376:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009161a6c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874741493238272:0@lo:38: 00000100:00100000:3.0:1787892899.932469:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892899.934228:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493238272 00000100:00100000:1.0:1787892899.934241:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493238272 00000100:00100000:1.0:1787892899.934325:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787892899.934332:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a6f4fd46 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3629:x1874741493238272:12345-0@lo:38: 00000100:00100000:1.0:1787892899.934442:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a6f4fd46 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3629:x1874741493238272:12345-0@lo:38: Request processed in 109us (1973us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787892899.934450:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787892899.935599:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787892899.935610:0:3629:0:(import.c:65:import_set_state_nolock()) 0000000097ecf013 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787892899.935617:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787892899.935620:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009161a6c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874741493238272:0@lo:38: 00000100:00100000:0.0:1787892899.935788:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001233f7e5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:6531:1874741493238400:0@lo:502: 00000100:00100000:0.0:1787892899.935850:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892899.935883:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set 000000002d831075 going to sleep for 11 seconds 00000100:00100000:1.0:1787892899.941391:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493238400 00000100:00100000:1.0:1787892899.941407:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493238400 00000100:00100000:1.0:1787892899.941767:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787892899.941776:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000889ba401 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+12:6531:x1874741493238400:12345-0@lo:502: 00000100:00100000:1.0:1787892899.941944:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000889ba401 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+12:6531:x1874741493238400:12345-0@lo:502: Request processed in 169us (6094us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892899.941952:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787892899.942095:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001233f7e5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:6531:1874741493238400:0@lo:502: 00000040:00080000:0.0:1787892899.942136:0:6531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1787892899.942287:0:6482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1787892899.942311:0:6482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787892899.942366:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: 000000006127e5fc/0x9232577658cf07c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf07c9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892899.942378:0:6482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: 000000006127e5fc/0x9232577658cf07c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf07c9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787892899.942434:0:6482:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787892899.942436:0:6482:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787892899.942438:0:6482:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787892899.942439:0:6482:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787892899.942440:0:6482:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787892899.942441:0:6482:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787892899.942442:0:6482:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787892899.942444:0:6482:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787892899.942445:0:6482:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787892899.942447:0:6482:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787892899.942448:0:6482:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787892899.942449:0:6482:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787892899.942453:0:6482:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1787892899.942455:0:6482:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787892899.942461:0:6482:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787892899.942462:0:6482:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787892899.942463:0:6482:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787892899.942464:0:6482:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787892899.942464:0:6482:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787892899.942465:0:6482:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787892899.942466:0:6482:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787892899.942467:0:6482:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787892899.942468:0:6482:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787892899.942469:0:6482:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787892899.942469:0:6482:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787892899.942520:0:6482:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787892899.942536:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000093857c5a pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:6482:1874741493238528:0@lo:253: 00000100:00100000:1.0:1787892899.942702:0:6482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892899.942738:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set 00000000581b0bb0 going to sleep for 11 seconds 00000100:00100000:0.0:1787892899.942797:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493238528 00000100:00100000:0.0:1787892899.942803:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493238528 00000100:00100000:0.0:1787892899.942838:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787892899.942845:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000337939fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+12:6482:x1874741493238528:12345-0@lo:253: 20000000:01000000:0.0:1787892899.942873:0:6499:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787892899.942886:0:6499:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787892899.954172:0:6499:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787892899.954191:0:6499:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1787892899.954210:0:6520:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787892899.954224:0:6520:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787892899.954243:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000bdc87414/0x9232577658cf07de lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892899.954262:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f66a0dc2/0x9232577658cf07ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf07a6 expref: 12 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892899.954270:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000bdc87414/0x9232577658cf07de lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892899.954305:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f66a0dc2/0x9232577658cf07ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf07a6 expref: 12 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892899.954321:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f66a0dc2/0x9232577658cf07ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf07a6 expref: 12 pid: 6497 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892899.954335:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b2f89cdc pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6520:1874741493238656:0@lo:104: 00000100:00100000:3.0:1787892899.954413:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892899.954481:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set 00000000973b8a27 going to sleep for 11 seconds 00000100:00100000:0.0:1787892899.954644:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493238656 00000100:00100000:0.0:1787892899.954652:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493238656 00000100:00100000:0.0:1787892899.954703:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787892899.954711:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003de100c2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ad7764-cf95-4087-88aa-57e4229a8397+3:6520:x1874741493238656:12345-0@lo:104: 00010000:00010000:0.0:1787892899.954724:0:6488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: 00000000d02c30bd/0x9232577658cf07a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf07ad expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892899.955338:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787892899.955345:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003de100c2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ad7764-cf95-4087-88aa-57e4229a8397+3:6520:x1874741493238656:12345-0@lo:104: Request processed in 635us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892899.955353:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787892899.955382:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787892899.955387:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: 00000000d02c30bd/0x9232577658cf07a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf07ad expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892899.955396:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d02c30bd already unused, calling callback (00000000196dfbc2) 10000000:00010000:1.0:1787892899.955399:0:6493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: 00000000d02c30bd/0x9232577658cf07a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf07ad expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892899.955407:0:6493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: 00000000d02c30bd/0x9232577658cf07a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf07ad expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787892899.955413:0:6493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: 00000000d02c30bd/0x9232577658cf07a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf07ad expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787892899.955418:0:6493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787892899.955458:0:6493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: 00000000d02c30bd/0x9232577658cf07a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf07ad expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892899.955465:0:6493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787892899.955522:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: 00000000d02c30bd/0x9232577658cf07a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf07ad expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892899.955529:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: 00000000d02c30bd/0x9232577658cf07a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf07ad expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892899.955547:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892899.955549:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892899.955550:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787892899.955574:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000901b997b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493238784:0@lo:103: 00000100:00100000:3.0:1787892899.955700:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b2f89cdc pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6520:1874741493238656:0@lo:104: 00010000:00010000:3.0:1787892899.955719:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000bdc87414/0x9232577658cf07de lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892899.955830:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892899.955888:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000337939fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+12:6482:x1874741493238528:12345-0@lo:253: Request processed in 13042us (13312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892899.955896:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787892899.955935:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493238784 00000100:00100000:3.0:1787892899.955940:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493238784 00010000:00010000:3.0:1787892899.955960:0:6490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f66a0dc2/0x9232577658cf07ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf07a6 expref: 12 pid: 6497 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892899.955990:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787892899.955997:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001233f7e5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ad7764-cf95-4087-88aa-57e4229a8397+12:3631:x1874741493238784:12345-0@lo:103: 00010000:00010000:3.0:1787892899.956007:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787892899.956018:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f66a0dc2/0x9232577658cf07ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf07a6 expref: 12 pid: 6497 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892899.956028:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f66a0dc2/0x9232577658cf07ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf07a6 expref: 12 pid: 6497 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892899.956039:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f66a0dc2/0x9232577658cf07ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf07a6 expref: 12 pid: 6497 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892899.956050:0:6490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000bdc87414/0x9232577658cf07de lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892899.956057:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bdc87414/0x9232577658cf07de lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787892899.956069:0:6490:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001846668s 00010000:00010000:3.0:1787892899.956072:0:6490:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bdc87414/0x9232577658cf07de lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892899.956078:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bdc87414/0x9232577658cf07de lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892899.956084:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000bdc87414/0x9232577658cf07de lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892899.956088:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000bdc87414/0x9232577658cf07de lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892899.956093:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bdc87414 already unused, calling callback (0000000010b23f3a) 00010000:00010000:3.0:1787892899.956097:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000bdc87414/0x9232577658cf07de lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892899.956102:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000bdc87414/0x9232577658cf07de lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892899.956204:0:6520:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000bdc87414/0x9232577658cf07de lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892899.956211:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000bdc87414/0x9232577658cf07de lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892899.956241:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000bdc87414/0x9232577658cf07de lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892899.956248:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bdc87414/0x9232577658cf07de lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892899.956260:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787892899.956326:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001233f7e5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ad7764-cf95-4087-88aa-57e4229a8397+11:3631:x1874741493238784:12345-0@lo:103: Request processed in 330us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892899.956333:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787892899.956595:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000901b997b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493238784:0@lo:103: 00000100:00100000:1.0:1787892899.957281:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000093857c5a pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:6482:1874741493238528:0@lo:253: 10000000:01000000:1.0:1787892899.957297:0:6482:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787892899.957301:0:6482:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787892899.957302:0:6482:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787892899.957304:0:6482:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787892899.957305:0:6482:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787892899.957306:0:6482:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787892899.957307:0:6482:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787892899.957309:0:6482:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787892899.957311:0:6482:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787892899.957312:0:6482:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787892899.957314:0:6482:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787892899.957315:0:6482:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787892899.957317:0:6482:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787892899.957329:0:6482:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787892899.964432:0:6482:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:1.0:1787892899.964637:0:6482:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1787892899.964919:0:6482:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:1.0:1787892899.965074:0:6482:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1787892899.965271:0:6482:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:1.0:1787892899.965450:0:6482:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1787892899.967680:0:6482:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1787892899.967866:0:6482:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1787892899.968107:0:6482:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:2.0:1787892899.968308:0:6482:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1787892899.968541:0:6482:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:3.0:1787892899.974688:0:6482:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:3.0:1787892899.979768:0:6482:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1787892900.005994:0:6482:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1787892900.006012:0:6536:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1787892900.006017:0:6536:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1787892900.006342:0:6537:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787892900.008556:0:6482:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787892900.008677:0:6482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787892900.009074:0:6482:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787892900.009092:0:6482:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787892900.009222:0:6482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787892900.010218:0:6482:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787892900.010798:0:6482:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787892900.010833:0:6482:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1787892900.011012:0:6482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787892900.015877:0:6537:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787892900.016360:0:6482:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00000040:00080000:1.0:1787892900.020089:0:6537:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787892900.020193:0:6537:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787892900.020198:0:6537:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:2.0:1787892900.024008:0:6482:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1787892900.024229:0:6482:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1787892900.024393:0:6482:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1787892900.024571:0:6482:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1787892900.026370:0:6482:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1787892900.026968:0:6482:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1787892900.027164:0:6482:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1787892900.027309:0:6482:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1787892900.027437:0:6482:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1787892900.028020:0:6482:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1787892900.028200:0:6482:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1787892900.028353:0:6482:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1787892900.028721:0:6482:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1787892900.028869:0:6482:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1787892900.029020:0:6482:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1787892900.029202:0:6482:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1787892900.029525:0:6482:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1787892900.029925:0:6482:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1787892900.030311:0:6482:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1787892900.030454:0:6482:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1787892900.030771:0:6482:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1787892900.030933:0:6482:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1787892900.033862:0:6482:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1787892900.035755:0:6482:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1787892900.035968:0:6482:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1787892900.037397:0:6482:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1787892900.037890:0:6482:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1787892900.038831:0:6482:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1787892900.039014:0:6482:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1787892900.039648:0:6482:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1787892900.039800:0:6482:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1787892900.039949:0:6482:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1787892900.040195:0:6482:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1787892900.048952:0:6482:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787892900.048992:0:6482:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbaa0c1c83988 00100000:10000000:2.0:1787892900.049000:0:6482:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787892900.049672:0:6482:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787892900.049688:0:6482:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.135@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787892900.049704:0:6482:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1787892900.049722:0:6482:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1787892900.050482:0:6482:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787892900.054669:0:6482:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1787892900.467474:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892901.489662:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892902.526965:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892903.537711:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892904.561713:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787892904.731959:0:6782:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg235-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1787892905.141097:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787892905.141106:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787892905.141109:0:36:0:(import.c:65:import_set_state_nolock()) 0000000097ecf013 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787892905.141120:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000097ecf013 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:3.0:1787892905.141141:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000288d2d36 x1874741493239040/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787892905.141356:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787892905.141370:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b2f89cdc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493238912:0@lo:400: 00000100:00100000:3.0:1787892905.141440:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892905.141520:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493238912 00000100:00100000:3.0:1787892905.141537:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493238912 00000100:00100000:3.0:1787892905.141587:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787892905.141602:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017032186 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+11:3633:x1874741493238912:12345-0@lo:400: 00000100:00100000:3.0:1787892905.141651:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017032186 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+11:3633:x1874741493238912:12345-0@lo:400: Request processed in 51us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892905.141658:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787892905.141699:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b2f89cdc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493238912:0@lo:400: 00000100:00100000:0.0:1787892905.143577:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000288d2d36 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874741493239040:0@lo:38: 00000100:00100000:0.0:1787892905.143647:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892905.146331:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493239040 00000100:00100000:3.0:1787892905.146347:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493239040 00000100:00100000:3.0:1787892905.146389:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787892905.146397:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e682a125 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3629:x1874741493239040:12345-0@lo:38: 00010000:00080000:3.0:1787892905.146428:0:6506:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 148 last 0 00000020:00000080:3.0:1787892905.146468:0:6506:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9232577658cf07e5 00000004:00100000:3.0:1787892905.146856:0:6506:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787892905.146993:0:6506:0:(import.c:65:import_set_state_nolock()) 0000000021dbc0cb : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787892905.147096:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e682a125 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1874741493239040:12345-0@lo:38: Request processed in 698us (3448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892905.147103:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787892905.147692:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000288d2d36 x1874741493239040/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787892915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787892905.147711:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787892905.147718:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787892905.147722:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787892905.147724:0:3629:0:(import.c:65:import_set_state_nolock()) 0000000097ecf013 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787892905.147730:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000288d2d36 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874741493239040:0@lo:38: 00010000:00010000:3.0:1787892905.588409:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787892905.896808:0:6834:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787892905.896966:0:6834:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787892906.609764:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892907.633644:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787892908.213690:0:6502:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787892908.213700:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc9d909c800 from 3 10000000:01000000:2.0:1787892908.213705:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787892908.213756:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: 000000005827ab40/0x9232577658cf07ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892908.213768:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: 000000005827ab40/0x9232577658cf07ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892908.213779:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: 000000005827ab40/0x9232577658cf07ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892908.213802:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009f99824f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493239168:0@lo:101: 00000100:00100000:2.0:1787892908.213872:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892908.213924:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set 000000004aaaea9c going to sleep for 11 seconds 00000100:00100000:0.0:1787892908.214078:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493239168 00000100:00100000:0.0:1787892908.214086:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493239168 00000100:00100000:0.0:1787892908.214134:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787892908.214142:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f12b619 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+11:6502:x1874741493239168:12345-0@lo:101: 00010000:00010000:0.0:1787892908.214163:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787892908.214176:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000019542834/0x9232577658cf07f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf07ec expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892908.214197:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000019542834/0x9232577658cf07f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf07ec expref: 12 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892908.214206:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000019542834/0x9232577658cf07f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf07ec expref: 12 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892908.214215:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000019542834, rc 0) 00000100:00100000:0.0:1787892908.214263:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f12b619 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+12:6502:x1874741493239168:12345-0@lo:101: Request processed in 122us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892908.214270:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787892908.214400:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009f99824f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493239168:0@lo:101: 00010000:00010000:2.0:1787892908.214414:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: 000000005827ab40/0x9232577658cf07ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf07f3 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892908.214437:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: 000000005827ab40/0x9232577658cf07ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf07f3 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892908.214482:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009f99824f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493239296:0@lo:256: 00000100:00100000:2.0:1787892908.214563:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892908.214589:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set 000000004aaaea9c going to sleep for 11 seconds 00000100:00100000:1.0:1787892908.214706:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493239296 00000100:00100000:1.0:1787892908.214711:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493239296 00000100:00100000:1.0:1787892908.214735:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787892908.214742:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088b28018 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+12:6502:x1874741493239296:12345-0@lo:256: 20000000:01000000:1.0:1787892908.214755:0:6500:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787892908.214771:0:6500:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787892908.214774:0:6500:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1787892908.214858:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088b28018 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+12:6502:x1874741493239296:12345-0@lo:256: Request processed in 117us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892908.214866:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787892908.216313:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009f99824f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493239296:0@lo:256: 10000000:01000000:2.0:1787892908.216380:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787892908.216388:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: 000000005827ab40/0x9232577658cf07ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf07f3 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892908.216398:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: 000000005827ab40/0x9232577658cf07ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf07f3 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892908.661074:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787892908.766004:0:6935:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787892908.766769:0:6935:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787892909.685954:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787892910.258833:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787892910.258860:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009f99824f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493239424:0@lo:400: 00000100:00100000:0.0:1787892910.258947:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892910.259020:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493239424 00000100:00100000:0.0:1787892910.259039:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493239424 00000100:00100000:0.0:1787892910.259081:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787892910.259088:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000761df701 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+12:3632:x1874741493239424:12345-0@lo:400: 00000100:00100000:2.0:1787892910.259128:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787892910.259135:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000761df701 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+12:3632:x1874741493239424:12345-0@lo:400: Request processed in 48us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892910.259137:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000377897d6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1874741493239552:0@lo:400: 00000100:00100000:0.0:1787892910.259142:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787892910.259169:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892910.259188:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009f99824f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493239424:0@lo:400: 00000100:00100000:1.0:1787892910.259275:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493239552 00000100:00100000:1.0:1787892910.259281:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493239552 00000100:00100000:2.0:1787892910.259827:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787892910.259834:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000579c1386 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1874741493239552:12345-0@lo:400: 00000100:00100000:2.0:1787892910.259887:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000579c1386 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1874741493239552:12345-0@lo:400: Request processed in 54us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892910.259893:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787892910.260077:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000377897d6 x1874741493239552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892910.260090:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000377897d6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1874741493239552:0@lo:400: 00010000:00010000:1.0:1787892910.714653:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892911.729912:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892912.753937:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892913.785570:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892914.807263:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892915.377867:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787892915.377891:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000071c9917d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874741493239808:0@lo:400: 00000100:00100000:1.0:1787892915.377967:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892915.378059:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493239808 00000100:00100000:1.0:1787892915.378082:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493239808 00000100:00100000:1.0:1787892915.378127:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787892915.378135:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aeef33e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1874741493239808:12345-0@lo:400: 00000100:00100000:1.0:1787892915.378188:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aeef33e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1874741493239808:12345-0@lo:400: Request processed in 54us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892915.378196:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787892915.378242:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000071c9917d x1874741493239808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892915.378255:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000071c9917d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874741493239808:0@lo:400: 00000100:00100000:0.0:1787892915.378446:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000093857c5a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493239680:0@lo:400: 00000100:00100000:0.0:1787892915.378484:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892915.378601:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493239680 00000100:00100000:3.0:1787892915.378607:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493239680 00000100:00100000:3.0:1787892915.378645:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787892915.378651:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2a43338 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+12:3631:x1874741493239680:12345-0@lo:400: 00000100:00100000:3.0:1787892915.378689:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2a43338 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+12:3631:x1874741493239680:12345-0@lo:400: Request processed in 39us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892915.378702:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787892915.378922:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000093857c5a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493239680:0@lo:400: 00010000:00010000:2.0:1787892915.862772:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892916.917288:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892917.937647:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892918.961671:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787892919.346051:0:7434:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787892919.346068:0:7434:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1787892919.346069:0:7434:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1787892919.346201:0:7434:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000d9a042c1 00000020:01000004:1.0:1787892919.346218:0:7434:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:1.0:1787892919.346229:0:7434:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787892919.346243:0:7434:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000ab2d3719) 00000020:00000080:1.0:1787892919.346257:0:7434:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787892919.416287:0:7434:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:2.0:1787892919.416372:0:7434:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:3.0:1787892919.447020:0:7434:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787892919.447750:0:7434:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1787892919.447762:0:7434:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787892919.447773:0:7434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9232577658cf0801 00000020:01000004:3.0:1787892919.447782:0:7434:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1787892919.447801:0:7434:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.135@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787892919.447804:0:7434:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.135@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787892919.447811:0:7434:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1787892919.447839:0:7434:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1787892919.447842:0:7434:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.135@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1787892919.466227:0:7434:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.135@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787892919.466270:0:7434:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.135@tcp, index=0001, flags=0x20061 00000020:01000004:3.0:1787892919.466274:0:7434:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787892919.466276:0:7434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787892919.466278:0:7434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787892919.466279:0:7434:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787892919.466280:0:7434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787892919.466281:0:7434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787892919.466282:0:7434:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787892919.466283:0:7434:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787892919.466285:0:7434:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787892919.466287:0:7434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787892919.466288:0:7434:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787892919.466292:0:7434:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:3.0:1787892919.466294:0:7434:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787892919.466296:0:7434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787892919.466297:0:7434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787892919.466298:0:7434:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787892919.466299:0:7434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787892919.466300:0:7434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787892919.466301:0:7434:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787892919.466302:0:7434:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787892919.466307:0:7434:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787892919.466308:0:7434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787892919.466309:0:7434:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787892919.466346:0:7434:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1787892919.466366:0:7434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b2f89cdc pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:7434:1874741493239936:0@lo:253: 00000100:00100000:3.0:1787892919.466760:0:7434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892919.466842:0:7434:0:(client.c:2715:ptlrpc_set_wait()) set 000000003cf7e7f7 going to sleep for 11 seconds 00000100:00100000:0.0:1787892919.466958:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493239936 00000100:00100000:0.0:1787892919.466967:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493239936 00000100:00100000:0.0:1787892919.467063:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787892919.467073:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c328694 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+12:7434:x1874741493239936:12345-0@lo:253: 20000000:01000000:0.0:1787892919.467104:0:6499:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787892919.467109:0:6499:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:0.0:1787892919.467114:0:6499:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:0.0:1787892919.467117:0:6499:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:0.0:1787892919.467151:0:6499:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:0.0:1787892919.467731:0:6499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787892919.467874:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1787892919.467900:0:6499:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787892919.467921:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1787892919.467959:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1787892919.467979:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1787892919.468039:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:0.0:1787892919.468047:0:6499:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:0.0:1787892919.468252:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:0.0:1787892919.468261:0:6499:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:0.0:1787892919.468274:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:0.0:1787892919.468279:0:6499:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:0.0:1787892919.468289:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1787892919.468303:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1787892919.468461:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:0.0:1787892919.468472:0:6499:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.135@tcp (null) (null) (null) 00000040:00080000:0.0:1787892919.468486:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:0.0:1787892919.468822:0:6499:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787892919.468844:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:0.0:1787892919.468851:0:6499:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.202.135@tcp (null) (null) 00000040:00080000:0.0:1787892919.468867:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:0.0:1787892919.468874:0:6499:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1787892919.468901:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1787892919.468921:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1787892919.468933:0:6499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1787892919.469027:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:0.0:1787892919.469037:0:6499:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:0.0:1787892919.469066:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1787892919.469086:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1787892919.469103:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:0.0:1787892919.469108:0:6499:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1787892919.469120:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1787892919.469139:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1787892919.469145:0:6499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:0.0:1787892919.469178:0:6499:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1787892919.469185:0:6499:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:1.0:1787892919.469583:0:7440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1787892919.469824:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1787892919.469847:0:6499:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.135@tcp for mdt 20000000:01000000:3.0:1787892919.469849:0:6499:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.135@tcp (null) (null) (null) 00000040:00080000:3.0:1787892919.469866:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1787892919.469874:0:6499:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787892919.469896:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1787892919.469904:0:6499:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.202.135@tcp (null) (null) 00000040:00080000:3.0:1787892919.469924:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1787892919.469932:0:6499:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:3.0:1787892919.469958:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:3.0:1787892919.469975:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:3.0:1787892919.470022:0:6499:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:3.0:1787892919.470030:0:6499:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:0.0:1787892919.471163:0:7441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:3.0:1787892919.471389:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1787892919.471793:0:6499:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.202.135@tcp for mdt 20000000:01000000:3.0:1787892919.471796:0:6499:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.135@tcp (null) (null) (null) 00000040:00080000:2.0:1787892919.471994:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1787892919.472006:0:6499:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787892919.472023:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1787892919.472029:0:6499:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.202.135@tcp (null) (null) 00000040:00080000:2.0:1787892919.472043:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1787892919.472050:0:6499:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:2.0:1787892919.472160:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1787892919.472180:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:2.0:1787892919.472207:0:6499:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787892919.472211:0:6499:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787892919.472214:0:6499:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787892919.472285:0:6499:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787892919.472287:0:6499:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787892919.473027:0:7442:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1787892919.473147:0:7442:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1787892919.473171:0:7442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1787892919.473360:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1787892919.473382:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1787892919.473480:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1787892919.477315:0:6499:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1787892919.477324:0:6499:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787892919.477963:0:7443:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1787892919.478010:0:7443:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1787892919.478026:0:7443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:3.0:1787892919.478364:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1787892919.478423:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1787892919.478443:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:3.0:1787892919.478454:0:6499:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787892919.478456:0:6499:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787892919.478870:0:7444:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1787892919.478897:0:7444:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1787892919.478913:0:7444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1787892919.479262:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:2.0:1787892919.479283:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:2.0:1787892919.479295:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:2.0:1787892919.479312:0:6499:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787892919.479314:0:6499:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787892919.479321:0:6499:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1787892919.479328:0:6499:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1787892919.480265:0:7445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:3.0:1787892919.480387:0:6499:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787892919.492751:0:6499:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787892919.492785:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d99f5e2b/0x9232577658cf0808 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.492804:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000df3051c2/0x9232577658cf073d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0736 expref: 12 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.492812:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009efa6137/0x9232577658cf0759 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0752 expref: 12 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.492818:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006ea533e4/0x9232577658cf07c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf07c2 expref: 12 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.492824:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000d99f5e2b/0x9232577658cf0808 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.492866:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006ea533e4/0x9232577658cf07c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf07c2 expref: 12 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.492882:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006ea533e4/0x9232577658cf07c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf07c2 expref: 12 pid: 6497 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892919.493162:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000949b5b1 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6499:1874741493240064:0@lo:104: 00000100:00100000:3.0:1787892919.493238:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787892919.493360:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009efa6137/0x9232577658cf0759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf0752 expref: 12 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.493369:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009efa6137/0x9232577658cf0759 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf0752 expref: 12 pid: 6499 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892919.493378:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000031cb715a pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6499:1874741493240192:0@lo:104: 00000100:00100000:3.0:1787892919.493430:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787892919.493788:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000df3051c2/0x9232577658cf073d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf0736 expref: 12 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.493798:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000df3051c2/0x9232577658cf073d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf0736 expref: 12 pid: 6497 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892919.493806:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005c16c023 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6499:1874741493240320:0@lo:104: 00000100:00100000:3.0:1787892919.493830:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892919.493854:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493240064 00000100:00100000:0.0:1787892919.493863:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493240064 00000100:00100000:0.0:1787892919.493919:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493240192 00000100:00100000:0.0:1787892919.493923:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493240192 00000100:00100000:0.0:1787892919.493952:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787892919.493961:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000076a6ba90 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ad7764-cf95-4087-88aa-57e4229a8397+4:6499:x1874741493240064:12345-0@lo:104: 00010000:00010000:0.0:1787892919.493973:0:6488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: 000000006127e5fc/0x9232577658cf07c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf07c9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892919.494026:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787892919.494031:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000076a6ba90 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ad7764-cf95-4087-88aa-57e4229a8397+4:6499:x1874741493240064:12345-0@lo:104: Request processed in 73us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892919.494038:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1787892919.494451:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787892919.494458:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: 000000006127e5fc/0x9232577658cf07c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf07c9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.494467:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006127e5fc already unused, calling callback (00000000196dfbc2) 10000000:00010000:2.0:1787892919.494470:0:6493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: 000000006127e5fc/0x9232577658cf07c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf07c9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.494479:0:6493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: 000000006127e5fc/0x9232577658cf07c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf07c9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787892919.494485:0:6493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: 000000006127e5fc/0x9232577658cf07c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf07c9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892919.494515:0:6493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787892919.494549:0:6493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: 000000006127e5fc/0x9232577658cf07c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf07c9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.494556:0:6493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787892919.494577:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: 000000006127e5fc/0x9232577658cf07c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf07c9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.494583:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: 000000006127e5fc/0x9232577658cf07c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf07c9 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.494598:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892919.494600:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892919.494601:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787892919.494622:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000006f6c4cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493240448:0@lo:103: 00000100:00100000:2.0:1787892919.494673:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892919.494719:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493240448 00000100:00100000:2.0:1787892919.494724:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493240448 00010000:00010000:2.0:1787892919.494742:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006ea533e4/0x9232577658cf07c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf07c2 expref: 13 pid: 6497 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892919.494766:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787892919.494773:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000834373c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ad7764-cf95-4087-88aa-57e4229a8397+13:3633:x1874741493240448:12345-0@lo:103: 00010000:00010000:2.0:1787892919.494785:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787892919.494790:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006ea533e4/0x9232577658cf07c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf07c2 expref: 13 pid: 6497 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.494800:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006ea533e4/0x9232577658cf07c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf07c2 expref: 13 pid: 6497 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.494816:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787892919.494844:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000834373c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ad7764-cf95-4087-88aa-57e4229a8397+13:3633:x1874741493240448:12345-0@lo:103: Request processed in 72us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892919.494851:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787892919.494900:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000006f6c4cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493240448:0@lo:103: 00000100:00100000:0.0:1787892919.495094:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787892919.495104:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000218ba58f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ad7764-cf95-4087-88aa-57e4229a8397+3:6499:x1874741493240192:12345-0@lo:104: 00010000:00010000:0.0:1787892919.495113:0:6488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: 00000000bdb19d19/0x9232577658cf0752 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0759 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892919.495157:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787892919.495162:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000218ba58f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ad7764-cf95-4087-88aa-57e4229a8397+3:6499:x1874741493240192:12345-0@lo:104: Request processed in 62us (1733us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892919.495168:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1787892919.495412:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787892919.495417:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: 00000000bdb19d19/0x9232577658cf0752 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0759 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.495425:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bdb19d19 already unused, calling callback (00000000196dfbc2) 10000000:00010000:2.0:1787892919.495428:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: 00000000bdb19d19/0x9232577658cf0752 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf0759 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.495434:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: 00000000bdb19d19/0x9232577658cf0752 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf0759 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787892919.495451:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: 00000000bdb19d19/0x9232577658cf0752 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf0759 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892919.495457:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787892919.495599:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: 00000000bdb19d19/0x9232577658cf0752 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0759 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.495606:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787892919.495647:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000006f6c4cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493240576:0@lo:103: 00000100:00100000:1.0:1787892919.495683:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787892919.495738:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: 00000000bdb19d19/0x9232577658cf0752 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0759 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.495746:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: 00000000bdb19d19/0x9232577658cf0752 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0759 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.495759:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892919.495761:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892919.495762:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787892919.495961:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f0d77b5f going to sleep for 11 seconds 00010000:00010000:3.0:1787892919.495983:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006ea533e4/0x9232577658cf07c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf07c2 expref: 12 pid: 6497 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892919.495994:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000949b5b1 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6499:1874741493240064:0@lo:104: 00000100:00100000:3.0:1787892919.496002:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000031cb715a pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6499:1874741493240192:0@lo:104: 00000100:00100000:0.0:1787892919.496050:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493240320 00000100:00100000:0.0:1787892919.496080:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493240320 00000100:00100000:0.0:1787892919.496128:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787892919.496134:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c499e24e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ad7764-cf95-4087-88aa-57e4229a8397+3:6499:x1874741493240320:12345-0@lo:104: 00010000:00010000:0.0:1787892919.496145:0:6488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: 00000000b76c75bd/0x9232577658cf0736 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf073d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892919.496198:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787892919.496203:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c499e24e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ad7764-cf95-4087-88aa-57e4229a8397+3:6499:x1874741493240320:12345-0@lo:104: Request processed in 70us (2373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892919.496210:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1787892919.496261:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787892919.496266:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: 00000000b76c75bd/0x9232577658cf0736 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf073d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.496273:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b76c75bd already unused, calling callback (00000000196dfbc2) 10000000:00010000:2.0:1787892919.496276:0:6493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: 00000000b76c75bd/0x9232577658cf0736 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf073d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.496282:0:6493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: 00000000b76c75bd/0x9232577658cf0736 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf073d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787892919.496287:0:6493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: 00000000b76c75bd/0x9232577658cf0736 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf073d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892919.496299:0:6493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787892919.496328:0:6493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: 00000000b76c75bd/0x9232577658cf0736 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf073d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.496334:0:6493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787892919.496380:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005c16c023 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6499:1874741493240320:0@lo:104: 00010000:00010000:3.0:1787892919.496414:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000d99f5e2b/0x9232577658cf0808 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892919.496556:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006ca1d6f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493240704:0@lo:103: 00000100:00100000:3.0:1787892919.496582:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892919.496820:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493240576 00000100:00100000:1.0:1787892919.496825:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493240576 00010000:00010000:1.0:1787892919.496843:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009efa6137/0x9232577658cf0759 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0752 expref: 12 pid: 6499 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892919.496967:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493240704 00000100:00100000:1.0:1787892919.496971:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493240704 00010000:00010000:1.0:1787892919.496982:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000df3051c2/0x9232577658cf073d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0736 expref: 13 pid: 6497 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.497034:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: 00000000b76c75bd/0x9232577658cf0736 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf073d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.497041:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: 00000000b76c75bd/0x9232577658cf0736 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf073d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.497064:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892919.497066:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892919.497067:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787892919.497244:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787892919.497254:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000093857c5a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ad7764-cf95-4087-88aa-57e4229a8397+13:3630:x1874741493240576:12345-0@lo:103: 00010000:00010000:3.0:1787892919.497266:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787892919.497271:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009efa6137/0x9232577658cf0759 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0752 expref: 13 pid: 6499 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.497280:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009efa6137/0x9232577658cf0759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf0752 expref: 13 pid: 6499 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.497298:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009efa6137/0x9232577658cf0759 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf0752 expref: 13 pid: 6499 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.497309:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787892919.497348:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000093857c5a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ad7764-cf95-4087-88aa-57e4229a8397+12:3630:x1874741493240576:12345-0@lo:103: Request processed in 97us (1666us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892919.497355:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787892919.497369:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787892919.497374:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c16c023 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ad7764-cf95-4087-88aa-57e4229a8397+11:3631:x1874741493240704:12345-0@lo:103: 00010000:00010000:3.0:1787892919.497380:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787892919.497383:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000df3051c2/0x9232577658cf073d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0736 expref: 11 pid: 6497 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.497391:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000df3051c2/0x9232577658cf073d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf0736 expref: 11 pid: 6497 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.497408:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000df3051c2/0x9232577658cf073d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf0736 expref: 11 pid: 6497 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.497417:0:6490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000d99f5e2b/0x9232577658cf0808 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.497423:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d99f5e2b/0x9232577658cf0808 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.497435:0:6490:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d99f5e2b/0x9232577658cf0808 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.497441:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d99f5e2b/0x9232577658cf0808 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.497452:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d99f5e2b/0x9232577658cf0808 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.497458:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d99f5e2b/0x9232577658cf0808 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.497462:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d99f5e2b already unused, calling callback (0000000010b23f3a) 00010000:00010000:3.0:1787892919.497465:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d99f5e2b/0x9232577658cf0808 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.497471:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d99f5e2b/0x9232577658cf0808 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.497483:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d99f5e2b/0x9232577658cf0808 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.497509:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787892919.497532:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c16c023 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ad7764-cf95-4087-88aa-57e4229a8397+10:3631:x1874741493240704:12345-0@lo:103: Request processed in 159us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892919.497538:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787892919.497563:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006ca1d6f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493240704:0@lo:103: 00010000:00010000:3.0:1787892919.497582:0:6499:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000d99f5e2b/0x9232577658cf0808 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.497588:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d99f5e2b/0x9232577658cf0808 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.497593:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d99f5e2b/0x9232577658cf0808 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787892919.497615:0:6499:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1787892919.498093:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000006f6c4cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493240576:0@lo:103: 00000100:00100000:1.0:1787892919.499779:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c328694 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+9:7434:x1874741493239936:12345-0@lo:253: Request processed in 32703us (33016us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892919.499792:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787892919.499872:0:7434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b2f89cdc pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:7434:1874741493239936:0@lo:253: 10000000:01000000:3.0:1787892919.499885:0:7434:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1787892919.499959:0:7434:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787892919.499961:0:7434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787892919.499962:0:7434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787892919.499963:0:7434:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:3.0:1787892919.499964:0:7434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787892919.499965:0:7434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787892919.499967:0:7434:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787892919.499968:0:7434:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787892919.499969:0:7434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787892919.499970:0:7434:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787892919.499990:0:7434:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d9a042c1 from lustre-MDT0001 10000000:01000000:3.0:1787892919.500017:0:7434:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1787892919.500020:0:7434:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1787892919.500026:0:7434:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fc9e2e3b370 local copy 10000000:01000000:3.0:1787892919.500031:0:7434:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787892919.500139:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: 00000000bdc87414/0x9232577658cf080f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.500151:0:7434:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.135@tcp lock: 00000000bdc87414/0x9232577658cf080f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.500159:0:7434:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: 00000000bdc87414/0x9232577658cf080f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892919.500176:0:7434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b2f89cdc pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:7434:1874741493240832:0@lo:101: 00000100:00100000:3.0:1787892919.500214:0:7434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892919.500255:0:7434:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f0d77b5f going to sleep for 11 seconds 00000100:00100000:1.0:1787892919.500302:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493240832 00000100:00100000:1.0:1787892919.500308:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493240832 00000100:00100000:1.0:1787892919.500347:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787892919.500355:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086b7d13f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+9:7434:x1874741493240832:12345-0@lo:101: 00010000:00010000:1.0:1787892919.500367:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787892919.500382:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000aea44c4/0x9232577658cf0816 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf080f expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892919.500414:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000aea44c4/0x9232577658cf0816 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf080f expref: 10 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892919.500424:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000aea44c4/0x9232577658cf0816 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf080f expref: 10 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892919.500431:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000aea44c4, rc 0) 00000100:00100000:1.0:1787892919.500469:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086b7d13f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+10:7434:x1874741493240832:12345-0@lo:101: Request processed in 116us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892919.500475:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787892919.500581:0:7434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b2f89cdc pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:7434:1874741493240832:0@lo:101: 00010000:00010000:2.0:1787892919.500593:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: 00000000bdc87414/0x9232577658cf080f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x9232577658cf0816 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.500600:0:7434:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: 00000000bdc87414/0x9232577658cf080f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9232577658cf0816 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892919.500683:0:7434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de1d2138 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:7434:1874741493240960:0@lo:501: 00000100:00100000:2.0:1787892919.500710:0:7434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892919.500734:0:7434:0:(client.c:2715:ptlrpc_set_wait()) set 000000000e38e131 going to sleep for 11 seconds 00000100:00100000:1.0:1787892919.500834:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493240960 00000100:00100000:1.0:1787892919.500838:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493240960 00000100:00100000:1.0:1787892919.500868:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787892919.500874:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb0e46f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+10:7434:x1874741493240960:12345-0@lo:501: 00000100:00100000:1.0:1787892919.501161:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb0e46f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+10:7434:x1874741493240960:12345-0@lo:501: Request processed in 286us (450us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787892919.501183:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787892919.501243:0:7434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de1d2138 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:7434:1874741493240960:0@lo:501: 10000000:01000000:2.0:1787892919.501256:0:7434:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.135@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787892919.501273:0:7434:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.135@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787892919.501283:0:7434:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: 00000000bdc87414/0x9232577658cf080f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9232577658cf0816 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.501290:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: 00000000bdc87414/0x9232577658cf080f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9232577658cf0816 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.501295:0:7434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: 00000000bdc87414/0x9232577658cf080f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9232577658cf0816 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.501323:0:7434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787892919.501345:0:7434:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fc9ed573800 10000000:01000000:2.0:1787892919.501349:0:7434:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787892919.501354:0:7434:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9fc9e2e3b370 10000000:01000000:2.0:1787892919.501356:0:7434:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787892919.501359:0:7434:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9fc9e2e3b370 from 1 10000000:01000000:2.0:1787892919.501361:0:7434:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787892919.501377:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: 00000000bf969c49/0x9232577658cf081d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.501384:0:7434:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: 00000000bf969c49/0x9232577658cf081d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.501392:0:7434:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: 00000000bf969c49/0x9232577658cf081d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892919.501416:0:7434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de1d2138 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:7434:1874741493241088:0@lo:101: 00000100:00100000:2.0:1787892919.501442:0:7434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892919.501456:0:7434:0:(client.c:2715:ptlrpc_set_wait()) set 000000001314b51e going to sleep for 11 seconds 00000100:00100000:2.0:1787892919.501470:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493241088 00000100:00100000:2.0:1787892919.501475:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493241088 00000100:00100000:2.0:1787892919.501522:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787892919.501535:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002fcd62e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+10:7434:x1874741493241088:12345-0@lo:101: 00010000:00010000:2.0:1787892919.501543:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787892919.501551:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f0208b40/0x9232577658cf0824 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf081d expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.501565:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f0208b40/0x9232577658cf0824 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf081d expref: 11 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.501572:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f0208b40/0x9232577658cf0824 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf081d expref: 11 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.501578:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f0208b40, rc 0) 00000100:00100000:2.0:1787892919.501605:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002fcd62e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+11:7434:x1874741493241088:12345-0@lo:101: Request processed in 71us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892919.501611:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787892919.501643:0:7434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de1d2138 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:7434:1874741493241088:0@lo:101: 00010000:00010000:2.0:1787892919.501652:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: 00000000bf969c49/0x9232577658cf081d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0824 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.501660:0:7434:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: 00000000bf969c49/0x9232577658cf081d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0824 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892919.501673:0:7434:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787892919.501684:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: 00000000bf969c49/0x9232577658cf081d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0824 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.501691:0:7434:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: 00000000bf969c49/0x9232577658cf081d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0824 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892919.501710:0:7434:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9fc9ed573800 10000000:01000000:2.0:1787892919.501713:0:7434:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787892919.501716:0:7434:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9fc9ed573800 from 1 10000000:01000000:2.0:1787892919.501718:0:7434:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787892919.501731:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: 00000000ac28bc9a/0x9232577658cf082b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.501738:0:7434:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: 00000000ac28bc9a/0x9232577658cf082b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.501745:0:7434:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: 00000000ac28bc9a/0x9232577658cf082b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892919.501757:0:7434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de1d2138 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:7434:1874741493241216:0@lo:101: 00000100:00100000:2.0:1787892919.501783:0:7434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892919.501796:0:7434:0:(client.c:2715:ptlrpc_set_wait()) set 000000001314b51e going to sleep for 11 seconds 00000100:00100000:2.0:1787892919.501809:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493241216 00000100:00100000:2.0:1787892919.501813:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493241216 00000100:00100000:2.0:1787892919.501830:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787892919.501836:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d0ce06b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+11:7434:x1874741493241216:12345-0@lo:101: 00010000:00010000:2.0:1787892919.501842:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787892919.501848:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009fa7179a/0x9232577658cf0832 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf082b expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.501861:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009fa7179a/0x9232577658cf0832 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf082b expref: 12 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.501868:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009fa7179a/0x9232577658cf0832 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf082b expref: 12 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.501880:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009fa7179a, rc 0) 00000100:00100000:2.0:1787892919.502047:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d0ce06b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+12:7434:x1874741493241216:12345-0@lo:101: Request processed in 211us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892919.502144:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787892919.502262:0:7434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de1d2138 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:7434:1874741493241216:0@lo:101: 00010000:00010000:2.0:1787892919.502273:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: 00000000ac28bc9a/0x9232577658cf082b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0832 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.502280:0:7434:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: 00000000ac28bc9a/0x9232577658cf082b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0832 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892919.502292:0:7434:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787892919.502295:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: 00000000ac28bc9a/0x9232577658cf082b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0832 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.502302:0:7434:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: 00000000ac28bc9a/0x9232577658cf082b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0832 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892919.502308:0:7434:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787892919.502312:0:7434:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787892919.502316:0:7434:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9fc9ed573800 10000000:01000000:2.0:1787892919.502318:0:7434:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787892919.502322:0:7434:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1787892919.502323:0:7434:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787892919.502335:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: 00000000ca4c469d/0x9232577658cf0839 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.502341:0:7434:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: 00000000ca4c469d/0x9232577658cf0839 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.502355:0:7434:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: 00000000ca4c469d/0x9232577658cf0839 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892919.502366:0:7434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de1d2138 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:7434:1874741493241344:0@lo:101: 00000100:00100000:2.0:1787892919.502392:0:7434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892919.502419:0:7434:0:(client.c:2715:ptlrpc_set_wait()) set 000000001314b51e going to sleep for 11 seconds 00000100:00100000:2.0:1787892919.502434:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493241344 00000100:00100000:2.0:1787892919.502437:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493241344 00000100:00100000:2.0:1787892919.502456:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787892919.502461:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011d638ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+12:7434:x1874741493241344:12345-0@lo:101: 00010000:00010000:2.0:1787892919.502468:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787892919.502474:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bb8a87c4/0x9232577658cf0840 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0839 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.502487:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bb8a87c4/0x9232577658cf0840 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0839 expref: 13 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.502511:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bb8a87c4/0x9232577658cf0840 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0839 expref: 13 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.502516:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bb8a87c4, rc 0) 00000100:00100000:2.0:1787892919.502544:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011d638ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+13:7434:x1874741493241344:12345-0@lo:101: Request processed in 83us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892919.502550:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787892919.502581:0:7434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de1d2138 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:7434:1874741493241344:0@lo:101: 00010000:00010000:2.0:1787892919.502590:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: 00000000ca4c469d/0x9232577658cf0839 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0840 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.502608:0:7434:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: 00000000ca4c469d/0x9232577658cf0839 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0840 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892919.502669:0:7434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de1d2138 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:7434:1874741493241472:0@lo:501: 00000100:00100000:2.0:1787892919.502695:0:7434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892919.502708:0:7434:0:(client.c:2715:ptlrpc_set_wait()) set 000000002b111207 going to sleep for 11 seconds 00000100:00100000:2.0:1787892919.502720:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493241472 00000100:00100000:2.0:1787892919.502723:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493241472 00000100:00100000:2.0:1787892919.502740:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787892919.502744:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e51f2dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+13:7434:x1874741493241472:12345-0@lo:501: 00000100:00100000:2.0:1787892919.502835:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e51f2dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+13:7434:x1874741493241472:12345-0@lo:501: Request processed in 91us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892919.502842:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787892919.502870:0:7434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de1d2138 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:7434:1874741493241472:0@lo:501: 00010000:00010000:1.0:1787892919.503185:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787892919.503192:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: 00000000bdc87414/0x9232577658cf080f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9232577658cf0816 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892919.503200:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bdc87414 already unused, calling callback (00000000196dfbc2) 10000000:00010000:1.0:1787892919.503203:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: 00000000bdc87414/0x9232577658cf080f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9232577658cf0816 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892919.503210:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: 00000000bdc87414/0x9232577658cf080f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x9232577658cf0816 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787892919.503217:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: 00000000bdc87414/0x9232577658cf080f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x9232577658cf0816 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787892919.503222:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787892919.503243:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: 00000000bdc87414/0x9232577658cf080f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9232577658cf0816 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892919.503249:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787892919.503280:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: 00000000bdc87414/0x9232577658cf080f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9232577658cf0816 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892919.503287:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: 00000000bdc87414/0x9232577658cf080f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9232577658cf0816 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892919.503301:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892919.503302:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892919.503303:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787892919.503350:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000071c9917d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493241600:0@lo:103: 00000100:00100000:3.0:1787892919.503409:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892919.503483:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493241600 00000100:00100000:1.0:1787892919.503521:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493241600 00000100:00100000:1.0:1787892919.503561:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787892919.503569:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031cb715a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ad7764-cf95-4087-88aa-57e4229a8397+13:3632:x1874741493241600:12345-0@lo:103: 00010000:00010000:1.0:1787892919.503579:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787892919.503591:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000aea44c4/0x9232577658cf0816 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9232577658cf080f expref: 13 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892919.503604:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787892919.503633:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031cb715a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ad7764-cf95-4087-88aa-57e4229a8397+12:3632:x1874741493241600:12345-0@lo:103: Request processed in 66us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892919.503639:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787892919.503710:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000071c9917d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493241600:0@lo:103: 00000100:00100000:2.0:1787892919.504310:0:7434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de1d2138 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:7434:1874741493241728:0@lo:503: 00000100:00100000:2.0:1787892919.504363:0:7434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892919.504408:0:7434:0:(client.c:2715:ptlrpc_set_wait()) set 000000002b111207 going to sleep for 11 seconds 00000100:00100000:1.0:1787892919.504632:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493241728 00000100:00100000:1.0:1787892919.504638:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493241728 00000100:00100000:1.0:1787892919.504678:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787892919.504685:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1dc3085 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+12:7434:x1874741493241728:12345-0@lo:503: 00000100:00100000:1.0:1787892919.504784:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1dc3085 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+12:7434:x1874741493241728:12345-0@lo:503: Request processed in 99us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892919.504792:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787892919.504873:0:7434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de1d2138 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:7434:1874741493241728:0@lo:503: 00000040:00080000:2.0:1787892919.505329:0:7434:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787892919.505415:0:7434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de1d2138 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:7434:1874741493241856:0@lo:502: 00000100:00100000:2.0:1787892919.505452:0:7434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892919.505479:0:7434:0:(client.c:2715:ptlrpc_set_wait()) set 000000000e38e131 going to sleep for 11 seconds 00000100:00100000:1.0:1787892919.505715:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493241856 00000100:00100000:1.0:1787892919.505722:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493241856 00000100:00100000:1.0:1787892919.505763:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787892919.505770:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d0be063 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+12:7434:x1874741493241856:12345-0@lo:502: 00000100:00100000:1.0:1787892919.505876:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d0be063 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+12:7434:x1874741493241856:12345-0@lo:502: Request processed in 106us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892919.505884:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787892919.506020:0:7434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de1d2138 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:7434:1874741493241856:0@lo:502: 00000040:00080000:3.0:1787892919.506225:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787892919.506254:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:3.0:1787892919.506269:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:3.0:1787892919.506282:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:3.0:1787892919.506293:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:3.0:1787892919.506307:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:3.0:1787892919.506320:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:3.0:1787892919.506335:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:3.0:1787892919.506350:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:3.0:1787892919.506362:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:3.0:1787892919.506374:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:3.0:1787892919.506387:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:3.0:1787892919.506415:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:3.0:1787892919.506432:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:3.0:1787892919.506445:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:3.0:1787892919.506458:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:3.0:1787892919.506471:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:3.0:1787892919.506485:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:3.0:1787892919.506531:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:3.0:1787892919.506544:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:3.0:1787892919.506557:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:3.0:1787892919.506570:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:3.0:1787892919.506581:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:3.0:1787892919.506605:0:7434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000949b5b1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:7434:1874741493241984:0@lo:502: 00000100:00100000:3.0:1787892919.506646:0:7434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892919.506662:0:7434:0:(client.c:2715:ptlrpc_set_wait()) set 000000004caceadf going to sleep for 11 seconds 00000100:00100000:2.0:1787892919.506868:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493241984 00000100:00100000:2.0:1787892919.506875:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493241984 00000100:00100000:2.0:1787892919.506908:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787892919.506922:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000df3d32bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+13:7434:x1874741493241984:12345-0@lo:502: 00000100:00100000:2.0:1787892919.507035:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000df3d32bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+13:7434:x1874741493241984:12345-0@lo:502: Request processed in 114us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892919.507042:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787892919.507255:0:7434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000949b5b1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:7434:1874741493241984:0@lo:502: 00000040:00080000:3.0:1787892919.507305:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:3.0:1787892919.507314:0:7434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:3.0:1787892919.507872:0:7446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787892919.507882:0:7446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787892919.507884:0:7446:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1787892919.507889:0:7446:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1787892919.507892:0:7446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787892919.507914:0:7446:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (0000000024980a3a) 00000020:00000080:3.0:1787892919.507933:0:7446:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:3.0:1787892919.507952:0:7446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787892919.508044:0:7446:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787892919.508052:0:7446:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9232577658cf084e 00000020:00000080:3.0:1787892919.508349:0:7446:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1787892919.508353:0:7446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787892919.508357:0:7446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787892919.508358:0:7446:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1787892919.508361:0:7446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787892919.508364:0:7446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787892919.508365:0:7446:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1787892919.508368:0:7446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787892919.508375:0:7446:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (000000003b7726d0) 00000020:00000080:3.0:1787892919.508385:0:7446:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:3.0:1787892919.508389:0:7446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787892919.508391:0:7446:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1787892919.508393:0:7446:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1787892919.508656:0:7446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787892919.508705:0:7446:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d9a042c1 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1787892919.508717:0:7446:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000640defdc) 00000020:00000080:3.0:1787892919.508726:0:7446:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:3.0:1787892919.508802:0:7446:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787892919.508808:0:7446:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9232577658cf0863 00000020:00000080:3.0:1787892919.509025:0:7446:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1787892919.509036:0:7446:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787892919.509041:0:7446:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x9232577658cf086a 00080000:01000000:3.0:1787892919.509046:0:7446:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787892919.509049:0:7446:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9232577658cf0871 00080000:10000000:3.0:1787892919.509669:0:7446:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1787892919.509808:0:7446:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:1.0:1787892919.611521:0:7446:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:1.0:1787892919.611768:0:7446:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:1.0:1787892919.614829:0:7446:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1787892919.615320:0:7446:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787892919.633477:0:7446:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1787892919.633517:0:7446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787892919.633526:0:7446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787892919.633529:0:7446:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1787892919.633533:0:7446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787892919.633540:0:7446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787892919.633542:0:7446:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1787892919.633544:0:7446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787892919.633550:0:7446:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.135@tcp to nid 0x20000c0a8ca87 (192.168.202.135@tcp) 00000020:00000080:3.0:1787892919.633587:0:7446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787892919.633604:0:7446:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000b0e07fdb) 00000020:00000080:3.0:1787892919.633630:0:7446:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1787892919.633636:0:7446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787892919.633737:0:7446:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1787892919.633744:0:7446:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787892919.633751:0:7446:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9232577658cf087f 00010000:00080000:3.0:1787892919.633787:0:7446:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000089493e8b@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.135@tcp at head 00010000:00010000:3.0:1787892919.645146:0:7446:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:2.0:1787892919.649388:0:7446:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787892919.649403:0:7446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1787892919.649442:0:7446:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787892919.649463:0:7446:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9232577658cf0886 00000100:00080000:2.0:1787892919.649473:0:7446:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787892919.649478:0:7446:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 0000000089493e8b using connection 192.168.202.135@tcp/0@lo 00000100:00100000:2.0:1787892919.649534:0:7446:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a0ee0935 x1874741493242112/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787892919.649564:0:7446:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787892919.649597:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a0ee0935 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493242112:0@lo:38: 00000020:01000000:2.0:1787892919.649622:0:7446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787892919.649626:0:7446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787892919.649627:0:7446:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1787892919.649630:0:7446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787892919.649632:0:7446:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1787892919.649634:0:7446:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787892919.649635:0:7446:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787892919.649636:0:7446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787892919.649638:0:7446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787892919.649639:0:7446:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787892919.649641:0:7446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787892919.649645:0:7446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787892919.649646:0:7446:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1787892919.649649:0:7446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787892919.649670:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:01000000:2.0:1787892919.649679:0:7446:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787892919.649691:0:7446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787892919.649694:0:7446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787892919.649701:0:7446:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1787892919.649705:0:7446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787892919.649708:0:7446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787892919.649709:0:7446:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787892919.649711:0:7446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787892919.649713:0:7446:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787892919.649739:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493242112 00000020:01000000:2.0:1787892919.649741:0:7446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787892919.649743:0:7446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787892919.649745:0:7446:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000100:00100000:3.0:1787892919.649746:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493242112 00000040:00080000:2.0:1787892919.649747:0:7446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:3.0:1787892919.649774:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787892919.649780:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000949b5b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3629:x1874741493242112:12345-0@lo:38: 00010000:00080000:3.0:1787892919.649801:0:6509:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 163 last 0 00000020:01000000:2.0:1787892919.649804:0:7434:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:2.0:1787892919.649830:0:7434:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787892919.649843:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: 00000000ca4c469d/0x9232577658cf0839 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0840 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1787892919.649845:0:6509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9232577658cf088d 00010000:00010000:2.0:1787892919.649853:0:7434:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: 00000000ca4c469d/0x9232577658cf0839 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0840 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00100000:3.0:1787892919.649858:0:6509:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 10000000:01000000:2.0:1787892919.649860:0:7434:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc9ed573800 from 1 10000000:01000000:2.0:1787892919.649862:0:7434:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000001:00000004:3.0:1787892919.649863:0:6509:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1787892919.649883:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: 00000000b76c75bd/0x9232577658cf0894 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.649890:0:7434:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: 00000000b76c75bd/0x9232577658cf0894 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.649898:0:7434:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: 00000000b76c75bd/0x9232577658cf0894 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892919.649910:0:7434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a2dbb7dc pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:7434:1874741493242240:0@lo:101: 00000100:00100000:2.0:1787892919.649956:0:7434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892919.649990:0:7434:0:(client.c:2715:ptlrpc_set_wait()) set 000000000df3f35a going to sleep for 11 seconds 00000100:00100000:2.0:1787892919.650012:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d19b12f6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874741493242368:0@lo:400: 00000100:00100000:2.0:1787892919.650039:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892919.650042:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493242240 00000100:00100000:3.0:1787892919.650046:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493242240 00000100:00100000:3.0:1787892919.650086:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787892919.650092:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3f0ead3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+12:7434:x1874741493242240:12345-0@lo:101: 00010000:00010000:3.0:1787892919.650103:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787892919.650113:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d99f5e2b/0x9232577658cf089b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0894 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.650131:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d99f5e2b/0x9232577658cf089b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0894 expref: 13 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.650140:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d99f5e2b/0x9232577658cf089b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0894 expref: 13 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.650147:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d99f5e2b, rc 0) 00000100:00100000:3.0:1787892919.650194:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3f0ead3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+13:7434:x1874741493242240:12345-0@lo:101: Request processed in 102us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892919.650200:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787892919.650330:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493242368 00000100:00100000:1.0:1787892919.650335:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493242368 00000100:00100000:1.0:1787892919.651237:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787892919.651248:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b42941a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1874741493242368:12345-0@lo:400: 00000100:00100000:1.0:1787892919.651306:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b42941a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1874741493242368:12345-0@lo:400: Request processed in 60us (1265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892919.651312:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787892919.651546:0:7434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a2dbb7dc pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:7434:1874741493242240:0@lo:101: 00010000:00010000:2.0:1787892919.651566:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: 00000000b76c75bd/0x9232577658cf0894 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf089b expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892919.651577:0:7434:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: 00000000b76c75bd/0x9232577658cf0894 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf089b expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892919.652117:0:7434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a2dbb7dc pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:7434:1874741493242496:0@lo:256: 00000100:00100000:2.0:1787892919.652175:0:7434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892919.652207:0:7434:0:(client.c:2715:ptlrpc_set_wait()) set 000000000df3f35a going to sleep for 11 seconds 00010000:00080000:2.0:1787892919.652237:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d19b12f6 x1874741493242368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892919.652248:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d19b12f6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874741493242368:0@lo:400: 00000100:00100000:2.0:1787892919.652283:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493242496 00000100:00100000:2.0:1787892919.652288:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493242496 00000100:00100000:2.0:1787892919.652319:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787892919.652326:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd561c7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+13:7434:x1874741493242496:12345-0@lo:256: 20000000:01000000:2.0:1787892919.654551:0:6499:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787892919.658619:0:6499:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787892919.658633:0:6499:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1787892919.660667:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd561c7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+13:7434:x1874741493242496:12345-0@lo:256: Request processed in 8331us (8482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892919.660684:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1787892919.662182:0:6509:0:(import.c:65:import_set_state_nolock()) 0000000052b9125c : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787892919.662275:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000949b5b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3629:x1874741493242112:12345-0@lo:38: Request processed in 12492us (12604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892919.662290:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787892919.662624:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787892919.662634:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1787892919.662642:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1787892919.662647:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787892919.662649:0:3629:0:(import.c:65:import_set_state_nolock()) 0000000089493e8b lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787892919.662664:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a0ee0935 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493242112:0@lo:38: 00000100:00100000:0.0:1787892919.662868:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009873c2e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493242624:0@lo:41: 00000100:00100000:0.0:1787892919.662908:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892919.663048:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493242624 00000100:00100000:2.0:1787892919.663069:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493242624 00000100:00100000:2.0:1787892919.663110:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787892919.663117:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd55396a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3630:x1874741493242624:12345-0@lo:41: 00000004:00000024:2.0:1787892919.663308:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1787892919.663415:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd55396a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3630:x1874741493242624:12345-0@lo:41: Request processed in 299us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892919.663422:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787892919.663695:0:7434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a2dbb7dc pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:7434:1874741493242496:0@lo:256: 10000000:01000000:3.0:1787892919.664761:0:7434:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787892919.664822:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: 00000000b76c75bd/0x9232577658cf0894 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf089b expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.664835:0:7434:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: 00000000b76c75bd/0x9232577658cf0894 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf089b expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787892919.664858:0:7434:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc9ed573800 from 1 10000000:01000000:3.0:1787892919.664861:0:7434:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787892919.664895:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: 000000000af27f01/0x9232577658cf08a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.664903:0:7434:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: 000000000af27f01/0x9232577658cf08a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.664912:0:7434:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: 000000000af27f01/0x9232577658cf08a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892919.664928:0:7434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000168bca1c pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:7434:1874741493242752:0@lo:101: 00000100:00100000:3.0:1787892919.664994:0:7434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892919.665035:0:7434:0:(client.c:2715:ptlrpc_set_wait()) set 000000009c76c73c going to sleep for 11 seconds 00000100:00100000:1.0:1787892919.665243:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493242752 00000100:00100000:1.0:1787892919.665252:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493242752 00000100:00100000:1.0:1787892919.665303:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787892919.665311:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000153f5129 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+13:7434:x1874741493242752:12345-0@lo:101: 00010000:00010000:1.0:1787892919.665324:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787892919.665346:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000aea44c4/0x9232577658cf08a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf08a2 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892919.665368:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000aea44c4/0x9232577658cf08a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf08a2 expref: 14 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892919.665377:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000aea44c4/0x9232577658cf08a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf08a2 expref: 14 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892919.665385:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000aea44c4, rc 0) 00000100:00100000:1.0:1787892919.665432:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000153f5129 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+14:7434:x1874741493242752:12345-0@lo:101: Request processed in 122us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892919.665447:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787892919.665972:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009873c2e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493242624:0@lo:41: 00000100:00100000:3.0:1787892919.666674:0:7434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000168bca1c pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:7434:1874741493242752:0@lo:101: 00010000:00010000:3.0:1787892919.666693:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: 000000000af27f01/0x9232577658cf08a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf08a9 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.666705:0:7434:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: 000000000af27f01/0x9232577658cf08a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf08a9 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892919.666839:0:7434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000168bca1c pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:7434:1874741493242880:0@lo:501: 00000100:00100000:3.0:1787892919.666882:0:7434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892919.666923:0:7434:0:(client.c:2715:ptlrpc_set_wait()) set 000000009c76c73c going to sleep for 11 seconds 00000100:00100000:1.0:1787892919.666985:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493242880 00000100:00100000:1.0:1787892919.666992:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493242880 00000100:00100000:1.0:1787892919.667037:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787892919.667046:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032d8be55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+14:7434:x1874741493242880:12345-0@lo:501: 00000100:00100000:1.0:1787892919.667538:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032d8be55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+14:7434:x1874741493242880:12345-0@lo:501: Request processed in 492us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892919.667546:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787892919.667732:0:7434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000168bca1c pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:7434:1874741493242880:0@lo:501: 00000100:00100000:3.0:1787892919.667765:0:7434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000168bca1c pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:7434:1874741493243008:0@lo:503: 00000100:00100000:3.0:1787892919.667818:0:7434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892919.667851:0:7434:0:(client.c:2715:ptlrpc_set_wait()) set 000000009c76c73c going to sleep for 11 seconds 00000100:00100000:0.0:1787892919.667902:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493243008 00000100:00100000:0.0:1787892919.667907:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493243008 00000100:00100000:0.0:1787892919.667956:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787892919.667964:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eba31e14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+14:7434:x1874741493243008:12345-0@lo:503: 00000040:00080000:0.0:1787892919.667999:0:6497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787892919.668063:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eba31e14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+14:7434:x1874741493243008:12345-0@lo:503: Request processed in 90us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892919.668076:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787892919.668325:0:7434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000168bca1c pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:7434:1874741493243008:0@lo:503: 00000040:00080000:1.0:1787892919.668778:0:7434:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787892919.668830:0:7434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:1.0:1787892919.668912:0:7434:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787892919.671736:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:3.0:1787892919.671885:0:7434:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1787892919.671917:0:7434:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787892919.671947:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: 000000000af27f01/0x9232577658cf08a2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf08a9 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.671960:0:7434:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: 000000000af27f01/0x9232577658cf08a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf08a9 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787892919.672016:0:7434:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787892919.672019:0:7434:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fc9ed573800 10000000:01000000:3.0:1787892919.672022:0:7434:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fc9ed573800 10000000:01000000:3.0:1787892919.672025:0:7434:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787892919.672030:0:7434:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc9ed573800 from 1 10000000:01000000:3.0:1787892919.672033:0:7434:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787892919.672695:0:7434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: 000000006e83e7ab/0x9232577658cf08b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.672706:0:7434:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: 000000006e83e7ab/0x9232577658cf08b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.672716:0:7434:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: 000000006e83e7ab/0x9232577658cf08b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892919.672740:0:7434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000206d0119 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:7434:1874741493243136:0@lo:101: 00000100:00100000:3.0:1787892919.672811:0:7434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892919.672845:0:7434:0:(client.c:2715:ptlrpc_set_wait()) set 00000000836c027c going to sleep for 11 seconds 00000100:00100000:1.0:1787892919.672918:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493243136 00000100:00100000:1.0:1787892919.672927:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493243136 00000100:00100000:1.0:1787892919.672988:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787892919.672998:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003addc524 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+14:7434:x1874741493243136:12345-0@lo:101: 00010000:00010000:1.0:1787892919.673012:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787892919.673023:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002170d5bd/0x9232577658cf08b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf08b0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892919.673046:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002170d5bd/0x9232577658cf08b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf08b0 expref: 15 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892919.673249:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002170d5bd/0x9232577658cf08b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf08b0 expref: 15 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892919.673259:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002170d5bd, rc 0) 00000100:00100000:1.0:1787892919.673574:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003addc524 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+15:7434:x1874741493243136:12345-0@lo:101: Request processed in 577us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892919.673581:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787892919.673679:0:7434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000206d0119 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:7434:1874741493243136:0@lo:101: 00010000:00010000:3.0:1787892919.673694:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: 000000006e83e7ab/0x9232577658cf08b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf08b7 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.673711:0:7434:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: 000000006e83e7ab/0x9232577658cf08b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf08b7 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892919.673821:0:7434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000206d0119 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:7434:1874741493243264:0@lo:501: 00000100:00100000:3.0:1787892919.673851:0:7434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892919.673875:0:7434:0:(client.c:2715:ptlrpc_set_wait()) set 00000000836c027c going to sleep for 11 seconds 00000100:00100000:1.0:1787892919.673949:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493243264 00000100:00100000:1.0:1787892919.673955:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493243264 00000100:00100000:1.0:1787892919.673992:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787892919.673999:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b4e19fb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+15:7434:x1874741493243264:12345-0@lo:501: 00000100:00100000:1.0:1787892919.674318:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b4e19fb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+15:7434:x1874741493243264:12345-0@lo:501: Request processed in 319us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892919.674326:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787892919.677771:0:7434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000206d0119 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:7434:1874741493243264:0@lo:501: 00000100:00100000:3.0:1787892919.678273:0:7434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000206d0119 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:7434:1874741493243392:0@lo:503: 00000100:00100000:3.0:1787892919.678596:0:7434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892919.678676:0:7434:0:(client.c:2715:ptlrpc_set_wait()) set 000000000ed0e7af going to sleep for 11 seconds 00000100:00100000:1.0:1787892919.678722:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493243392 00000100:00100000:1.0:1787892919.678729:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493243392 00000100:00100000:1.0:1787892919.678817:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787892919.678826:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0b19178 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+15:7434:x1874741493243392:12345-0@lo:503: 00000100:00100000:1.0:1787892919.678957:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0b19178 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+15:7434:x1874741493243392:12345-0@lo:503: Request processed in 132us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892919.678965:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787892919.679032:0:7434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000206d0119 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:7434:1874741493243392:0@lo:503: 00000040:00080000:0.0:1787892919.679317:0:7434:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787892919.679404:0:7434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000015c57a8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:7434:1874741493243520:0@lo:502: 00000100:00100000:0.0:1787892919.679437:0:7434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892919.679851:0:7434:0:(client.c:2715:ptlrpc_set_wait()) set 00000000465fd1b3 going to sleep for 11 seconds 00000100:00100000:3.0:1787892919.679903:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493243520 00000100:00100000:3.0:1787892919.679908:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493243520 00000100:00100000:3.0:1787892919.679934:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787892919.679951:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a11cedc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+15:7434:x1874741493243520:12345-0@lo:502: 00000100:00100000:3.0:1787892919.680040:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a11cedc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+15:7434:x1874741493243520:12345-0@lo:502: Request processed in 90us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892919.680047:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787892919.680132:0:7434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000015c57a8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:7434:1874741493243520:0@lo:502: 00000040:00080000:0.0:1787892919.680312:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787892919.680348:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787892919.680360:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787892919.680371:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787892919.680382:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787892919.680392:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787892919.680412:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787892919.680422:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787892919.680433:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787892919.680443:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787892919.680453:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787892919.680463:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787892919.680472:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787892919.680483:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787892919.680510:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787892919.680523:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787892919.680533:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787892919.680544:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787892919.680554:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787892919.680564:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787892919.680575:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787892919.680585:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787892919.680604:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787892919.680614:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787892919.680625:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1787892919.680635:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1787892919.680646:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1787892919.680656:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1787892919.680677:0:7434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000015c57a8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:7434:1874741493243648:0@lo:502: 00000100:00100000:0.0:1787892919.680711:0:7434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892919.680721:0:7434:0:(client.c:2715:ptlrpc_set_wait()) set 000000007f8189ef going to sleep for 11 seconds 00000100:00100000:3.0:1787892919.680966:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493243648 00000100:00100000:3.0:1787892919.680971:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493243648 00000100:00100000:3.0:1787892919.680987:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787892919.680992:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000006005a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+15:7434:x1874741493243648:12345-0@lo:502: 00000100:00100000:3.0:1787892919.681135:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000006005a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+15:7434:x1874741493243648:12345-0@lo:502: Request processed in 143us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892919.681142:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787892919.681471:0:7434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000015c57a8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:7434:1874741493243648:0@lo:502: 00000040:00080000:0.0:1787892919.681530:0:7434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1787892919.681538:0:7434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1787892919.681919:0:7452:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1787892919.681950:0:7452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (000000004ccfc2af) 00000020:00000080:3.0:1787892919.681970:0:7452:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1787892919.682191:0:7452:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d9a042c1 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787892919.682196:0:7452:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000d9a042c1 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787892919.682198:0:7452:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000d9a042c1 3 00010000:00080000:3.0:1787892919.682227:0:7452:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b879e222@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.135@tcp at head 00010000:00010000:3.0:1787892919.685607:0:7452:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:3.0:1787892919.685873:0:7452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1787892919.685915:0:7452:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787892919.685930:0:7452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x9232577658cf08c5 00000100:00080000:3.0:1787892919.685950:0:7452:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787892919.685955:0:7452:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000b879e222 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:3.0:1787892919.685989:0:7452:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c82cf28e x1874741493243776/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787892919.686009:0:7452:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000040:00080000:1.0:1787892919.691994:0:7452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:3.0:1787892919.692840:0:7454:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:0.0:1787892919.692989:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c82cf28e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3629:1874741493243776:0@lo:38: 00000100:00100000:0.0:1787892919.693304:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1787892919.701744:0:7434:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1787892919.701787:0:7434:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787892919.701811:0:7434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: 000000006e83e7ab/0x9232577658cf08b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf08b7 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892919.701825:0:7434:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: 000000006e83e7ab/0x9232577658cf08b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf08b7 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787892919.701878:0:7434:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787892919.701881:0:7434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787892919.701882:0:7434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787892919.701883:0:7434:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787892919.701884:0:7434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787892919.701885:0:7434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787892919.701887:0:7434:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787892919.701888:0:7434:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787892919.701889:0:7434:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787892919.701896:0:7434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787892919.701898:0:7434:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787892919.701901:0:7434:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:0.0:1787892919.701903:0:7434:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787892919.701904:0:7434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787892919.701905:0:7434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787892919.701906:0:7434:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787892919.701906:0:7434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787892919.701907:0:7434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787892919.701908:0:7434:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787892919.701909:0:7434:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787892919.701910:0:7434:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787892919.701911:0:7434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787892919.701912:0:7434:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787892919.701936:0:7434:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1787892919.701961:0:7434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000069c6ddbb pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:7434:1874741493243904:0@lo:253: 00000100:00100000:0.0:1787892919.702027:0:7434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892919.702066:0:7434:0:(client.c:2715:ptlrpc_set_wait()) set 00000000465fd1b3 going to sleep for 11 seconds 00000100:00100000:3.0:1787892919.702589:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493243904 00000100:00100000:3.0:1787892919.702598:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493243904 00000100:00100000:3.0:1787892919.702642:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787892919.702650:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005432f4c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+15:7434:x1874741493243904:12345-0@lo:253: 20000000:01000000:3.0:1787892919.702678:0:6497:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787892919.702691:0:6497:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1787892919.705112:0:6484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1787892919.706244:0:6497:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787892919.706261:0:6497:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1787892919.706380:0:6520:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787892919.706384:0:6520:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787892919.706409:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e6f9f3eb/0x9232577658cf08cc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.706429:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000019542834/0x9232577658cf07f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf07ec expref: 15 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.706448:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d99f5e2b/0x9232577658cf089b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0894 expref: 15 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.706456:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e6f9f3eb/0x9232577658cf08cc lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.706514:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d99f5e2b/0x9232577658cf089b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf0894 expref: 15 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.706526:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d99f5e2b/0x9232577658cf089b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf0894 expref: 15 pid: 6497 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892919.706540:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007052a104 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6520:1874741493244032:0@lo:104: 00000100:00100000:3.0:1787892919.706606:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787892919.706654:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000019542834/0x9232577658cf07f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf07ec expref: 15 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.706662:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000019542834/0x9232577658cf07f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf07ec expref: 15 pid: 6499 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892919.706670:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ed230efc pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6520:1874741493244160:0@lo:104: 00000100:00100000:3.0:1787892919.706692:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892919.706711:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set 0000000047fbae1b going to sleep for 11 seconds 00000100:00100000:3.0:1787892919.706737:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493244032 00000100:00100000:3.0:1787892919.706744:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493244032 00000100:00100000:3.0:1787892919.706780:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493244160 00000100:00100000:3.0:1787892919.706783:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493244160 00000100:00100000:3.0:1787892919.706798:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787892919.706807:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cbea91e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ad7764-cf95-4087-88aa-57e4229a8397+4:6520:x1874741493244032:12345-0@lo:104: 00010000:00010000:3.0:1787892919.706825:0:6488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: 00000000b76c75bd/0x9232577658cf0894 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf089b expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.706876:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787892919.706882:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cbea91e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ad7764-cf95-4087-88aa-57e4229a8397+4:6520:x1874741493244032:12345-0@lo:104: Request processed in 76us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892919.706889:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787892919.706906:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787892919.706912:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c11b10a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ad7764-cf95-4087-88aa-57e4229a8397+3:6520:x1874741493244160:12345-0@lo:104: 00010000:00010000:3.0:1787892919.706918:0:6488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: 000000005827ab40/0x9232577658cf07ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf07f3 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.706962:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787892919.706966:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c11b10a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ad7764-cf95-4087-88aa-57e4229a8397+3:6520:x1874741493244160:12345-0@lo:104: Request processed in 56us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892919.706972:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1787892919.706988:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787892919.706992:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: 00000000b76c75bd/0x9232577658cf0894 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf089b expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.706999:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b76c75bd already unused, calling callback (00000000196dfbc2) 10000000:00010000:3.0:1787892919.707002:0:6493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: 00000000b76c75bd/0x9232577658cf0894 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf089b expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.707008:0:6493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: 00000000b76c75bd/0x9232577658cf0894 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf089b expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787892919.707014:0:6493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: 00000000b76c75bd/0x9232577658cf0894 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf089b expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787892919.707024:0:6493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787892919.707045:0:6493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: 00000000b76c75bd/0x9232577658cf0894 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf089b expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.707062:0:6493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787892919.707081:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: 00000000b76c75bd/0x9232577658cf0894 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf089b expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.707088:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: 00000000b76c75bd/0x9232577658cf0894 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf089b expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.707100:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787892919.707102:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: 000000005827ab40/0x9232577658cf07ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf07f3 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.707108:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005827ab40 already unused, calling callback (00000000196dfbc2) 10000000:00010000:3.0:1787892919.707110:0:6493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: 000000005827ab40/0x9232577658cf07ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf07f3 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.707116:0:6493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: 000000005827ab40/0x9232577658cf07ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf07f3 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787892919.707120:0:6493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: 000000005827ab40/0x9232577658cf07ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf07f3 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787892919.707125:0:6493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787892919.707136:0:6493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: 000000005827ab40/0x9232577658cf07ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf07f3 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.707142:0:6493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787892919.707162:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: 000000005827ab40/0x9232577658cf07ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf07f3 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.707168:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: 000000005827ab40/0x9232577658cf07ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf07f3 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.707181:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892919.707183:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892919.707184:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892919.707190:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787892919.707201:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000206d0119 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493244288:0@lo:103: 00000100:00100000:3.0:1787892919.707230:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892919.707261:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000168bca1c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493244416:0@lo:103: 00000100:00100000:3.0:1787892919.707287:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892919.707314:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493244288 00000100:00100000:3.0:1787892919.707319:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493244288 00010000:00010000:3.0:1787892919.707336:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d99f5e2b/0x9232577658cf089b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0894 expref: 16 pid: 6497 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892919.707355:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493244416 00000100:00100000:3.0:1787892919.707358:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493244416 00010000:00010000:3.0:1787892919.707366:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000019542834/0x9232577658cf07f3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf07ec expref: 17 pid: 6499 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892919.707378:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787892919.707384:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b2f89cdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ad7764-cf95-4087-88aa-57e4229a8397+17:3631:x1874741493244288:12345-0@lo:103: 00010000:00010000:3.0:1787892919.707393:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787892919.707397:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d99f5e2b/0x9232577658cf089b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0894 expref: 17 pid: 6497 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.707417:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d99f5e2b/0x9232577658cf089b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf0894 expref: 17 pid: 6497 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.707432:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787892919.707460:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b2f89cdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ad7764-cf95-4087-88aa-57e4229a8397+17:3631:x1874741493244288:12345-0@lo:103: Request processed in 77us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892919.707467:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787892919.707480:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787892919.707485:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0a5e829 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ad7764-cf95-4087-88aa-57e4229a8397+16:3632:x1874741493244416:12345-0@lo:103: 00010000:00010000:3.0:1787892919.707518:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787892919.707522:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000019542834/0x9232577658cf07f3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf07ec expref: 16 pid: 6499 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.707529:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000019542834/0x9232577658cf07f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf07ec expref: 16 pid: 6499 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.707540:0:6492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e6f9f3eb/0x9232577658cf08cc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.707546:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e6f9f3eb/0x9232577658cf08cc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787892919.707558:0:6492:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001846668s 00010000:00010000:3.0:1787892919.707561:0:6492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e6f9f3eb/0x9232577658cf08cc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.707566:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e6f9f3eb/0x9232577658cf08cc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.707571:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e6f9f3eb/0x9232577658cf08cc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.707582:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e6f9f3eb/0x9232577658cf08cc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.707587:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e6f9f3eb already unused, calling callback (0000000010b23f3a) 00010000:00010000:3.0:1787892919.707590:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e6f9f3eb/0x9232577658cf08cc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.707596:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e6f9f3eb/0x9232577658cf08cc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.707604:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e6f9f3eb/0x9232577658cf08cc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.707613:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787892919.707643:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0a5e829 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ad7764-cf95-4087-88aa-57e4229a8397+16:3632:x1874741493244416:12345-0@lo:103: Request processed in 158us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892919.707649:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787892919.707711:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000168bca1c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493244416:0@lo:103: 00000100:00100000:3.0:1787892919.707733:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000206d0119 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493244288:0@lo:103: 00010000:00010000:3.0:1787892919.707762:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d99f5e2b/0x9232577658cf089b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf0894 expref: 15 pid: 6497 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892919.707770:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007052a104 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6520:1874741493244032:0@lo:104: 00010000:00010000:3.0:1787892919.707778:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000019542834/0x9232577658cf07f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf07ec expref: 14 pid: 6499 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892919.707784:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ed230efc pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6520:1874741493244160:0@lo:104: 00010000:00010000:3.0:1787892919.707804:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e6f9f3eb/0x9232577658cf08cc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.707811:0:6520:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e6f9f3eb/0x9232577658cf08cc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.707816:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e6f9f3eb/0x9232577658cf08cc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892919.707821:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e6f9f3eb/0x9232577658cf08cc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892919.709797:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493243776 00000100:00100000:2.0:1787892919.709817:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493243776 00000100:00100000:2.0:1787892919.709870:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787892919.709877:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000015c57a8c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3629:x1874741493243776:12345-0@lo:38: 00010000:00080000:2.0:1787892919.709908:0:6504:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 163 last 0 00000020:00000080:2.0:1787892919.709960:0:6504:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x9232577658cf08d3 00000004:00100000:2.0:1787892919.709978:0:6504:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787892919.710013:0:6504:0:(import.c:65:import_set_state_nolock()) 00000000b00c934a : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787892919.711147:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005432f4c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+13:7434:x1874741493243904:12345-0@lo:253: Request processed in 8486us (9109us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892919.711159:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787892919.711317:0:7434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000069c6ddbb pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:7434:1874741493243904:0@lo:253: 10000000:01000000:0.0:1787892919.711343:0:7434:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1787892919.711347:0:7434:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787892919.711348:0:7434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787892919.711350:0:7434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787892919.711351:0:7434:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787892919.711352:0:7434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787892919.711353:0:7434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787892919.711354:0:7434:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787892919.711355:0:7434:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787892919.711356:0:7434:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787892919.711358:0:7434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787892919.711358:0:7434:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787892919.711370:0:7434:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1787892919.722352:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000015c57a8c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1874741493243776:12345-0@lo:38: Request processed in 12465us (29039us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892919.722369:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787892919.722704:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c82cf28e x1874741493243776/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787892929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892919.722718:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787892919.722727:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1787892919.722735:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787892919.722740:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787892919.722742:0:3629:0:(import.c:65:import_set_state_nolock()) 00000000b879e222 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787892919.722749:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c82cf28e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3629:1874741493243776:0@lo:38: 00080000:10000000:0.0:1787892919.728777:0:7434:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:0.0:1787892919.728925:0:7434:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1787892919.730772:0:7434:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1787892919.732815:0:7434:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1787892919.734829:0:7434:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1787892919.735657:0:7434:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1787892919.746853:0:7434:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1787892919.749571:0:7434:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1787892919.749801:0:7434:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:0.0:1787892919.749983:0:7434:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1787892919.750179:0:7434:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:0.0:1787892919.750374:0:7434:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:3.0:1787892919.759265:0:7434:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:3.0:1787892919.759625:0:7458:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:3.0:1787892919.759675:0:7458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ed230efc pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7458:1874741493244544:0@lo:700: 00000100:00100000:3.0:1787892919.759747:0:7458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892919.759795:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493244544 00000100:00100000:3.0:1787892919.759801:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493244544 00000100:00100000:3.0:1787892919.759841:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787892919.759849:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007052a104 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7458:x1874741493244544:12345-0@lo:700: 00000100:00100000:3.0:1787892919.759984:0:7458:0:(client.c:2715:ptlrpc_set_wait()) set 0000000084996bc3 going to sleep for 11 seconds 00000040:01000000:1.0:1787892919.760039:0:7434:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000020:00080000:0.0:1787892919.760860:0:7457:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1787892919.760866:0:7457:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:0.0:1787892919.763426:0:7459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000069c6ddbb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7459:1874741493244672:0@lo:1000: 00000100:00100000:0.0:1787892919.763554:0:7459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892919.763595:0:7459:0:(client.c:2715:ptlrpc_set_wait()) set 000000003941f488 going to sleep for 11 seconds 00000100:00100000:3.0:1787892919.763751:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493244672 00000100:00100000:3.0:1787892919.763759:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493244672 00000100:00100000:3.0:1787892919.763814:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787892919.763823:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000322b0735 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7459:x1874741493244672:12345-0@lo:1000: 00000100:00100000:3.0:1787892919.763916:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000322b0735 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7459:x1874741493244672:12345-0@lo:1000: Request processed in 94us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892919.763930:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787892919.764094:0:7459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000069c6ddbb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7459:1874741493244672:0@lo:1000: 00000040:01000000:0.0:1787892919.764139:0:7459:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:0.0:1787892919.764184:0:7459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000069c6ddbb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7459:1874741493244800:0@lo:700: 00000100:00100000:0.0:1787892919.764213:0:7459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892919.764231:0:7459:0:(client.c:2715:ptlrpc_set_wait()) set 000000009b33c7bc going to sleep for 11 seconds 00000100:00100000:3.0:1787892919.764436:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493244800 00000100:00100000:3.0:1787892919.764442:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493244800 00000100:00100000:3.0:1787892919.764481:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787892919.764488:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2f985f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7459:x1874741493244800:12345-0@lo:700: 00000100:00100000:3.0:1787892919.764559:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2f985f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7459:x1874741493244800:12345-0@lo:700: Request processed in 72us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892919.764566:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787892919.764591:0:7459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000069c6ddbb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7459:1874741493244800:0@lo:700: 00000100:00100000:3.0:1787892919.764632:0:7459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000206d0119 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7459:1874741493244928:0@lo:900: 00000100:00100000:3.0:1787892919.764657:0:7459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892919.764690:0:7459:0:(client.c:2715:ptlrpc_set_wait()) set 000000003cf7e7f7 going to sleep for 11 seconds 00000100:00100000:0.0:1787892919.767790:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493244928 00000100:00100000:0.0:1787892919.767808:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493244928 00000100:00100000:0.0:1787892919.767870:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787892919.767880:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000168bca1c pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7459:x1874741493244928:12345-0@lo:900: 00000100:00100000:0.0:1787892919.768006:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000168bca1c pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7459:x1874741493244928:12345-0@lo:900: Request processed in 128us (3348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892919.768014:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787892919.768324:0:7459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000206d0119 x1874741493244928/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787892935 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892919.768340:0:7459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000206d0119 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7459:1874741493244928:0@lo:900: 00000100:00100000:3.0:1787892919.768479:0:7459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000206d0119 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7459:1874741493245056:0@lo:1000: 00000100:00100000:3.0:1787892919.768550:0:7459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892919.768576:0:7459:0:(client.c:2715:ptlrpc_set_wait()) set 0000000067d2355d going to sleep for 11 seconds 00000100:00100000:0.0:1787892919.768824:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493245056 00000100:00100000:0.0:1787892919.768837:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493245056 00000100:00100000:0.0:1787892919.768870:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787892919.768877:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c16c023 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7459:x1874741493245056:12345-0@lo:1000: 00000100:00100000:0.0:1787892919.768966:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c16c023 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7459:x1874741493245056:12345-0@lo:1000: Request processed in 90us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892919.768973:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787892919.769527:0:7459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000206d0119 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7459:1874741493245056:0@lo:1000: 00000004:00080000:3.0:1787892919.769575:0:7459:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000003cf7e7f7 with version 0 00000020:00100000:3.0:1787892919.769589:0:7459:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787892919.769594:0:7459:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000206d0119 x1874741493245312/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787892919.769608:0:7459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000206d0119 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7459:1874741493245312:0@lo:1000: 00000100:00100000:3.0:1787892919.769643:0:7459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892919.769662:0:7459:0:(client.c:2715:ptlrpc_set_wait()) set 00000000192243c8 going to sleep for 11 seconds 00000100:00100000:0.0:1787892919.769831:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493245312 00000100:00100000:0.0:1787892919.769836:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493245312 00000100:00100000:0.0:1787892919.769859:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787892919.769864:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031cb715a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7459:x1874741493245312:12345-0@lo:1000: 00000040:01000000:1.0:1787892919.771534:0:7434:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1787892919.771657:0:7434:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787892919.772593:0:7434:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787892919.772603:0:7434:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1787892919.772748:0:7434:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 40000000:02000000:0.0:1787892919.773805:0:6511:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000040:00080000:1.0:1787892919.777847:0:7434:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787892919.782838:0:7434:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787892919.782910:0:7434:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1787892919.785002:0:7434:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1787892919.785385:0:6484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:2.0:1787892919.785608:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031cb715a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7459:x1874741493245312:12345-0@lo:1000: Request processed in 15739us (15961us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787892919.785621:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:3.0:1787892919.786191:0:7459:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1787892919.786197:0:7459:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787892919.786213:0:7459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000206d0119 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7459:1874741493245312:0@lo:1000: 00000100:00100000:3.0:1787892919.786306:0:7459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000206d0119 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7459:1874741493245440:0@lo:1000: 00000100:00100000:3.0:1787892919.786349:0:7459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892919.786379:0:7459:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a2f7ee04 going to sleep for 11 seconds 00080000:10000000:1.0:1787892919.786969:0:7434:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1787892919.787665:0:7434:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1787892919.787807:0:7434:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1787892919.787974:0:7434:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1787892919.788111:0:7434:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1787892919.788319:0:7434:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1787892919.788582:0:7434:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1787892919.788721:0:7434:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1787892919.788854:0:7434:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1787892919.789032:0:7434:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1787892919.789186:0:7434:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1787892919.789333:0:7434:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1787892919.789481:0:7434:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1787892919.789666:0:7434:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1787892919.789799:0:7434:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1787892919.789933:0:7434:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00000100:00100000:2.0:1787892919.791440:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493245440 00000100:00100000:2.0:1787892919.791460:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493245440 00000100:00100000:2.0:1787892919.791554:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787892919.791565:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b2f89cdc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7459:x1874741493245440:12345-0@lo:1000: 00000100:00100000:2.0:1787892919.791697:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b2f89cdc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7459:x1874741493245440:12345-0@lo:1000: Request processed in 135us (5349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892919.791718:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787892919.791770:0:7459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000206d0119 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7459:1874741493245440:0@lo:1000: 00000040:00080000:2.0:1787892919.791800:0:7459:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1787892919.791842:0:7459:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000000df3f35a with version 1 00000040:00080000:2.0:1787892919.793893:0:7459:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787892919.793998:0:7459:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787892919.796080:0:7449:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000eb5625da version 1 rpc_version 1 00000020:00100000:3.0:1787892919.796119:0:7449:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787892919.796140:0:7449:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000288d2d36 x1874741493245696/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787892919.796163:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000288d2d36 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7449:1874741493245696:0@lo:1000: 00000100:00100000:3.0:1787892919.796228:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892919.796257:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 0000000015b092c6 going to sleep for 11 seconds 00000100:00100000:3.0:1787892919.796284:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493245696 00000100:00100000:3.0:1787892919.796291:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493245696 00000100:00100000:3.0:1787892919.796332:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787892919.796341:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aecbd066 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7449:x1874741493245696:12345-0@lo:1000: 00000100:00100000:0.0:1787892919.799989:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007052a104 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7458:x1874741493244544:12345-0@lo:700: Request processed in 40133us (40235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892919.800031:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787892919.801408:0:7458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ed230efc x1874741493244544/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787892935 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892919.801427:0:7458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ed230efc pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7458:1874741493244544:0@lo:700: 40000000:02000000:3.0:1787892919.801441:0:7458:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:1.0:1787892919.808885:0:7434:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1787892919.810819:0:7434:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1787892919.811015:0:7434:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1787892919.812681:0:7434:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1787892919.812878:0:7434:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1787892919.813795:0:7434:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1787892919.813971:0:7434:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1787892919.815611:0:7434:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1787892919.815855:0:7434:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1787892919.818282:0:7434:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1787892919.819921:0:7434:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1787892919.820153:0:7434:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1787892919.820317:0:7434:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1787892919.820476:0:7434:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1787892919.820652:0:7434:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1787892919.820816:0:7434:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1787892919.821000:0:7434:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1787892919.821218:0:7434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1787892919.823413:0:6484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:1.0:1787892919.823667:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aecbd066 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7449:x1874741493245696:12345-0@lo:1000: Request processed in 27323us (27434us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787892919.823681:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:3.0:1787892919.825824:0:7449:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1787892919.825839:0:7449:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787892919.825858:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000288d2d36 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7449:1874741493245696:0@lo:1000: 00000040:00080000:1.0:1787892919.830250:0:7458:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1787892919.831606:0:7434:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787892919.831644:0:7434:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbaa0c1a33988 00100000:10000000:2.0:1787892919.831652:0:7434:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1787892919.832457:0:7434:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787892919.832519:0:7434:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.135@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787892919.832544:0:7434:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1787892919.832572:0:7434:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1787892919.834657:0:7434:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787892919.838218:0:7434:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:0.0:1787892919.859980:0:7458:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787892919.865325:0:7458:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787892919.865338:0:7458:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:3.0:1787892919.986210:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892921.016282:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892922.034021:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787892923.058795:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892924.082798:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787892924.833414:0:7704:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg235-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1787892925.105724:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000206d0119 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493246080:0@lo:400: 00000100:00100000:3.0:1787892925.105816:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892925.105878:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787892925.105883:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ed230efc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1874741493245952:0@lo:400: 00000100:00100000:3.0:1787892925.105921:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892925.105953:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493246080 00000100:00100000:3.0:1787892925.105962:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493246080 00000100:00100000:3.0:1787892925.106019:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787892925.106028:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c64e271d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493246080:12345-0@lo:400: 00000100:00100000:3.0:1787892925.106089:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c64e271d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493246080:12345-0@lo:400: Request processed in 62us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892925.106096:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787892925.106136:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000206d0119 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493246080:0@lo:400: 00000100:00100000:1.0:1787892925.106204:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493245952 00000100:00100000:1.0:1787892925.106208:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493245952 00000100:00100000:1.0:1787892925.106242:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787892925.106249:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb0e650a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1874741493245952:12345-0@lo:400: 00000100:00100000:1.0:1787892925.106297:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb0e650a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1874741493245952:12345-0@lo:400: Request processed in 49us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892925.106304:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787892925.106337:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000ed230efc x1874741493245952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892925.106361:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ed230efc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1874741493245952:0@lo:400: 00000100:00100000:2.0:1787892925.106564:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000288d2d36 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493245824:0@lo:400: 00000100:00100000:2.0:1787892925.106599:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892925.106627:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787892925.106632:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c82cf28e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874741493246208:0@lo:400: 00000100:00100000:2.0:1787892925.106658:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787892925.106713:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892925.106781:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493245824 00000100:00100000:1.0:1787892925.106786:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493245824 00000100:00100000:1.0:1787892925.106816:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787892925.106823:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019a704f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+13:3633:x1874741493245824:12345-0@lo:400: 00000100:00100000:1.0:1787892925.106857:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019a704f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+13:3633:x1874741493245824:12345-0@lo:400: Request processed in 35us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892925.106864:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787892925.106945:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000288d2d36 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493245824:0@lo:400: 00000100:00100000:3.0:1787892925.107005:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493246208 00000100:00100000:3.0:1787892925.107009:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493246208 00000100:00100000:3.0:1787892925.107039:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787892925.107045:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000000afe306 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1874741493246208:12345-0@lo:400: 00000100:00100000:3.0:1787892925.107086:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000000afe306 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1874741493246208:12345-0@lo:400: Request processed in 42us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892925.107091:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787892925.107164:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000c82cf28e x1874741493246208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892925.107174:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c82cf28e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874741493246208:0@lo:400: 00000100:00100000:0.0:1787892925.107548:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b73742ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493246336:0@lo:41: 00000100:00100000:0.0:1787892925.107583:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892925.111299:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493246336 00000100:00100000:1.0:1787892925.111317:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493246336 00000100:00100000:1.0:1787892925.111392:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787892925.111402:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f03124a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493246336:12345-0@lo:41: 00000004:00000024:1.0:1787892925.111441:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1787892925.111763:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f03124a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493246336:12345-0@lo:41: Request processed in 363us (4179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892925.111771:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787892925.111886:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b73742ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493246336:0@lo:41: 00000020:00000004:3.0:1787892926.005738:0:7756:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787892926.006634:0:7756:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787892926.136537:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892927.155377:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892928.177905:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892929.203030:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787892929.211946:0:6502:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787892929.211982:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc9ed573800 from 4 10000000:01000000:3.0:1787892929.211987:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787892929.212034:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: 00000000e6f9f3eb/0x9232577658cf08da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892929.212047:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: 00000000e6f9f3eb/0x9232577658cf08da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892929.212057:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: 00000000e6f9f3eb/0x9232577658cf08da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892929.212080:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000033d8b851 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493246464:0@lo:101: 00000100:00100000:3.0:1787892929.212154:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892929.212208:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b93807be going to sleep for 11 seconds 00000100:00100000:0.0:1787892929.212551:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493246464 00000100:00100000:0.0:1787892929.212562:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493246464 00000100:00100000:0.0:1787892929.212624:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787892929.212633:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1954ab0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+13:6502:x1874741493246464:12345-0@lo:101: 00010000:00010000:0.0:1787892929.212649:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787892929.212662:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000013cd21a/0x9232577658cf08e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf08da expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892929.212690:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000013cd21a/0x9232577658cf08e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf08da expref: 14 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892929.212700:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000013cd21a/0x9232577658cf08e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf08da expref: 14 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892929.212708:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000013cd21a, rc 0) 00000100:00100000:0.0:1787892929.212748:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1954ab0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+14:6502:x1874741493246464:12345-0@lo:101: Request processed in 116us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892929.212754:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787892929.213557:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000033d8b851 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493246464:0@lo:101: 00010000:00010000:3.0:1787892929.213578:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: 00000000e6f9f3eb/0x9232577658cf08da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf08e1 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892929.213588:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: 00000000e6f9f3eb/0x9232577658cf08da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf08e1 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892929.213651:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000033d8b851 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493246592:0@lo:256: 00000100:00100000:3.0:1787892929.213697:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892929.213737:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b93807be going to sleep for 11 seconds 00000100:00100000:1.0:1787892929.213817:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493246592 00000100:00100000:1.0:1787892929.213824:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493246592 00000100:00100000:1.0:1787892929.213873:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787892929.213882:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e58f6828 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+14:6502:x1874741493246592:12345-0@lo:256: 20000000:01000000:1.0:1787892929.213906:0:6499:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787892929.213920:0:6499:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787892929.213923:0:6499:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1787892929.214008:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e58f6828 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+14:6502:x1874741493246592:12345-0@lo:256: Request processed in 126us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892929.214015:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787892929.214088:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000033d8b851 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493246592:0@lo:256: 10000000:01000000:3.0:1787892929.214128:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787892929.214135:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: 00000000e6f9f3eb/0x9232577658cf08da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf08e1 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892929.214153:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: 00000000e6f9f3eb/0x9232577658cf08da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf08e1 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787892929.214163:0:6502:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787892929.214165:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc9d909c800 from 21 10000000:01000000:3.0:1787892929.214168:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787892929.214187:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: 00000000d99f5e2b/0x9232577658cf08e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892929.214194:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: 00000000d99f5e2b/0x9232577658cf08e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892929.214201:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: 00000000d99f5e2b/0x9232577658cf08e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892929.214211:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000033d8b851 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493246720:0@lo:101: 00000100:00100000:3.0:1787892929.214238:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892929.214279:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493246720 00000100:00100000:1.0:1787892929.214285:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493246720 00000100:00100000:1.0:1787892929.214309:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787892929.214313:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b58dd215 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+14:6502:x1874741493246720:12345-0@lo:101: 00010000:00010000:1.0:1787892929.214321:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787892929.214332:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003fb335a5/0x9232577658cf08ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf08e8 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892929.214351:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003fb335a5/0x9232577658cf08ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf08e8 expref: 15 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892929.214359:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003fb335a5/0x9232577658cf08ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf08e8 expref: 15 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892929.214365:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003fb335a5, rc 0) 00000100:00100000:1.0:1787892929.218032:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b58dd215 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+15:6502:x1874741493246720:12345-0@lo:101: Request processed in 3709us (3784us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892929.218048:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787892929.220727:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b93807be going to sleep for 11 seconds 00000100:00100000:3.0:1787892929.220763:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000033d8b851 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493246720:0@lo:101: 00010000:00010000:3.0:1787892929.220785:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: 00000000d99f5e2b/0x9232577658cf08e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf08ef expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892929.220796:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: 00000000d99f5e2b/0x9232577658cf08e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf08ef expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892929.221844:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000033d8b851 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493246848:0@lo:501: 00000100:00100000:3.0:1787892929.221915:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892929.221966:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b93807be going to sleep for 11 seconds 00000100:00100000:1.0:1787892929.222043:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493246848 00000100:00100000:1.0:1787892929.222053:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493246848 00000100:00100000:1.0:1787892929.222108:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787892929.222116:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003143b638 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+15:6502:x1874741493246848:12345-0@lo:501: 00000100:00100000:1.0:1787892929.223722:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003143b638 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+15:6502:x1874741493246848:12345-0@lo:501: Request processed in 1605us (1805us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892929.223742:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787892929.224151:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000033d8b851 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493246848:0@lo:501: 00000100:00100000:3.0:1787892929.224203:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000033d8b851 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493246976:0@lo:503: 00000020:00000004:0.0:1787892929.224316:0:7857:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000100:00100000:3.0:1787892929.224353:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892929.224398:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b93807be going to sleep for 11 seconds 00000100:00100000:1.0:1787892929.224590:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493246976 00000100:00100000:1.0:1787892929.224598:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493246976 00000020:00000004:0.0:1787892929.224778:0:7857:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787892929.225030:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787892929.225040:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db74e71e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+15:6502:x1874741493246976:12345-0@lo:503: 00000100:00100000:1.0:1787892929.225155:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db74e71e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+15:6502:x1874741493246976:12345-0@lo:503: Request processed in 117us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892929.225163:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787892929.225242:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000033d8b851 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493246976:0@lo:503: 00000100:00100000:3.0:1787892929.226736:0:7858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000033d8b851 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:7858:1874741493247104:0@lo:502: 00000100:00100000:3.0:1787892929.226810:0:7858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892929.226875:0:7858:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d9da524f going to sleep for 11 seconds 00000100:00100000:0.0:1787892929.226888:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493247104 00000100:00100000:0.0:1787892929.226897:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493247104 00000100:00100000:0.0:1787892929.226943:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787892929.226960:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016af26d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+15:7858:x1874741493247104:12345-0@lo:502: 00000100:00100000:0.0:1787892929.227087:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016af26d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+15:7858:x1874741493247104:12345-0@lo:502: Request processed in 136us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892929.227097:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787892929.227163:0:7858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000033d8b851 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:7858:1874741493247104:0@lo:502: 00000100:00100000:3.0:1787892929.227203:0:7858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000033d8b851 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:7858:1874741493247232:0@lo:502: 00000100:00100000:3.0:1787892929.227241:0:7858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892929.227268:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493247232 00000100:00100000:2.0:1787892929.227273:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493247232 00000100:00100000:2.0:1787892929.227294:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787892929.227299:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000676c9335 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+15:7858:x1874741493247232:12345-0@lo:502: 00000100:00100000:2.0:1787892929.227371:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000676c9335 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+15:7858:x1874741493247232:12345-0@lo:502: Request processed in 71us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892929.227378:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787892929.227392:0:7858:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d9da524f going to sleep for 11 seconds 00000100:00100000:3.0:1787892929.227407:0:7858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000033d8b851 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:7858:1874741493247232:0@lo:502: 00000040:00080000:3.0:1787892929.227426:0:7858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1787892929.227480:0:6502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1787892929.227516:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787892929.227525:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: 00000000d99f5e2b/0x9232577658cf08e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf08ef expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892929.227534:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: 00000000d99f5e2b/0x9232577658cf08e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf08ef expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787892929.227543:0:6502:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787892929.227545:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc9d909c800 from 4 10000000:01000000:3.0:1787892929.227548:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787892929.227577:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: 0000000047bd84c5/0x9232577658cf08f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892929.227585:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: 0000000047bd84c5/0x9232577658cf08f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892929.227594:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: 0000000047bd84c5/0x9232577658cf08f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892929.227605:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000033d8b851 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493247360:0@lo:101: 00000100:00100000:3.0:1787892929.227632:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892929.227651:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d9da524f going to sleep for 11 seconds 00000100:00100000:2.0:1787892929.227755:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493247360 00000100:00100000:2.0:1787892929.227760:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493247360 00000100:00100000:2.0:1787892929.227778:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787892929.227784:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a6d787c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+15:6502:x1874741493247360:12345-0@lo:101: 00010000:00010000:2.0:1787892929.227791:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787892929.227802:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b76c75bd/0x9232577658cf08fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf08f6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892929.227821:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b76c75bd/0x9232577658cf08fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf08f6 expref: 16 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892929.227830:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b76c75bd/0x9232577658cf08fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf08f6 expref: 16 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892929.227839:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b76c75bd, rc 0) 00000100:00100000:2.0:1787892929.227885:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a6d787c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+16:6502:x1874741493247360:12345-0@lo:101: Request processed in 101us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892929.227892:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787892929.228049:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000033d8b851 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493247360:0@lo:101: 00010000:00010000:3.0:1787892929.228061:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: 0000000047bd84c5/0x9232577658cf08f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf08fd expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892929.228069:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: 0000000047bd84c5/0x9232577658cf08f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf08fd expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892929.228110:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000033d8b851 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493247488:0@lo:256: 00000100:00100000:3.0:1787892929.228143:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892929.228165:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d9da524f going to sleep for 11 seconds 00000100:00100000:3.0:1787892929.228177:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493247488 00000100:00100000:3.0:1787892929.228181:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493247488 00000100:00100000:3.0:1787892929.228201:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787892929.228206:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025bb5d1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+16:6502:x1874741493247488:12345-0@lo:256: 20000000:01000000:3.0:1787892929.228219:0:6497:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787892929.228235:0:6497:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787892929.228238:0:6497:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1787892929.228815:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025bb5d1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+16:6502:x1874741493247488:12345-0@lo:256: Request processed in 605us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892929.228823:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787892929.228922:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000033d8b851 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493247488:0@lo:256: 10000000:01000000:2.0:1787892929.228976:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787892929.228990:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: 0000000047bd84c5/0x9232577658cf08f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf08fd expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892929.228998:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: 0000000047bd84c5/0x9232577658cf08f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf08fd expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892929.229006:0:6502:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787892929.229008:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1787892929.229011:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787892929.229031:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: 000000005827ab40/0x9232577658cf0904 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892929.229038:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: 000000005827ab40/0x9232577658cf0904 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892929.229045:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: 000000005827ab40/0x9232577658cf0904 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892929.229056:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea95163b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493247616:0@lo:101: 00000100:00100000:2.0:1787892929.229084:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892929.229114:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set 000000002120a89d going to sleep for 11 seconds 00000100:00100000:1.0:1787892929.229248:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493247616 00000100:00100000:1.0:1787892929.229253:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493247616 00000100:00100000:1.0:1787892929.229294:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787892929.229300:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec8b4769 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+16:6502:x1874741493247616:12345-0@lo:101: 00010000:00010000:1.0:1787892929.229310:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787892929.229321:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003b1d3144/0x9232577658cf090b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0904 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892929.229340:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003b1d3144/0x9232577658cf090b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0904 expref: 17 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892929.229349:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003b1d3144/0x9232577658cf090b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0904 expref: 17 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892929.229356:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003b1d3144, rc 0) 00000100:00100000:1.0:1787892929.229385:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec8b4769 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+17:6502:x1874741493247616:12345-0@lo:101: Request processed in 86us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892929.229391:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787892929.229448:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea95163b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493247616:0@lo:101: 00010000:00010000:2.0:1787892929.229458:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: 000000005827ab40/0x9232577658cf0904 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf090b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892929.229467:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: 000000005827ab40/0x9232577658cf0904 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf090b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892929.229547:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea95163b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493247744:0@lo:501: 00000100:00100000:2.0:1787892929.229581:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892929.229601:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set 000000002120a89d going to sleep for 11 seconds 00000100:00100000:1.0:1787892929.229660:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493247744 00000100:00100000:1.0:1787892929.229665:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493247744 00000100:00100000:1.0:1787892929.229687:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787892929.229691:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054181213 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+17:6502:x1874741493247744:12345-0@lo:501: 00000100:00100000:1.0:1787892929.229809:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054181213 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+17:6502:x1874741493247744:12345-0@lo:501: Request processed in 117us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892929.229815:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787892929.229941:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea95163b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493247744:0@lo:501: 00000100:00100000:2.0:1787892929.229991:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea95163b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493247872:0@lo:503: 00000100:00100000:2.0:1787892929.230027:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892929.230048:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set 000000002120a89d going to sleep for 11 seconds 00000100:00100000:3.0:1787892929.230232:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493247872 00000100:00100000:3.0:1787892929.230237:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493247872 00000100:00100000:3.0:1787892929.230258:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787892929.230265:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f04c548 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+17:6502:x1874741493247872:12345-0@lo:503: 00000100:00100000:3.0:1787892929.230347:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f04c548 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+17:6502:x1874741493247872:12345-0@lo:503: Request processed in 82us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892929.230353:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787892929.230439:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea95163b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493247872:0@lo:503: 00000100:00100000:2.0:1787892929.232616:0:7859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea95163b pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:7859:1874741493248000:0@lo:502: 00000100:00100000:0.0:1787892929.232889:0:7859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892929.232964:0:7859:0:(client.c:2715:ptlrpc_set_wait()) set 000000003a5320ed going to sleep for 11 seconds 00000100:00100000:3.0:1787892929.234322:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493248000 00000100:00100000:3.0:1787892929.234333:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493248000 00000100:00100000:3.0:1787892929.234388:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787892929.234397:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a9ccf85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+17:7859:x1874741493248000:12345-0@lo:502: 00000100:00100000:3.0:1787892929.234557:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a9ccf85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+17:7859:x1874741493248000:12345-0@lo:502: Request processed in 161us (1669us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892929.234565:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787892929.234810:0:7859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea95163b pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:7859:1874741493248000:0@lo:502: 00000020:01000000:0.0:1787892929.234845:0:7859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787892929.234867:0:7859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787892929.234870:0:7859:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1787892929.234875:0:7859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787892929.234879:0:7859:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.135@tcp to nid 0x20000c0a8ca87 (192.168.202.135@tcp) 00000020:00000080:0.0:1787892929.234902:0:7859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787892929.234923:0:7859:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (0000000097e9a52b) 00000020:00000080:0.0:1787892929.234944:0:7859:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:0.0:1787892929.234950:0:7859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787892929.235030:0:7859:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1787892929.235035:0:7859:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787892929.235041:0:7859:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9232577658cf0919 00010000:00080000:0.0:1787892929.235067:0:7859:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000029d57600@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.135@tcp at head 00010000:00010000:0.0:1787892929.241391:0:7859:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:1.0:1787892929.261895:0:7859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787892929.261913:0:7859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787892929.261953:0:7859:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787892929.262049:0:7859:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9232577658cf0920 00000100:00080000:1.0:1787892929.262059:0:7859:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787892929.262064:0:7859:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 0000000029d57600 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:1.0:1787892929.262096:0:7859:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005f059301 x1874741493248128/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787892929.262202:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005f059301 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493248128:0@lo:38: 00000100:00100000:3.0:1787892929.262265:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787892929.262332:0:7859:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:1.0:1787892929.262367:0:7859:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1787892929.262618:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493248128 00000100:00100000:2.0:1787892929.262626:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493248128 00000100:00100000:2.0:1787892929.262655:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787892929.262661:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a92ec5eb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3629:x1874741493248128:12345-0@lo:38: 00010000:00080000:2.0:1787892929.262688:0:6509:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:2.0:1787892929.262719:0:6509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9232577658cf0927 00000004:00100000:2.0:1787892929.262735:0:6509:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787892929.262740:0:6509:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1787892929.262811:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d6c15985 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493248256:0@lo:400: 00000100:00100000:2.0:1787892929.262842:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892929.262876:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787892929.262881:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005d30d802 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493248384:0@lo:400: 00000100:00100000:2.0:1787892929.262900:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892929.262919:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea95163b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493248512:0@lo:400: 00000100:00100000:2.0:1787892929.262937:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892929.262963:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1787892929.262981:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1787892929.262998:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493248256 00000100:00100000:2.0:1787892929.263001:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493248256 00000100:00100000:2.0:1787892929.263026:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493248512 00000100:00100000:2.0:1787892929.263028:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493248512 00000100:00100000:2.0:1787892929.263038:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787892929.263043:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b73742ac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493248256:12345-0@lo:400: 00000100:00100000:2.0:1787892929.263082:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b73742ac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493248256:12345-0@lo:400: Request processed in 39us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892929.263088:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787892929.263101:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787892929.263105:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009873c2e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493248512:12345-0@lo:400: 00000100:00100000:2.0:1787892929.263259:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009873c2e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493248512:12345-0@lo:400: Request processed in 153us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892929.263265:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787892929.263298:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000d6c15985 x1874741493248256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892929.263373:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d6c15985 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493248256:0@lo:400: 00010000:00080000:2.0:1787892929.263400:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000ea95163b x1874741493248512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892929.263407:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea95163b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493248512:0@lo:400: 00000100:00100000:3.0:1787892929.271548:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493248384 00000100:00100000:3.0:1787892929.271563:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493248384 00000100:00100000:3.0:1787892929.271684:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787892929.271693:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000834373c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493248384:12345-0@lo:400: 00000100:00100000:3.0:1787892929.271793:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000834373c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493248384:12345-0@lo:400: Request processed in 102us (8891us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892929.271802:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1787892929.272400:0:7864:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@000000001fd04f1b x1874741493248640/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892929.272411:0:7864:0:(client.c:2715:ptlrpc_set_wait()) set 000000003c8cfd52 going to sleep for 0 seconds 00000020:01000000:3.0:1787892929.272523:0:7859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787892929.272535:0:7859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787892929.272538:0:7859:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1787892929.272541:0:7859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787892929.272545:0:7859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787892929.272546:0:7859:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787892929.272550:0:7859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787892929.272551:0:7859:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787892929.272573:0:7859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000154a9709 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:7859:1874741493248768:0@lo:502: 00000100:00100000:3.0:1787892929.272625:0:7859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892929.272660:0:7859:0:(client.c:2715:ptlrpc_set_wait()) set 0000000090bcb6ca going to sleep for 11 seconds 00000100:00100000:0.0:1787892929.272713:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493248768 00000100:00100000:0.0:1787892929.272719:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493248768 00000100:00100000:0.0:1787892929.272757:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787892929.272764:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009831cde5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+17:7859:x1874741493248768:12345-0@lo:502: 00000100:00100000:0.0:1787892929.272886:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009831cde5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+17:7859:x1874741493248768:12345-0@lo:502: Request processed in 121us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892929.272894:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787892929.274108:0:7859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000154a9709 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:7859:1874741493248768:0@lo:502: 00000020:01000000:3.0:1787892929.274215:0:7859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787892929.274223:0:7859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787892929.274225:0:7859:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787892929.274229:0:7859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1787892929.274390:0:6502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1787892929.274414:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787892929.274423:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: 000000005827ab40/0x9232577658cf0904 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf090b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892929.274434:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: 000000005827ab40/0x9232577658cf0904 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf090b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787892929.274444:0:6502:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787892929.274446:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fc9e2e3b370 from 1 10000000:01000000:0.0:1787892929.274449:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787892929.274479:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: 00000000909d720a/0x9232577658cf092e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892929.274510:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: 00000000909d720a/0x9232577658cf092e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892929.274518:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: 00000000909d720a/0x9232577658cf092e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892929.274534:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000752cc03 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493248896:0@lo:101: 00000100:00100000:0.0:1787892929.274582:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892929.274602:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set 0000000001dfe327 going to sleep for 11 seconds 00000100:00100000:0.0:1787892929.274619:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493248896 00000100:00100000:0.0:1787892929.274623:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493248896 00000100:00100000:0.0:1787892929.274656:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787892929.274663:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000245a18de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+17:6502:x1874741493248896:12345-0@lo:101: 00010000:00010000:0.0:1787892929.274674:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787892929.274685:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000136cf3a3/0x9232577658cf0935 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf092e expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892929.274708:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000136cf3a3/0x9232577658cf0935 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf092e expref: 18 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892929.274718:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000136cf3a3/0x9232577658cf0935 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf092e expref: 18 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892929.274725:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000136cf3a3, rc 0) 00000100:00100000:0.0:1787892929.274757:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000245a18de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+18:6502:x1874741493248896:12345-0@lo:101: Request processed in 95us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892929.274764:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787892929.274800:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000752cc03 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493248896:0@lo:101: 00010000:00010000:0.0:1787892929.274819:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: 00000000909d720a/0x9232577658cf092e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0935 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892929.274826:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: 00000000909d720a/0x9232577658cf092e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0935 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892929.274883:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000752cc03 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493249024:0@lo:501: 00000100:00100000:0.0:1787892929.274908:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892929.274923:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set 0000000001dfe327 going to sleep for 11 seconds 00000100:00100000:0.0:1787892929.274936:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493249024 00000100:00100000:0.0:1787892929.274940:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493249024 00000100:00100000:0.0:1787892929.274962:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787892929.276079:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054e2d821 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+18:6502:x1874741493249024:12345-0@lo:501: 00000100:00100000:0.0:1787892929.276255:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054e2d821 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+18:6502:x1874741493249024:12345-0@lo:501: Request processed in 183us (1346us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787892929.276263:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787892929.277264:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000752cc03 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493249024:0@lo:501: 10000000:01000000:0.0:1787892929.277321:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787892929.277330:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: 00000000909d720a/0x9232577658cf092e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0935 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892929.277339:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: 00000000909d720a/0x9232577658cf092e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0935 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787892929.280454:0:6509:0:(import.c:65:import_set_state_nolock()) 00000000dcbe7961 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787892929.280664:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005d30d802 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493248384:0@lo:400: 00000100:00100000:1.0:1787892929.281098:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a92ec5eb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3629:x1874741493248128:12345-0@lo:38: Request processed in 18434us (18830us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892929.281109:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787892929.281210:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787892929.281219:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787892929.281229:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787892929.281234:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787892929.281237:0:3629:0:(import.c:65:import_set_state_nolock()) 0000000029d57600 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1787892929.281259:0:3629:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000003c8cfd52): req@000000001fd04f1b x1874741493248640/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892929.281278:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005f059301 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493248128:0@lo:38: 00000100:00100000:2.0:1787892929.281468:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787892929.281480:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005d30d802 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493249152:0@lo:41: 00000100:00100000:2.0:1787892929.281554:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892929.281590:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493249152 00000100:00100000:2.0:1787892929.281597:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493249152 00000100:00100000:2.0:1787892929.281643:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787892929.281651:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea95163b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3632:x1874741493249152:12345-0@lo:41: 00000004:00000024:2.0:1787892929.281677:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1787892929.281712:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea95163b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3632:x1874741493249152:12345-0@lo:41: Request processed in 63us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892929.281718:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787892929.281745:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005d30d802 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493249152:0@lo:41: 00000100:00100000:3.0:1787892929.282612:0:7864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892929.282637:0:7864:0:(client.c:2715:ptlrpc_set_wait()) set 000000003c8cfd52 going to sleep for 11 seconds 00000100:00100000:1.0:1787892929.282720:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493248640 00000100:00100000:1.0:1787892929.282727:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493248640 00000100:00100000:1.0:1787892929.282761:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787892929.282768:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000154a9709 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7864:x1874741493248640:12345-0@lo:1000: 00000100:00100000:1.0:1787892929.282838:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000154a9709 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7864:x1874741493248640:12345-0@lo:1000: Request processed in 70us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892929.282845:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787892929.282928:0:7864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001fd04f1b pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7864:1874741493248640:0@lo:1000: 00000040:01000000:3.0:1787892929.282975:0:7864:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1787892929.283013:0:7864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000068394af6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7864:1874741493249280:0@lo:1000: 00000100:00100000:3.0:1787892929.283058:0:7864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892929.283080:0:7864:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d9da524f going to sleep for 11 seconds 00000100:00100000:1.0:1787892929.283260:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493249280 00000100:00100000:1.0:1787892929.283265:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493249280 00000100:00100000:1.0:1787892929.283303:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787892929.283318:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c87a8b4d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7864:x1874741493249280:12345-0@lo:1000: 00000100:00100000:1.0:1787892929.283418:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c87a8b4d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7864:x1874741493249280:12345-0@lo:1000: Request processed in 109us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892929.283424:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787892929.284292:0:7864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000068394af6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7864:1874741493249280:0@lo:1000: 00000100:00100000:3.0:1787892929.284354:0:7864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000068394af6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7864:1874741493249408:0@lo:700: 00000100:00100000:3.0:1787892929.284393:0:7864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892929.284415:0:7864:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ceddf0a4 going to sleep for 11 seconds 00000100:00100000:2.0:1787892929.285093:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493249408 00000100:00100000:2.0:1787892929.285101:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493249408 00000100:00100000:2.0:1787892929.285154:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787892929.285162:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b5ed7e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7864:x1874741493249408:12345-0@lo:700: 00000100:00100000:2.0:1787892929.285225:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b5ed7e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7864:x1874741493249408:12345-0@lo:700: Request processed in 64us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892929.285231:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787892929.285558:0:7864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000068394af6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7864:1874741493249408:0@lo:700: 00000100:00100000:3.0:1787892929.285721:0:7864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000068394af6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7864:1874741493249536:0@lo:1000: 00000100:00100000:3.0:1787892929.285756:0:7864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892929.285779:0:7864:0:(client.c:2715:ptlrpc_set_wait()) set 000000005758bfe9 going to sleep for 11 seconds 00000100:00100000:1.0:1787892929.285871:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493249536 00000100:00100000:1.0:1787892929.285877:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493249536 00000100:00100000:1.0:1787892929.285915:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787892929.285922:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007be5154b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7864:x1874741493249536:12345-0@lo:1000: 00000100:00100000:1.0:1787892929.285983:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007be5154b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7864:x1874741493249536:12345-0@lo:1000: Request processed in 62us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892929.285990:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787892929.286140:0:7864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000068394af6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7864:1874741493249536:0@lo:1000: 00000004:00080000:3.0:1787892929.286179:0:7864:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000ceddf0a4 with version 0 00000020:00100000:3.0:1787892929.286192:0:7864:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787892929.286198:0:7864:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000068394af6 x1874741493249792/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787892929.286211:0:7864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000068394af6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7864:1874741493249792:0@lo:1000: 00000100:00100000:3.0:1787892929.286234:0:7864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892929.286247:0:7864:0:(client.c:2715:ptlrpc_set_wait()) set 00000000144299b6 going to sleep for 11 seconds 00000100:00100000:2.0:1787892929.287460:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493249792 00000100:00100000:2.0:1787892929.287472:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493249792 00000100:00100000:2.0:1787892929.287535:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787892929.287543:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008264013a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7864:x1874741493249792:12345-0@lo:1000: 00000001:00080000:0.0:1787892929.292865:0:7436:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:0.0:1787892929.292882:0:7436:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787892929.299778:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008264013a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7864:x1874741493249792:12345-0@lo:1000: Request processed in 12227us (13534us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787892929.299796:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:3.0:1787892929.300870:0:7864:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1787892929.300880:0:7864:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787892929.300898:0:7864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000068394af6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7864:1874741493249792:0@lo:1000: 00000100:00100000:3.0:1787892929.300990:0:7864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000068394af6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7864:1874741493249920:0@lo:1000: 00000100:00100000:3.0:1787892929.301038:0:7864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892929.301113:0:7864:0:(client.c:2715:ptlrpc_set_wait()) set 000000008f0108c2 going to sleep for 11 seconds 00000100:00100000:2.0:1787892929.303439:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493249920 00000100:00100000:2.0:1787892929.303455:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493249920 00000100:00100000:3.0:1787892929.305985:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787892929.306005:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000028a4d6b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7864:x1874741493249920:12345-0@lo:1000: 00000100:00100000:3.0:1787892929.306242:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000028a4d6b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7864:x1874741493249920:12345-0@lo:1000: Request processed in 240us (5204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892929.306250:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787892929.306641:0:7864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000068394af6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7864:1874741493249920:0@lo:1000: 00000040:00080000:1.0:1787892929.306736:0:7864:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1787892929.307280:0:7864:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000078c8817 with version 1 00000004:00080000:2.0:1787892929.308567:0:7860:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000b67a08e6 version 1 rpc_version 1 00000020:00100000:2.0:1787892929.308616:0:7860:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787892929.308630:0:7860:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000005d30d802 x1874741493250176/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787892929.308659:0:7860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005d30d802 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7860:1874741493250176:0@lo:1000: 00000100:00100000:2.0:1787892929.308751:0:7860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892929.308810:0:7860:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a8918004 going to sleep for 11 seconds 00000100:00100000:0.0:1787892929.310242:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493250176 00000100:00100000:0.0:1787892929.310254:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493250176 00000100:00100000:0.0:1787892929.310324:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787892929.310335:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d6c15985 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7860:x1874741493250176:12345-0@lo:1000: 00000040:00080000:1.0:1787892929.311743:0:7864:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787892929.311805:0:7864:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787892929.311810:0:7864:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:1.0:1787892929.317792:0:7436:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:0.0:1787892929.317994:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d6c15985 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7860:x1874741493250176:12345-0@lo:1000: Request processed in 7659us (9240us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787892929.318007:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:1.0:1787892929.318408:0:7860:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1787892929.318413:0:7860:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787892929.318429:0:7860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005d30d802 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7860:1874741493250176:0@lo:1000: 00000020:00000080:3.0:1787892930.188455:0:7911:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc252750a0 20000000:00000080:3.0:1787892930.188472:0:7911:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fc9fe351400 uarg=0000000000000000 20000000:01000000:3.0:1787892930.189010:0:7911:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787892930.189017:0:7911:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787892930.189022:0:7911:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787892930.189171:0:7911:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1787892930.189181:0:7911:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1787892930.192486:0:7911:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787892930.192917:0:7911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787892930.192951:0:7911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1787892930.192966:0:7911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1787892930.192980:0:7911:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787892930.192998:0:7911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c3fc6683/0x9232577658cf093c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892930.193018:0:7911:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000005cdc76c/0x9232577658cf07bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf07b4 expref: 17 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892930.193025:0:7911:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000aea44c4/0x9232577658cf08a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf08a2 expref: 17 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892930.193031:0:7911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c3fc6683/0x9232577658cf093c lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892930.193072:0:7911:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000aea44c4/0x9232577658cf08a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf08a2 expref: 17 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892930.193095:0:7911:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000aea44c4/0x9232577658cf08a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf08a2 expref: 17 pid: 6500 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892930.193111:0:7911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000072fe7d8e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7911:1874741493250304:0@lo:104: 00000100:00100000:3.0:1787892930.193179:0:7911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787892930.193239:0:7911:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000005cdc76c/0x9232577658cf07bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf07b4 expref: 17 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892930.193247:0:7911:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000005cdc76c/0x9232577658cf07bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf07b4 expref: 17 pid: 6497 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892930.193254:0:7911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cb7def66 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7911:1874741493250432:0@lo:104: 00000100:00100000:3.0:1787892930.193270:0:7911:0:(client.c:2715:ptlrpc_set_wait()) set 000000008f0108c2 going to sleep for 11 seconds 00000100:00100000:2.0:1787892930.193343:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787892930.193361:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892930.193400:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493250304 00000100:00100000:2.0:1787892930.193407:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493250304 00000100:00100000:2.0:1787892930.193436:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493250432 00000100:00100000:2.0:1787892930.193438:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493250432 00000100:00100000:2.0:1787892930.193449:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787892930.193455:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000592eb54d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+4:7911:x1874741493250304:12345-0@lo:104: 00010000:00010000:2.0:1787892930.193466:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: 000000000af27f01/0x9232577658cf08a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf08a9 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892930.193548:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787892930.193553:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000592eb54d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+4:7911:x1874741493250304:12345-0@lo:104: Request processed in 98us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892930.193561:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787892930.193595:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787892930.193601:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2dbb7dc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+3:7911:x1874741493250432:12345-0@lo:104: 00010000:00010000:2.0:1787892930.193608:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: 0000000049ea5268/0x9232577658cf07b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf07bb expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892930.193639:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787892930.193643:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2dbb7dc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+3:7911:x1874741493250432:12345-0@lo:104: Request processed in 43us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892930.193648:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1787892930.193664:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787892930.193668:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: 000000000af27f01/0x9232577658cf08a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf08a9 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892930.193686:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000af27f01 already unused, calling callback (00000000196dfbc2) 10000000:00010000:2.0:1787892930.193689:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: 000000000af27f01/0x9232577658cf08a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf08a9 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892930.193697:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: 000000000af27f01/0x9232577658cf08a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf08a9 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787892930.193703:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: 000000000af27f01/0x9232577658cf08a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf08a9 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892930.193709:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787892930.193731:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: 000000000af27f01/0x9232577658cf08a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf08a9 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892930.193737:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787892930.193751:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: 000000000af27f01/0x9232577658cf08a2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf08a9 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892930.193756:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: 000000000af27f01/0x9232577658cf08a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf08a9 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892930.193768:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787892930.193770:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: 0000000049ea5268/0x9232577658cf07b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf07bb expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892930.193775:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000049ea5268 already unused, calling callback (00000000196dfbc2) 10000000:00010000:2.0:1787892930.193777:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: 0000000049ea5268/0x9232577658cf07b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf07bb expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892930.193791:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: 0000000049ea5268/0x9232577658cf07b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf07bb expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787892930.193796:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: 0000000049ea5268/0x9232577658cf07b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf07bb expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892930.193801:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787892930.193809:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: 0000000049ea5268/0x9232577658cf07b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf07bb expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892930.193814:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787892930.193817:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: 0000000049ea5268/0x9232577658cf07b4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf07bb expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892930.193822:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: 0000000049ea5268/0x9232577658cf07b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf07bb expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892930.193832:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892930.193834:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892930.193835:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787892930.193859:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a0ee0935 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493250560:0@lo:103: 00000100:00100000:2.0:1787892930.193885:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892930.193910:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787892930.193915:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de1d2138 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493250688:0@lo:103: 00000100:00100000:2.0:1787892930.193931:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892930.193955:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493250560 00000100:00100000:2.0:1787892930.193959:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493250560 00010000:00010000:2.0:1787892930.193974:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000aea44c4/0x9232577658cf08a9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf08a2 expref: 18 pid: 6500 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892930.194004:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493250688 00000100:00100000:2.0:1787892930.194007:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493250688 00010000:00010000:2.0:1787892930.194018:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000005cdc76c/0x9232577658cf07bb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf07b4 expref: 19 pid: 6497 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892930.194029:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787892930.194034:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006f6c4cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ad7764-cf95-4087-88aa-57e4229a8397+19:3630:x1874741493250560:12345-0@lo:103: 00010000:00010000:2.0:1787892930.194044:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787892930.194048:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000aea44c4/0x9232577658cf08a9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf08a2 expref: 19 pid: 6500 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892930.194057:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000aea44c4/0x9232577658cf08a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf08a2 expref: 19 pid: 6500 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892930.194070:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787892930.194095:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006f6c4cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ad7764-cf95-4087-88aa-57e4229a8397+19:3630:x1874741493250560:12345-0@lo:103: Request processed in 61us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892930.194101:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787892930.194113:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787892930.194118:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ca1d6f7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ad7764-cf95-4087-88aa-57e4229a8397+18:3630:x1874741493250688:12345-0@lo:103: 00010000:00010000:2.0:1787892930.194124:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787892930.194127:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000005cdc76c/0x9232577658cf07bb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf07b4 expref: 18 pid: 6497 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892930.194135:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000005cdc76c/0x9232577658cf07bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf07b4 expref: 18 pid: 6497 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892930.194144:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c3fc6683/0x9232577658cf093c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892930.194155:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c3fc6683/0x9232577658cf093c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892930.194165:0:6491:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c3fc6683/0x9232577658cf093c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892930.194171:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c3fc6683/0x9232577658cf093c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892930.194177:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c3fc6683/0x9232577658cf093c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892930.194183:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c3fc6683/0x9232577658cf093c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892930.194187:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c3fc6683 already unused, calling callback (0000000010b23f3a) 00010000:00010000:2.0:1787892930.194190:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c3fc6683/0x9232577658cf093c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892930.194195:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c3fc6683/0x9232577658cf093c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892930.194201:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c3fc6683/0x9232577658cf093c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892930.194209:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787892930.194227:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ca1d6f7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ad7764-cf95-4087-88aa-57e4229a8397+18:3630:x1874741493250688:12345-0@lo:103: Request processed in 110us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892930.194232:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787892930.194260:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de1d2138 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493250688:0@lo:103: 00000100:00100000:2.0:1787892930.194273:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a0ee0935 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493250560:0@lo:103: 00010000:00010000:3.0:1787892930.194373:0:7911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000aea44c4/0x9232577658cf08a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf08a2 expref: 17 pid: 6500 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892930.194384:0:7911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000072fe7d8e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7911:1874741493250304:0@lo:104: 00010000:00010000:3.0:1787892930.194390:0:7911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000005cdc76c/0x9232577658cf07bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf07b4 expref: 16 pid: 6497 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892930.194397:0:7911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cb7def66 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7911:1874741493250432:0@lo:104: 00010000:00010000:3.0:1787892930.194407:0:7911:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c3fc6683/0x9232577658cf093c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892930.194414:0:7911:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c3fc6683/0x9232577658cf093c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892930.194419:0:7911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c3fc6683/0x9232577658cf093c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892930.194429:0:7911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c3fc6683/0x9232577658cf093c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892930.195545:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892930.225599:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787892930.236581:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787892930.236608:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a0ee0935 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493250816:0@lo:41: 00000100:00100000:2.0:1787892930.236676:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892930.236792:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493250816 00000100:00100000:0.0:1787892930.236802:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493250816 00000100:00100000:0.0:1787892930.236870:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787892930.236879:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de1d2138 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493250816:12345-0@lo:41: 00000004:00000024:0.0:1787892930.236909:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1787892930.236972:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de1d2138 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493250816:12345-0@lo:41: Request processed in 95us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892930.236980:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787892930.237066:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a0ee0935 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493250816:0@lo:41: 00010000:00010000:1.0:1787892931.252388:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892932.273622:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892933.298736:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892934.322237:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892934.322303:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000377897d6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493250944:0@lo:41: 00000100:00100000:1.0:1787892934.322380:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892934.322650:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cb7def66 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493251072:0@lo:400: 00000100:00100000:1.0:1787892934.322700:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892934.322734:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787892934.322741:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000072fe7d8e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493251200:0@lo:400: 00000100:00100000:1.0:1787892934.322767:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892934.322800:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493251200 00000100:00100000:1.0:1787892934.322819:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493251200 00000100:00100000:1.0:1787892934.322882:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787892934.322891:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002124cb05 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493251200:12345-0@lo:400: 00000100:00100000:1.0:1787892934.322944:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002124cb05 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493251200:12345-0@lo:400: Request processed in 55us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892934.322951:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787892934.322990:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000072fe7d8e x1874741493251200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892934.323003:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000072fe7d8e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493251200:0@lo:400: 00000100:00100000:1.0:1787892934.323022:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000eb279a73 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874741493251456:0@lo:400: 00000100:00100000:1.0:1787892934.323044:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892934.323062:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787892934.323067:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002c72a502 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493251328:0@lo:400: 00000100:00100000:1.0:1787892934.323088:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892934.323127:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493251456 00000100:00100000:1.0:1787892934.323131:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493251456 00000100:00100000:1.0:1787892934.323153:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787892934.323158:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b64d31c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1874741493251456:12345-0@lo:400: 00000100:00100000:1.0:1787892934.323191:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b64d31c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1874741493251456:12345-0@lo:400: Request processed in 33us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892934.323197:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787892934.323223:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493250944 00000100:00100000:1.0:1787892934.323226:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493250944 00000100:00100000:1.0:1787892934.323247:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493251328 00000100:00100000:1.0:1787892934.323250:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493251328 00000100:00100000:1.0:1787892934.323263:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787892934.323269:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a4bb9729 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493250944:12345-0@lo:41: 00000004:00000024:1.0:1787892934.323297:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1787892934.323331:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a4bb9729 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493250944:12345-0@lo:41: Request processed in 63us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892934.323337:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787892934.323349:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787892934.323354:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d3dc60f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493251328:12345-0@lo:400: 00000100:00100000:1.0:1787892934.323378:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d3dc60f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493251328:12345-0@lo:400: Request processed in 25us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892934.323383:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787892934.323411:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002c72a502 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493251328:0@lo:400: 00010000:00080000:1.0:1787892934.323419:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000eb279a73 x1874741493251456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892934.323429:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000eb279a73 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874741493251456:0@lo:400: 00000100:00100000:1.0:1787892934.323441:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000377897d6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493250944:0@lo:41: 00000100:00100000:3.0:1787892934.323697:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493251072 00000100:00100000:3.0:1787892934.323702:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493251072 00000100:00100000:3.0:1787892934.323739:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787892934.323746:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6b37205 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+16:3630:x1874741493251072:12345-0@lo:400: 00000100:00100000:3.0:1787892934.323783:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6b37205 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+16:3630:x1874741493251072:12345-0@lo:400: Request processed in 38us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892934.323789:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787892934.324145:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cb7def66 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493251072:0@lo:400: 10000000:01000000:1.0:1787892935.347946:0:6502:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787892935.347955:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc9ed573800 from 1 10000000:01000000:1.0:1787892935.347961:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787892935.348012:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: 00000000d6279780/0x9232577658cf0943 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892935.348044:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: 00000000d6279780/0x9232577658cf0943 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892935.348057:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: 00000000d6279780/0x9232577658cf0943 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892935.348080:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001578e3ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493251584:0@lo:101: 00000100:00100000:1.0:1787892935.348172:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892935.348229:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set 000000005654d27b going to sleep for 11 seconds 00000100:00100000:1.0:1787892935.348256:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493251584 00000100:00100000:1.0:1787892935.348264:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493251584 00000100:00100000:1.0:1787892935.348335:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787892935.348345:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e018bac8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+16:6502:x1874741493251584:12345-0@lo:101: 00010000:00010000:1.0:1787892935.348358:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787892935.348371:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000aea44c4/0x9232577658cf094a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0943 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892935.348395:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000aea44c4/0x9232577658cf094a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0943 expref: 17 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892935.348404:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000aea44c4/0x9232577658cf094a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0943 expref: 17 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892935.348413:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000aea44c4, rc 0) 00000100:00100000:1.0:1787892935.348450:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e018bac8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+17:6502:x1874741493251584:12345-0@lo:101: Request processed in 107us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892935.348458:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787892935.348531:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001578e3ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493251584:0@lo:101: 00010000:00010000:1.0:1787892935.348555:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: 00000000d6279780/0x9232577658cf0943 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf094a expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892935.348563:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: 00000000d6279780/0x9232577658cf0943 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf094a expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892935.348619:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001578e3ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493251712:0@lo:501: 00000100:00100000:1.0:1787892935.348649:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892935.348663:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set 000000005654d27b going to sleep for 11 seconds 00000100:00100000:1.0:1787892935.348677:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493251712 00000100:00100000:1.0:1787892935.348680:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493251712 00000100:00100000:1.0:1787892935.348701:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787892935.348706:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041312074 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+17:6502:x1874741493251712:12345-0@lo:501: 00000100:00100000:3.0:1787892935.349141:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f22b59c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493251840:0@lo:41: 00000100:00100000:3.0:1787892935.349179:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892935.349219:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493251840 00000100:00100000:3.0:1787892935.349223:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493251840 00000100:00100000:3.0:1787892935.349256:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787892935.349264:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f781632 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493251840:12345-0@lo:41: 00000004:00000024:3.0:1787892935.349288:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1787892935.349326:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f781632 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493251840:12345-0@lo:41: Request processed in 63us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892935.349332:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787892935.349367:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f22b59c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493251840:0@lo:41: 00000100:00100000:1.0:1787892935.351422:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041312074 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+17:6502:x1874741493251712:12345-0@lo:501: Request processed in 2709us (2766us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892935.351437:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787892935.355362:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001578e3ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493251712:0@lo:501: 00000100:00100000:0.0:1787892935.355434:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000752cc03 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493251968:0@lo:503: 00000100:00100000:0.0:1787892935.355553:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892935.355594:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f32836fd going to sleep for 11 seconds 00000100:00100000:3.0:1787892935.357930:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493251968 00000100:00100000:3.0:1787892935.357946:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493251968 00000100:00100000:3.0:1787892935.358007:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787892935.358015:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b795f78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+17:6502:x1874741493251968:12345-0@lo:503: 00000100:00100000:3.0:1787892935.358190:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b795f78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+17:6502:x1874741493251968:12345-0@lo:503: Request processed in 176us (2637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892935.358205:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787892935.358268:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000752cc03 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493251968:0@lo:503: 00000100:00100000:3.0:1787892935.358529:0:8127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f22b59c6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:8127:1874741493252096:0@lo:502: 00000100:00100000:3.0:1787892935.358570:0:8127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892935.358596:0:8127:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e92e10df going to sleep for 11 seconds 00000100:00100000:0.0:1787892935.359578:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493252096 00000100:00100000:0.0:1787892935.359590:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493252096 00000100:00100000:0.0:1787892935.359641:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787892935.359650:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a03b5c64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+17:8127:x1874741493252096:12345-0@lo:502: 00000100:00100000:0.0:1787892935.359784:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a03b5c64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+17:8127:x1874741493252096:12345-0@lo:502: Request processed in 134us (1214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892935.359813:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00010000:1.0:1787892935.362885:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787892935.366261:0:8127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f22b59c6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:8127:1874741493252096:0@lo:502: 00000020:01000000:3.0:1787892935.366315:0:8127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787892935.366324:0:8127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787892935.366326:0:8127:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787892935.366333:0:8127:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc9ed573800 00000020:00000080:3.0:1787892935.366335:0:8127:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787892935.366403:0:8127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe34bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:8127:1874741493252224:0@lo:502: 00000100:00100000:3.0:1787892935.366478:0:8127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892935.366542:0:8127:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e5e5b000 going to sleep for 11 seconds 00000100:00100000:0.0:1787892935.368006:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493252224 00000100:00100000:0.0:1787892935.368019:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493252224 00000100:00100000:0.0:1787892935.368076:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787892935.368086:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+17:8127:x1874741493252224:12345-0@lo:502: 00000100:00100000:0.0:1787892935.368265:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+17:8127:x1874741493252224:12345-0@lo:502: Request processed in 179us (1787us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892935.368272:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787892935.370579:0:8127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe34bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:8127:1874741493252224:0@lo:502: 00000020:01000000:3.0:1787892935.370629:0:8127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787892935.370641:0:8127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787892935.370643:0:8127:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787892935.370647:0:8127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1787892935.370843:0:6502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787892935.370867:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787892935.370880:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69c600/0x9232577658cf0943 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf094a expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892935.370892:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69c600/0x9232577658cf0943 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf094a expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787892935.370902:0:6502:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787892935.370904:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc9d909c800 from 1 10000000:01000000:0.0:1787892935.370907:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787892935.370942:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31000/0x9232577658cf0951 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892935.370951:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31000/0x9232577658cf0951 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892935.370961:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31000/0x9232577658cf0951 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892935.370981:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493252352:0@lo:101: 00000100:00100000:0.0:1787892935.371059:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892935.371106:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c4d87480 going to sleep for 11 seconds 00000100:00100000:3.0:1787892935.371463:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493252352 00000100:00100000:3.0:1787892935.371470:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493252352 00000100:00100000:3.0:1787892935.371566:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787892935.371575:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+17:6502:x1874741493252352:12345-0@lo:101: 00010000:00010000:3.0:1787892935.371588:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787892935.371602:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9c147d400/0x9232577658cf0958 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0951 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892935.371637:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9c147d400/0x9232577658cf0958 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0951 expref: 18 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892935.371647:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9c147d400/0x9232577658cf0958 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0951 expref: 18 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892935.371656:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9c147d400, rc 0) 00000100:00100000:3.0:1787892935.371703:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+18:6502:x1874741493252352:12345-0@lo:101: Request processed in 128us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892935.371709:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787892935.371851:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493252352:0@lo:101: 00010000:00010000:3.0:1787892935.371863:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31000/0x9232577658cf0951 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0958 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892935.371872:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31000/0x9232577658cf0951 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0958 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892935.371924:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe34bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493252480:0@lo:501: 00000100:00100000:3.0:1787892935.371950:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892935.371972:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e5e5b780 going to sleep for 11 seconds 00000100:00100000:3.0:1787892935.371985:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493252480 00000100:00100000:3.0:1787892935.371988:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493252480 00000100:00100000:3.0:1787892935.372011:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787892935.372018:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+18:6502:x1874741493252480:12345-0@lo:501: 00000100:00100000:3.0:1787892935.372119:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+18:6502:x1874741493252480:12345-0@lo:501: Request processed in 101us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892935.372125:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787892935.372164:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe34bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493252480:0@lo:501: 00000100:00100000:3.0:1787892935.372190:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe34bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493252608:0@lo:503: 00000100:00100000:3.0:1787892935.372227:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892935.372241:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d24f29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787892935.372251:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493252608 00000100:00100000:3.0:1787892935.372254:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493252608 00000100:00100000:3.0:1787892935.372275:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787892935.372281:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+18:6502:x1874741493252608:12345-0@lo:503: 00000100:00100000:3.0:1787892935.372362:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+18:6502:x1874741493252608:12345-0@lo:503: Request processed in 81us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892935.372369:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787892935.372409:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe34bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493252608:0@lo:503: 00000100:00100000:3.0:1787892935.372617:0:8128:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe34bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:8128:1874741493252736:0@lo:502: 00000100:00100000:3.0:1787892935.372656:0:8128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892935.372676:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493252736 00000100:00100000:3.0:1787892935.372679:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493252736 00000100:00100000:3.0:1787892935.372700:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787892935.372706:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+18:8128:x1874741493252736:12345-0@lo:502: 00000100:00100000:3.0:1787892935.372769:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+18:8128:x1874741493252736:12345-0@lo:502: Request processed in 62us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892935.372776:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787892935.372823:0:8128:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d24f2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787892935.372837:0:8128:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe34bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:8128:1874741493252736:0@lo:502: 00000020:01000000:3.0:1787892935.372858:0:8128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787892935.372867:0:8128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787892935.372870:0:8128:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787892935.372880:0:8128:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc9d909c800 00000020:00000080:3.0:1787892935.372882:0:8128:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787892935.372903:0:8128:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe34bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:8128:1874741493252864:0@lo:502: 00000100:00100000:3.0:1787892935.372933:0:8128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892935.372951:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493252864 00000100:00100000:3.0:1787892935.372954:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493252864 00000100:00100000:3.0:1787892935.372973:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787892935.372978:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+18:8128:x1874741493252864:12345-0@lo:502: 00000100:00100000:3.0:1787892935.373029:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+18:8128:x1874741493252864:12345-0@lo:502: Request processed in 50us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892935.373035:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787892935.373062:0:8128:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d24f2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787892935.373074:0:8128:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe34bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:8128:1874741493252864:0@lo:502: 00000020:01000000:3.0:1787892935.373089:0:8128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787892935.373094:0:8128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787892935.373095:0:8128:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787892935.373098:0:8128:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1787892935.373140:0:6502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787892935.373157:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787892935.373165:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31000/0x9232577658cf0951 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0958 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892935.373174:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31000/0x9232577658cf0951 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0958 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892936.374129:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892937.396172:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787892938.423337:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787892939.445139:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe34bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493252992:0@lo:400: 00000100:00100000:3.0:1787892939.445204:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892939.445244:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe34aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493253504:0@lo:400: 00000100:00100000:3.0:1787892939.445280:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892939.445314:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787892939.445319:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe349500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1874741493253376:0@lo:400: 00000100:00100000:3.0:1787892939.445341:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892939.445370:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe349c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493253120:0@lo:400: 00000100:00100000:3.0:1787892939.445392:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892939.445407:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787892939.445412:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe348700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493253248:0@lo:400: 00000100:00100000:3.0:1787892939.445431:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892939.445458:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493252992 00000100:00100000:3.0:1787892939.445465:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493252992 00000100:00100000:3.0:1787892939.445938:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787892939.445948:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+18:3631:x1874741493252992:12345-0@lo:400: 00000100:00100000:3.0:1787892939.446002:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+18:3631:x1874741493252992:12345-0@lo:400: Request processed in 56us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892939.446009:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787892939.446043:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493253504 00000100:00100000:3.0:1787892939.446047:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493253504 00000100:00100000:3.0:1787892939.446068:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493253248 00000100:00100000:3.0:1787892939.446070:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493253248 00000100:00100000:3.0:1787892939.446084:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787892939.446090:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe349180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493253504:12345-0@lo:400: 00000100:00100000:3.0:1787892939.446122:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe349180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493253504:12345-0@lo:400: Request processed in 32us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892939.446128:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787892939.446140:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787892939.446146:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ed561f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493253248:12345-0@lo:400: 00000100:00100000:3.0:1787892939.446189:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ed561f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493253248:12345-0@lo:400: Request processed in 43us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892939.446195:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787892939.446243:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe348700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493253248:0@lo:400: 00000100:00100000:3.0:1787892939.446269:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe34bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493252992:0@lo:400: 00000100:00100000:3.0:1787892939.446278:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe34aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493253504:0@lo:400: 00000100:00100000:1.0:1787892939.446649:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493253376 00000100:00100000:1.0:1787892939.446655:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493253376 00000100:00100000:1.0:1787892939.446683:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493253120 00000100:00100000:1.0:1787892939.446685:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493253120 00000100:00100000:1.0:1787892939.446700:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787892939.446706:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe34a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1874741493253376:12345-0@lo:400: 00000100:00100000:1.0:1787892939.446746:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe34a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1874741493253376:12345-0@lo:400: Request processed in 41us (1404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892939.446752:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787892939.446779:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787892939.446785:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe349f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493253120:12345-0@lo:400: 00000100:00100000:1.0:1787892939.446832:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe349f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493253120:12345-0@lo:400: Request processed in 42us (1434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892939.446839:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1787892939.446875:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc9fe349c00 x1874741493253120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892939.446886:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe349c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493253120:0@lo:400: 00010000:00080000:1.0:1787892939.446910:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc9fe349500 x1874741493253376/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892939.446918:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe349500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1874741493253376:0@lo:400: 00000100:00100000:1.0:1787892939.447723:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787892939.447738:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed562680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493253632:0@lo:41: 00000100:00100000:1.0:1787892939.447789:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892939.447945:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493253632 00000100:00100000:3.0:1787892939.447951:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493253632 00000100:00100000:3.0:1787892939.447984:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787892939.447991:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493253632:12345-0@lo:41: 00000004:00000024:3.0:1787892939.448016:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1787892939.448054:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493253632:12345-0@lo:41: Request processed in 63us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892939.448059:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787892939.448131:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed562680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493253632:0@lo:41: 00010000:00010000:3.0:1787892939.448715:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787892940.465649:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787892940.465675:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed563480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493253760:0@lo:41: 00000100:00100000:3.0:1787892940.465745:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892940.465818:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493253760 00000100:00100000:3.0:1787892940.465825:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493253760 00000100:00100000:3.0:1787892940.465880:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787892940.465890:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ed560380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493253760:12345-0@lo:41: 00000004:00000024:3.0:1787892940.465922:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1787892940.465966:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ed560380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493253760:12345-0@lo:41: Request processed in 77us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892940.465972:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787892940.466027:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed563480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493253760:0@lo:41: 00010000:00010000:2.0:1787892940.466542:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787892940.924776:0:8412:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787892940.924781:0:8412:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787892940.924782:0:8412:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787892940.924933:0:8412:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fc9fe136000 00000020:01000004:2.0:1787892940.924948:0:8412:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787892940.924960:0:8412:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787892940.924973:0:8412:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9fc9d911b370) 00000020:00000080:2.0:1787892940.924991:0:8412:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787892940.959035:0:8412:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787892940.959096:0:8412:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1787892940.982195:0:8412:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787892940.982621:0:8412:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787892940.982633:0:8412:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787892940.982646:0:8412:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9232577658cf0966 00000020:01000004:2.0:1787892940.982655:0:8412:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787892940.982676:0:8412:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.135@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787892940.982679:0:8412:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.135@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787892940.982686:0:8412:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787892940.982691:0:8412:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787892940.982702:0:8412:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9fc9d9118000) 00000020:00000080:2.0:1787892940.982715:0:8412:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1787892940.984786:0:8412:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787892940.985145:0:8412:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787892940.985152:0:8412:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787892940.987776:0:8412:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787892940.987788:0:8412:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787892940.989702:0:8412:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787892940.989715:0:8412:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787892940.993428:0:8412:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787892940.993651:0:8412:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787892940.993658:0:8412:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787892941.002796:0:8412:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787892941.002807:0:8412:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787892941.038878:0:8412:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787892941.039114:0:8412:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787892941.039121:0:8412:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787892941.041099:0:8412:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787892941.041112:0:8412:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787892941.042642:0:8412:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787892941.042658:0:8412:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787892941.046612:0:8412:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787892941.046813:0:8412:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787892941.046820:0:8412:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787892941.047351:0:8412:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787892941.047586:0:8412:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787892941.122664:0:8412:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787892941.125471:0:8412:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787892941.125486:0:8412:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787892941.136066:0:8412:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787892941.136084:0:8412:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787892941.139672:0:8412:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787892941.139703:0:8412:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1787892941.139710:0:8412:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.135@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787892941.186060:0:8412:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.135@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787892941.186111:0:8412:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.135@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1787892941.186116:0:8412:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787892941.186117:0:8412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787892941.186118:0:8412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787892941.186119:0:8412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787892941.186120:0:8412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787892941.186122:0:8412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787892941.186123:0:8412:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787892941.186125:0:8412:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787892941.186126:0:8412:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787892941.186127:0:8412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787892941.186129:0:8412:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787892941.186132:0:8412:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1787892941.186139:0:8412:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787892941.186140:0:8412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787892941.186141:0:8412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787892941.186142:0:8412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787892941.186143:0:8412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787892941.186144:0:8412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787892941.186145:0:8412:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787892941.186146:0:8412:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787892941.186146:0:8412:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787892941.186147:0:8412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787892941.186148:0:8412:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787892941.186181:0:8412:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787892941.186200:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f72d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:8412:1874741493253888:0@lo:253: 00000100:00100000:1.0:1787892941.186270:0:8412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892941.186322:0:8412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fe374540 going to sleep for 11 seconds 00000100:00100000:0.0:1787892941.187602:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493253888 00000100:00100000:0.0:1787892941.187613:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493253888 00000100:00100000:0.0:1787892941.187671:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787892941.187681:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+18:8412:x1874741493253888:12345-0@lo:253: 20000000:01000000:0.0:1787892941.187711:0:6500:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787892941.187715:0:6500:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1787892941.187719:0:6500:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1787892941.187722:0:6500:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1787892941.187964:0:6500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787892941.188094:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1787892941.188107:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1787892941.188122:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1787892941.188126:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1787892941.188137:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1787892941.188149:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1787892941.188223:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1787892941.188235:0:6500:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.135@tcp 20000000:01000000:0.0:1787892941.188237:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.135@tcp (null) (null) (null) 00000040:00080000:0.0:1787892941.188250:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1787892941.188256:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787892941.188268:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1787892941.188273:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.135@tcp (null) (null) 00000040:00080000:0.0:1787892941.188284:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1787892941.188290:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787892941.188321:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1787892941.188338:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1787892941.188404:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:0.0:1787892941.188414:0:6500:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.135@tcp 20000000:01000000:0.0:1787892941.188415:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.135@tcp (null) (null) (null) 00000040:00080000:0.0:1787892941.188426:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:0.0:1787892941.188431:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787892941.188442:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:0.0:1787892941.188447:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.202.135@tcp (null) (null) 00000040:00080000:0.0:1787892941.188457:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:0.0:1787892941.188462:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787892941.188487:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:0.0:1787892941.188535:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:0.0:1787892941.188897:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:0.0:1787892941.188909:0:6500:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.135@tcp 20000000:01000000:0.0:1787892941.188910:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.135@tcp (null) (null) (null) 00000040:00080000:0.0:1787892941.188924:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:0.0:1787892941.188929:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787892941.188941:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:0.0:1787892941.188945:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.135@tcp (null) (null) 00000040:00080000:0.0:1787892941.188955:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:0.0:1787892941.188961:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787892941.188971:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:0.0:1787892941.188984:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:0.0:1787892941.188995:0:6500:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787892941.188997:0:6500:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787892941.189000:0:6500:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787892941.189036:0:6500:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787892941.189039:0:6500:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787892941.189736:0:8431:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:3.0:1787892941.189777:0:8431:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:3.0:1787892941.189793:0:8431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1787892941.190371:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1787892941.190406:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1787892941.190438:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1787892941.190449:0:6500:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787892941.190451:0:6500:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787892941.191319:0:8432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1787892941.191573:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1787892941.191596:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1787892941.191609:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1787892941.191618:0:6500:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1787892941.191620:0:6500:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787892941.193355:0:8433:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:0.0:1787892941.193396:0:8433:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:0.0:1787892941.193413:0:8433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:1.0:1787892941.193637:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:1.0:1787892941.193658:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:1.0:1787892941.193670:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:1.0:1787892941.193682:0:6500:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787892941.193684:0:6500:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787892941.194396:0:8434:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 20 1->4: lustre sys.timeout 20000000:01000000:1.0:1787892941.194421:0:8434:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 20 2->4: lustre sys.timeout 00000040:00080000:1.0:1787892941.194436:0:8434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1787892941.194675:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:0.0:1787892941.194697:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:0.0:1787892941.194711:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 10000000:01000000:0.0:1787892941.194724:0:6500:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787892941.194753:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0974 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892941.194770:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9dd729200/0x9232577658cf0840 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0839 expref: 18 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892941.194785:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9dd69d800/0x9232577658cf08b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf08b0 expref: 18 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892941.194792:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9dd69ce00/0x9232577658cf08ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf08e8 expref: 18 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892941.194799:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9dd69c800/0x9232577658cf090b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0904 expref: 18 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892941.194805:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9edb31c00/0x9232577658cf0935 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf092e expref: 18 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892941.194823:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0974 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892941.194861:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9edb31c00/0x9232577658cf0935 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf092e expref: 18 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892941.194876:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc9edb31c00/0x9232577658cf0935 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf092e expref: 18 pid: 6500 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892941.194889:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6500:1874741493254016:0@lo:104: 00000100:00100000:0.0:1787892941.194952:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787892941.195006:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9dd69c800/0x9232577658cf090b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf0904 expref: 18 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892941.195016:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc9dd69c800/0x9232577658cf090b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf0904 expref: 18 pid: 6500 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892941.195024:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6500:1874741493254144:0@lo:104: 00000100:00100000:0.0:1787892941.195058:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787892941.195086:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9dd69ce00/0x9232577658cf08ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf08e8 expref: 18 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892941.195094:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc9dd69ce00/0x9232577658cf08ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf08e8 expref: 18 pid: 6500 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892941.195103:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6500:1874741493254272:0@lo:104: 00000100:00100000:0.0:1787892941.195121:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787892941.195137:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9dd69d800/0x9232577658cf08b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf08b0 expref: 18 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892941.195152:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc9dd69d800/0x9232577658cf08b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf08b0 expref: 18 pid: 6499 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892941.195160:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6500:1874741493254400:0@lo:104: 00000100:00100000:0.0:1787892941.195181:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787892941.195198:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9dd729200/0x9232577658cf0840 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf0839 expref: 18 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892941.195205:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc9dd729200/0x9232577658cf0840 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf0839 expref: 18 pid: 6500 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892941.195212:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6500:1874741493254528:0@lo:104: 00000100:00100000:0.0:1787892941.195231:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892941.195240:0:6500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fe47fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787892941.195380:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493254016 00000100:00100000:2.0:1787892941.195396:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493254016 00000100:00100000:2.0:1787892941.195438:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493254144 00000100:00100000:2.0:1787892941.195441:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493254144 00000100:00100000:2.0:1787892941.195452:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493254272 00000100:00100000:2.0:1787892941.195454:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493254272 00000100:00100000:2.0:1787892941.195475:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493254400 00000100:00100000:2.0:1787892941.195477:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493254400 00000100:00100000:2.0:1787892941.195485:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493254528 00000100:00100000:2.0:1787892941.195487:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493254528 00000100:00100000:2.0:1787892941.195525:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787892941.195540:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+7:6500:x1874741493254016:12345-0@lo:104: 00010000:00010000:2.0:1787892941.195552:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30e00/0x9232577658cf092e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0935 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892941.195615:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787892941.195622:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+7:6500:x1874741493254016:12345-0@lo:104: Request processed in 83us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892941.195629:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787892941.195646:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787892941.195652:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+6:6500:x1874741493254144:12345-0@lo:104: 00000100:00100000:0.0:1787892941.195652:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6500:1874741493254016:0@lo:104: 00010000:00010000:2.0:1787892941.195660:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf0904 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf090b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.195690:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787892941.195696:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30e00/0x9232577658cf092e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0935 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892941.195701:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1787892941.195704:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30e00 already unused, calling callback (ffffffffc129fc20) 00000100:00100000:2.0:1787892941.195706:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+6:6500:x1874741493254144:12345-0@lo:104: Request processed in 55us (648us total) trans 0 rc 0/0 10000000:00010000:1.0:1787892941.195708:0:6493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30e00/0x9232577658cf092e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf0935 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892941.195712:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1787892941.195716:0:6493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30e00/0x9232577658cf092e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf0935 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892941.195723:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787892941.195729:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+5:6500:x1874741493254272:12345-0@lo:104: 10000000:00010000:1.0:1787892941.195733:0:6493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30e00/0x9232577658cf092e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf0935 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892941.195735:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9c147dc00/0x9232577658cf08e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf08ef expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787892941.195750:0:6493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787892941.195771:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787892941.195776:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+5:6500:x1874741493254272:12345-0@lo:104: Request processed in 48us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892941.195782:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1787892941.195785:0:6493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30e00/0x9232577658cf092e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0935 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.195791:0:6493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787892941.195792:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787892941.195797:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+4:6500:x1874741493254400:12345-0@lo:104: 00010000:00010000:1.0:1787892941.195807:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30e00/0x9232577658cf092e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0935 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892941.195809:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d800/0x9232577658cf08b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf08b7 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.195815:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30e00/0x9232577658cf092e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0935 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.195826:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787892941.195829:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf0904 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf090b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892941.195834:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1787892941.195835:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd728200 already unused, calling callback (ffffffffc129fc20) 00000100:00100000:2.0:1787892941.195838:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+4:6500:x1874741493254400:12345-0@lo:104: Request processed in 41us (656us total) trans 0 rc 0/0 10000000:00010000:1.0:1787892941.195838:0:6493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf0904 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf090b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892941.195844:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1787892941.195845:0:6493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf0904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf090b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787892941.195851:0:6493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf0904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf090b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892941.195855:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 10000000:01000000:1.0:1787892941.195857:0:6493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1787892941.195860:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+3:6500:x1874741493254528:12345-0@lo:104: 00010000:00010000:2.0:1787892941.195868:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729a00/0x9232577658cf0839 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0840 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.195873:0:6493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf0904 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf090b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.195879:0:6493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787892941.195884:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf0904 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf090b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892941.195890:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:1.0:1787892941.195890:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf0904 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf090b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892941.195894:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+3:6500:x1874741493254528:12345-0@lo:104: Request processed in 35us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892941.195899:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1787892941.195899:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787892941.195902:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9c147dc00/0x9232577658cf08e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf08ef expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.195907:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c147dc00 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:1.0:1787892941.195910:0:6493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c147dc00/0x9232577658cf08e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf08ef expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892941.195912:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787892941.195917:0:6493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9c147dc00/0x9232577658cf08e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf08ef expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787892941.195923:0:6493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c147dc00/0x9232577658cf08e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf08ef expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787892941.195928:0:6493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787892941.195938:0:6493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9c147dc00/0x9232577658cf08e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf08ef expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.195943:0:6493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787892941.195955:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9c147dc00/0x9232577658cf08e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf08ef expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.195969:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9c147dc00/0x9232577658cf08e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf08ef expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.195978:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787892941.195980:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729a00/0x9232577658cf0839 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0840 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.195985:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd729a00 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:1.0:1787892941.195988:0:6493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729a00/0x9232577658cf0839 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf0840 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.195994:0:6493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729a00/0x9232577658cf0839 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf0840 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787892941.196000:0:6493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729a00/0x9232577658cf0839 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf0840 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787892941.196005:0:6493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787892941.196018:0:6493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729a00/0x9232577658cf0839 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0840 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.196023:0:6493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787892941.196030:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729a00/0x9232577658cf0839 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0840 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892941.196038:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892941.196044:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d800/0x9232577658cf08b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf08b7 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.196049:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729a00/0x9232577658cf0839 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0840 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892941.196050:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c147d800 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:2.0:1787892941.196053:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d800/0x9232577658cf08b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf08b7 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.196057:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892941.196060:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d800/0x9232577658cf08b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf08b7 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.196063:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892941.196065:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:2.0:1787892941.196066:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d800/0x9232577658cf08b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf08b7 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892941.196076:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787892941.196076:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493254784:0@lo:103: 00010000:00010000:2.0:1787892941.196089:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d800/0x9232577658cf08b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf08b7 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892941.196094:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787892941.196098:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d800/0x9232577658cf08b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf08b7 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892941.196104:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787892941.196105:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d800/0x9232577658cf08b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf08b7 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892941.196116:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892941.196118:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892941.196120:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892941.196125:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892941.196126:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892941.196130:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787892941.196136:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493254656:0@lo:103: 00000100:00100000:1.0:1787892941.196156:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892941.196181:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d29f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493255168:0@lo:103: 00000100:00100000:1.0:1787892941.196199:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892941.196222:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493255040:0@lo:103: 00000100:00100000:1.0:1787892941.196243:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892941.196254:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787892941.196259:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493254912:0@lo:103: 00000100:00100000:1.0:1787892941.196279:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892941.196299:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493254784 00000100:00100000:1.0:1787892941.196303:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493254784 00010000:00010000:1.0:1787892941.196321:0:6490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9dd69c800/0x9232577658cf090b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0904 expref: 19 pid: 6500 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892941.196334:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493254656 00000100:00100000:1.0:1787892941.196336:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493254656 00010000:00010000:1.0:1787892941.196344:0:6490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9edb31c00/0x9232577658cf0935 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf092e expref: 20 pid: 6500 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892941.196352:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493255168 00000100:00100000:1.0:1787892941.196354:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493255168 00010000:00010000:1.0:1787892941.196361:0:6490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9dd69d800/0x9232577658cf08b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf08b0 expref: 21 pid: 6499 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892941.196369:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493255040 00000100:00100000:1.0:1787892941.196376:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493255040 00010000:00010000:1.0:1787892941.196387:0:6490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9dd729200/0x9232577658cf0840 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0839 expref: 22 pid: 6500 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892941.196397:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493254912 00000100:00100000:1.0:1787892941.196399:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493254912 00010000:00010000:1.0:1787892941.196407:0:6490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9dd69ce00/0x9232577658cf08ef lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf08e8 expref: 23 pid: 6500 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892941.196418:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787892941.196423:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ad7764-cf95-4087-88aa-57e4229a8397+23:3631:x1874741493254784:12345-0@lo:103: 00010000:00010000:1.0:1787892941.196431:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787892941.196435:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9dd69c800/0x9232577658cf090b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0904 expref: 23 pid: 6500 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.196444:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9dd69c800/0x9232577658cf090b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf0904 expref: 23 pid: 6500 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.196457:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787892941.196483:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ad7764-cf95-4087-88aa-57e4229a8397+23:3631:x1874741493254784:12345-0@lo:103: Request processed in 60us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892941.196512:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787892941.196526:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787892941.196531:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ad7764-cf95-4087-88aa-57e4229a8397+22:3631:x1874741493254656:12345-0@lo:103: 00010000:00010000:1.0:1787892941.196538:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787892941.196541:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9edb31c00/0x9232577658cf0935 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf092e expref: 22 pid: 6500 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.196549:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9edb31c00/0x9232577658cf0935 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf092e expref: 22 pid: 6500 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.196570:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9edb31c00/0x9232577658cf0935 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf092e expref: 22 pid: 6500 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.196579:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787892941.196601:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ad7764-cf95-4087-88aa-57e4229a8397+21:3631:x1874741493254656:12345-0@lo:103: Request processed in 70us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892941.196607:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787892941.196619:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787892941.196627:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ad7764-cf95-4087-88aa-57e4229a8397+20:3631:x1874741493255168:12345-0@lo:103: 00010000:00010000:1.0:1787892941.196634:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787892941.196637:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9dd69d800/0x9232577658cf08b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf08b0 expref: 20 pid: 6499 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.196644:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9dd69d800/0x9232577658cf08b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf08b0 expref: 20 pid: 6499 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.196653:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787892941.196673:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ad7764-cf95-4087-88aa-57e4229a8397+20:3631:x1874741493255168:12345-0@lo:103: Request processed in 48us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892941.196679:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787892941.196689:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787892941.196694:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ad7764-cf95-4087-88aa-57e4229a8397+19:3633:x1874741493255040:12345-0@lo:103: 00010000:00010000:1.0:1787892941.196700:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787892941.196704:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9dd729200/0x9232577658cf0840 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0839 expref: 19 pid: 6500 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.196711:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9dd729200/0x9232577658cf0840 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf0839 expref: 19 pid: 6500 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.196727:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787892941.196767:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ad7764-cf95-4087-88aa-57e4229a8397+19:3633:x1874741493255040:12345-0@lo:103: Request processed in 72us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892941.196773:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787892941.196785:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787892941.196790:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e71850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ad7764-cf95-4087-88aa-57e4229a8397+18:3633:x1874741493254912:12345-0@lo:103: 00010000:00010000:1.0:1787892941.196797:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787892941.196801:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9dd69ce00/0x9232577658cf08ef lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf08e8 expref: 18 pid: 6500 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.196809:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9dd69ce00/0x9232577658cf08ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf08e8 expref: 18 pid: 6500 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.196820:0:6490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0974 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.196827:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0974 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.196839:0:6490:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0974 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.196846:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0974 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.196852:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0974 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.196857:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0974 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.196869:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30c00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:1.0:1787892941.196873:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0974 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.196879:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0974 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.196887:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0974 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.196895:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787892941.196919:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e71850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ad7764-cf95-4087-88aa-57e4229a8397+18:3633:x1874741493254912:12345-0@lo:103: Request processed in 128us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892941.196924:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787892941.196972:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493254912:0@lo:103: 00000100:00100000:1.0:1787892941.196979:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493255040:0@lo:103: 00000100:00100000:1.0:1787892941.196999:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493254656:0@lo:103: 00000100:00100000:1.0:1787892941.197006:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d29f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493255168:0@lo:103: 00000100:00100000:1.0:1787892941.197012:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493254784:0@lo:103: 00010000:00010000:0.0:1787892941.197282:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9dd69c800/0x9232577658cf090b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf0904 expref: 17 pid: 6500 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892941.197294:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6500:1874741493254144:0@lo:104: 00010000:00010000:0.0:1787892941.197304:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9dd69ce00/0x9232577658cf08ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf08e8 expref: 16 pid: 6500 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892941.197311:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6500:1874741493254272:0@lo:104: 00010000:00010000:0.0:1787892941.197321:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9dd69d800/0x9232577658cf08b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf08b0 expref: 15 pid: 6499 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892941.197331:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6500:1874741493254400:0@lo:104: 00010000:00010000:0.0:1787892941.197349:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9dd729200/0x9232577658cf0840 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf0839 expref: 14 pid: 6500 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892941.197359:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6500:1874741493254528:0@lo:104: 00010000:00010000:0.0:1787892941.197376:0:6500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0974 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892941.197383:0:6500:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0974 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892941.197390:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0974 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892941.197396:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0974 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787892941.197407:0:6500:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787892941.202996:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+13:8412:x1874741493253888:12345-0@lo:253: Request processed in 15306us (16716us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892941.203011:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787892941.203211:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f72d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:8412:1874741493253888:0@lo:253: 10000000:01000000:1.0:1787892941.203228:0:8412:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787892941.203231:0:8412:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787892941.203233:0:8412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787892941.203234:0:8412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787892941.203235:0:8412:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1787892941.203249:0:8412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787892941.203251:0:8412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787892941.203252:0:8412:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787892941.203254:0:8412:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787892941.203255:0:8412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787892941.203257:0:8412:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787892941.203277:0:8412:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fc9fe136000 from lustre-OST0000 10000000:01000000:1.0:1787892941.203307:0:8412:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787892941.203310:0:8412:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787892941.203318:0:8412:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fc9e2e3b370 local copy 10000000:01000000:1.0:1787892941.203322:0:8412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787892941.203360:0:8412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69de00/0x9232577658cf097b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.203371:0:8412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69de00/0x9232577658cf097b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.203380:0:8412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69de00/0x9232577658cf097b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892941.203400:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f72d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:8412:1874741493255296:0@lo:101: 00000100:00100000:1.0:1787892941.203436:0:8412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892941.203479:0:8412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fe374600 going to sleep for 11 seconds 00000100:00100000:0.0:1787892941.203631:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493255296 00000100:00100000:0.0:1787892941.203638:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493255296 00000100:00100000:0.0:1787892941.203681:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787892941.203690:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+13:8412:x1874741493255296:12345-0@lo:101: 00010000:00010000:0.0:1787892941.203702:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787892941.203715:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0982 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf097b expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892941.203736:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0982 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf097b expref: 14 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892941.203769:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0982 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf097b expref: 14 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892941.203787:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb30c00, rc 0) 00000100:00100000:0.0:1787892941.203826:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+14:8412:x1874741493255296:12345-0@lo:101: Request processed in 137us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892941.203832:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787892941.203976:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f72d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:8412:1874741493255296:0@lo:101: 00010000:00010000:3.0:1787892941.203989:0:8412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69de00/0x9232577658cf097b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x9232577658cf0982 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892941.203998:0:8412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69de00/0x9232577658cf097b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9232577658cf0982 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892941.204087:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed563480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:8412:1874741493255424:0@lo:501: 00000100:00100000:3.0:1787892941.204114:0:8412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892941.204142:0:8412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fd0803c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787892941.204890:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493255424 00000100:00100000:0.0:1787892941.204898:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493255424 00000100:00100000:0.0:1787892941.204936:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787892941.204944:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+14:8412:x1874741493255424:12345-0@lo:501: 00000100:00100000:0.0:1787892941.205022:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+14:8412:x1874741493255424:12345-0@lo:501: Request processed in 79us (907us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787892941.205030:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787892941.205860:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed563480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:8412:1874741493255424:0@lo:501: 10000000:01000000:2.0:1787892941.205881:0:8412:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.135@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787892941.205910:0:8412:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.135@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787892941.205916:0:8412:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69de00/0x9232577658cf097b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9232577658cf0982 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892941.205925:0:8412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69de00/0x9232577658cf097b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9232577658cf0982 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892941.205931:0:8412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69de00/0x9232577658cf097b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9232577658cf0982 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892941.205972:0:8412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787892941.206000:0:8412:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fc9fe136000 10000000:01000000:2.0:1787892941.206004:0:8412:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787892941.206010:0:8412:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787892941.206012:0:8412:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787892941.206017:0:8412:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787892941.206019:0:8412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787892941.206046:0:8412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729200/0x9232577658cf0989 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892941.206054:0:8412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729200/0x9232577658cf0989 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892941.206064:0:8412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729200/0x9232577658cf0989 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892941.206080:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d29faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:8412:1874741493255552:0@lo:101: 00000100:00100000:2.0:1787892941.206120:0:8412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892941.206156:0:8412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c4d87a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787892941.206202:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493255552 00000100:00100000:0.0:1787892941.206208:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493255552 00010000:00010000:1.0:1787892941.206223:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787892941.206229:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69de00/0x9232577658cf097b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9232577658cf0982 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.206237:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd69de00 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:1.0:1787892941.206240:0:6493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69de00/0x9232577658cf097b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9232577658cf0982 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892941.206244:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00010000:00010000:1.0:1787892941.206250:0:6493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69de00/0x9232577658cf097b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x9232577658cf0982 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892941.206252:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+14:8412:x1874741493255552:12345-0@lo:101: 00010000:00010000:0.0:1787892941.206261:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 10000000:00010000:1.0:1787892941.206267:0:6493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69de00/0x9232577658cf097b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x9232577658cf0982 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892941.206272:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9edb31600/0x9232577658cf0990 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0989 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787892941.206273:0:6493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787892941.206289:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9edb31600/0x9232577658cf0990 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0989 expref: 15 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.206290:0:6493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69de00/0x9232577658cf097b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9232577658cf0982 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.206296:0:6493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787892941.206298:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9edb31600/0x9232577658cf0990 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0989 expref: 15 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892941.206315:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb31600, rc 0) 00010000:00010000:1.0:1787892941.206323:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69de00/0x9232577658cf097b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9232577658cf0982 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.206330:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69de00/0x9232577658cf097b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9232577658cf0982 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.206343:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892941.206345:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892941.206346:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787892941.206348:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+15:8412:x1874741493255552:12345-0@lo:101: Request processed in 97us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892941.206353:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787892941.206353:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787892941.206372:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493255680:0@lo:103: 00000100:00100000:0.0:1787892941.206385:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d29faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:8412:1874741493255552:0@lo:101: 00010000:00010000:0.0:1787892941.206396:0:8412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729200/0x9232577658cf0989 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0990 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892941.206404:0:8412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729200/0x9232577658cf0989 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0990 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892941.206409:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892941.206436:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493255680 00000100:00100000:1.0:1787892941.206439:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493255680 00000100:00100000:1.0:1787892941.206467:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787892941.206473:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:8412:1874741493255808:0@lo:501: 00000100:00100000:1.0:1787892941.206474:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ad7764-cf95-4087-88aa-57e4229a8397+15:3630:x1874741493255680:12345-0@lo:103: 00010000:00010000:1.0:1787892941.206482:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787892941.206518:0:8412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787892941.206521:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0982 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9232577658cf097b expref: 15 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.206531:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787892941.206536:0:8412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c5c9f180 going to sleep for 11 seconds 00000100:00100000:1.0:1787892941.206562:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ad7764-cf95-4087-88aa-57e4229a8397+14:3630:x1874741493255680:12345-0@lo:103: Request processed in 88us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892941.206568:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787892941.206577:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493255680:0@lo:103: 00000100:00100000:1.0:1787892941.206595:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493255808 00000100:00100000:1.0:1787892941.206599:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493255808 00000100:00100000:1.0:1787892941.206626:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787892941.206632:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+14:8412:x1874741493255808:12345-0@lo:501: 00000100:00100000:1.0:1787892941.206723:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+14:8412:x1874741493255808:12345-0@lo:501: Request processed in 91us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892941.206729:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787892941.206788:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:8412:1874741493255808:0@lo:501: 00000100:00100000:0.0:1787892941.206811:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:8412:1874741493255936:0@lo:503: 00000100:00100000:0.0:1787892941.206849:0:8412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892941.206872:0:8412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c5c9f180 going to sleep for 11 seconds 00000100:00100000:0.0:1787892941.206885:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493255936 00000100:00100000:0.0:1787892941.206888:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493255936 00000100:00100000:0.0:1787892941.206915:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787892941.206921:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+14:8412:x1874741493255936:12345-0@lo:503: 00000100:00100000:0.0:1787892941.206994:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+14:8412:x1874741493255936:12345-0@lo:503: Request processed in 73us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892941.207006:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787892941.207040:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:8412:1874741493255936:0@lo:503: 00000040:00080000:0.0:1787892941.207249:0:8412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787892941.207308:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:8412:1874741493256064:0@lo:502: 00000100:00100000:0.0:1787892941.207346:0:8412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892941.207369:0:8412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c5c9f180 going to sleep for 11 seconds 00000100:00100000:3.0:1787892941.207420:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493256064 00000100:00100000:3.0:1787892941.207425:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493256064 00000100:00100000:3.0:1787892941.207460:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787892941.207467:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+14:8412:x1874741493256064:12345-0@lo:502: 00000100:00100000:3.0:1787892941.207571:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+14:8412:x1874741493256064:12345-0@lo:502: Request processed in 104us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892941.207577:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787892941.207595:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:8412:1874741493256064:0@lo:502: 00000040:00080000:2.0:1787892941.207785:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787892941.207810:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787892941.207825:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787892941.207839:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787892941.207854:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787892941.207868:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787892941.207888:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d29f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:8412:1874741493256192:0@lo:502: 00000100:00100000:2.0:1787892941.207929:0:8412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892941.207968:0:8412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c4d87840 going to sleep for 11 seconds 00000100:00100000:1.0:1787892941.208013:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493256192 00000100:00100000:1.0:1787892941.208018:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493256192 00000100:00100000:1.0:1787892941.208049:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787892941.208056:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+14:8412:x1874741493256192:12345-0@lo:502: 00000100:00100000:1.0:1787892941.208128:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+14:8412:x1874741493256192:12345-0@lo:502: Request processed in 72us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892941.208134:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787892941.208201:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d29f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:8412:1874741493256192:0@lo:502: 00000040:00080000:2.0:1787892941.208241:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787892941.208248:0:8412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1787892941.208820:0:8436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787892941.208828:0:8436:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1787892941.208835:0:8436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787892941.208837:0:8436:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787892941.208843:0:8436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787892941.208858:0:8436:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9fc9c2f399b8) 00000020:00000080:1.0:1787892941.208889:0:8436:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787892941.208895:0:8436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787892941.208963:0:8436:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc9fe136000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787892941.208970:0:8436:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787892941.208976:0:8436:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9232577658cf099e 00010000:00010000:0.0:1787892941.213751:0:8436:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:0.0:1787892941.214294:0:8436:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1787892941.220626:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1787892941.221415:0:8436:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1787892941.231633:0:8436:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1787892941.233034:0:8436:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1787892941.247669:0:8436:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1787892941.253966:0:8436:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787892941.253984:0:8436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787892941.253990:0:8436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787892941.253991:0:8436:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787892941.253994:0:8436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787892941.253998:0:8436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787892941.253999:0:8436:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787892941.254002:0:8436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787892941.254004:0:8436:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787892941.254027:0:8436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787892941.254029:0:8436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787892941.254031:0:8436:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787892941.254034:0:8436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787892941.256021:0:8412:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1787892941.256067:0:8412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787892941.256094:0:8412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729200/0x9232577658cf0989 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0990 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892941.256107:0:8412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729200/0x9232577658cf0989 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0990 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787892941.256115:0:8412:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc9fe136000 from 1 10000000:01000000:0.0:1787892941.256117:0:8412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787892941.256151:0:8412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31a00/0x9232577658cf09a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892941.256159:0:8412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31a00/0x9232577658cf09a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892941.256181:0:8412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31a00/0x9232577658cf09a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892941.256203:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:8412:1874741493256320:0@lo:101: 00000100:00100000:0.0:1787892941.256280:0:8412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892941.256321:0:8412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c5c9f600 going to sleep for 11 seconds 00000100:00100000:0.0:1787892941.256353:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493256320 00000100:00100000:0.0:1787892941.256373:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493256320 00000100:00100000:0.0:1787892941.256412:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787892941.256421:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+14:8412:x1874741493256320:12345-0@lo:101: 00010000:00010000:0.0:1787892941.256434:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787892941.256445:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9edb31e00/0x9232577658cf09ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf09a5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892941.256465:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9edb31e00/0x9232577658cf09ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf09a5 expref: 15 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892941.256475:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9edb31e00/0x9232577658cf09ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf09a5 expref: 15 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892941.256483:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb31e00, rc 0) 00000100:00100000:0.0:1787892941.256536:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+15:8412:x1874741493256320:12345-0@lo:101: Request processed in 116us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892941.256543:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787892941.256590:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:8412:1874741493256320:0@lo:101: 00010000:00010000:0.0:1787892941.256603:0:8412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31a00/0x9232577658cf09a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf09ac expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892941.256637:0:8412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31a00/0x9232577658cf09a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf09ac expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892941.256717:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:8412:1874741493256448:0@lo:501: 00000100:00100000:0.0:1787892941.256756:0:8412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892941.256770:0:8412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c5c9f600 going to sleep for 11 seconds 00000100:00100000:1.0:1787892941.257882:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493256448 00000100:00100000:1.0:1787892941.257891:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493256448 00000100:00100000:1.0:1787892941.257923:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787892941.257932:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+15:8412:x1874741493256448:12345-0@lo:501: 00000100:00100000:1.0:1787892941.258062:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+15:8412:x1874741493256448:12345-0@lo:501: Request processed in 130us (1305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892941.258068:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787892941.258162:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:8412:1874741493256448:0@lo:501: 00000100:00100000:3.0:1787892941.258198:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed561500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:8412:1874741493256576:0@lo:503: 00000100:00100000:3.0:1787892941.258246:0:8412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892941.258313:0:8412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fd0800c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787892941.266992:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493256576 00000100:00100000:1.0:1787892941.267006:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493256576 00000100:00100000:1.0:1787892941.267050:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787892941.267057:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+15:8412:x1874741493256576:12345-0@lo:503: 00000100:00100000:1.0:1787892941.268172:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+15:8412:x1874741493256576:12345-0@lo:503: Request processed in 1111us (9921us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892941.268183:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787892941.271199:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed561500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:8412:1874741493256576:0@lo:503: 00000040:00080000:3.0:1787892941.271484:0:8412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787892941.271588:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed561500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:8412:1874741493256704:0@lo:502: 00000100:00100000:3.0:1787892941.271654:0:8412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892941.271692:0:8412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fd0800c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787892941.272276:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493256704 00000100:00100000:0.0:1787892941.272285:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493256704 00000100:00100000:2.0:1787892941.272721:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787892941.272733:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+15:8412:x1874741493256704:12345-0@lo:502: 00000100:00100000:2.0:1787892941.272876:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+15:8412:x1874741493256704:12345-0@lo:502: Request processed in 145us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892941.272884:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787892941.272978:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed561500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:8412:1874741493256704:0@lo:502: 00000040:00080000:0.0:1787892941.273185:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787892941.273240:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787892941.273269:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:8412:1874741493256832:0@lo:502: 00000100:00100000:0.0:1787892941.273307:0:8412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892941.273347:0:8412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c5c9fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787892941.273446:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493256832 00000100:00100000:2.0:1787892941.273452:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493256832 00000100:00100000:2.0:1787892941.273514:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787892941.273523:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+15:8412:x1874741493256832:12345-0@lo:502: 00000100:00100000:2.0:1787892941.273588:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+15:8412:x1874741493256832:12345-0@lo:502: Request processed in 66us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892941.273595:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787892941.273831:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:8412:1874741493256832:0@lo:502: 00000040:00080000:0.0:1787892941.273869:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787892941.273877:0:8412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787892941.274336:0:8440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787892941.274345:0:8440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787892941.274348:0:8440:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787892941.274354:0:8440:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc9fe136000 00000020:00000080:0.0:1787892941.274433:0:8440:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787892941.274449:0:8440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787892941.274452:0:8440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787892941.274454:0:8440:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787892941.274457:0:8440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1787892941.274592:0:8412:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787892941.274617:0:8412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787892941.274640:0:8412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31a00/0x9232577658cf09a5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf09ac expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.274664:0:8412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31a00/0x9232577658cf09a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf09ac expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787892941.274716:0:8412:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787892941.274718:0:8412:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fc9fe136000 10000000:01000000:1.0:1787892941.274722:0:8412:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fc9fe136000 10000000:01000000:1.0:1787892941.274726:0:8412:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787892941.274731:0:8412:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc9fe136000 from 1 10000000:01000000:1.0:1787892941.274734:0:8412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787892941.274771:0:8412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69de00/0x9232577658cf09b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.274779:0:8412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69de00/0x9232577658cf09b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.274788:0:8412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69de00/0x9232577658cf09b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892941.274804:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f71500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:8412:1874741493256960:0@lo:101: 00000100:00100000:1.0:1787892941.274846:0:8412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892941.274875:0:8412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e5e5b840 going to sleep for 11 seconds 00000100:00100000:1.0:1787892941.274892:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493256960 00000100:00100000:1.0:1787892941.274897:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493256960 00000100:00100000:1.0:1787892941.274926:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787892941.274934:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+15:8412:x1874741493256960:12345-0@lo:101: 00010000:00010000:1.0:1787892941.274945:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787892941.274957:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9dd69d800/0x9232577658cf09ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf09b3 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.274989:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9dd69d800/0x9232577658cf09ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf09b3 expref: 16 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.274999:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9dd69d800/0x9232577658cf09ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf09b3 expref: 16 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.275008:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9dd69d800, rc 0) 00000100:00100000:1.0:1787892941.275040:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+16:8412:x1874741493256960:12345-0@lo:101: Request processed in 107us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892941.275046:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787892941.275084:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f71500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:8412:1874741493256960:0@lo:101: 00010000:00010000:1.0:1787892941.275096:0:8412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69de00/0x9232577658cf09b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf09ba expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892941.275104:0:8412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69de00/0x9232577658cf09b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf09ba expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892941.275168:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f71500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:8412:1874741493257088:0@lo:501: 00000100:00100000:1.0:1787892941.275201:0:8412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892941.275607:0:8412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e5e5b840 going to sleep for 11 seconds 00000100:00100000:0.0:1787892941.280889:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493257088 00000100:00100000:0.0:1787892941.280921:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493257088 00000100:00100000:0.0:1787892941.280969:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787892941.280977:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+16:8412:x1874741493257088:12345-0@lo:501: 00000100:00100000:0.0:1787892941.281158:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+16:8412:x1874741493257088:12345-0@lo:501: Request processed in 180us (5955us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892941.281165:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787892941.284087:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f71500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:8412:1874741493257088:0@lo:501: 00000100:00100000:2.0:1787892941.284147:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d29f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:8412:1874741493257216:0@lo:503: 00000100:00100000:2.0:1787892941.284225:0:8412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892941.284243:0:8412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c4d87a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787892941.284373:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493257216 00000100:00100000:1.0:1787892941.284380:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493257216 00000100:00100000:1.0:1787892941.284445:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787892941.284454:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+16:8412:x1874741493257216:12345-0@lo:503: 00000100:00100000:1.0:1787892941.284584:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+16:8412:x1874741493257216:12345-0@lo:503: Request processed in 130us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892941.284593:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787892941.284632:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d29f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:8412:1874741493257216:0@lo:503: 00000040:00080000:3.0:1787892941.284959:0:8412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787892941.285012:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed563800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:8412:1874741493257344:0@lo:502: 00000100:00100000:3.0:1787892941.285177:0:8412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892941.285290:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493257344 00000100:00100000:1.0:1787892941.285295:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493257344 00000100:00100000:3.0:1787892941.285333:0:8412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fd080cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787892941.285363:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787892941.285371:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+16:8412:x1874741493257344:12345-0@lo:502: 00000100:00100000:1.0:1787892941.285452:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+16:8412:x1874741493257344:12345-0@lo:502: Request processed in 82us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892941.285459:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787892941.285556:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed563800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:8412:1874741493257344:0@lo:502: 00000040:00080000:3.0:1787892941.285719:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787892941.285754:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787892941.285794:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787892941.285809:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787892941.285816:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787892941.285823:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787892941.285830:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787892941.285836:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787892941.285843:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787892941.285850:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787892941.285860:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787892941.285874:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787892941.285886:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787892941.285899:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787892941.285912:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787892941.285932:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787892941.285939:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787892941.285945:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787892941.285960:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787892941.285968:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787892941.285974:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787892941.285981:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787892941.285988:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787892941.285995:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787892941.286002:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1787892941.286013:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1787892941.286025:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1787892941.286053:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1787892941.286069:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1787892941.286084:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1787892941.286098:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1787892941.286109:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1787892941.286121:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1787892941.286133:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1787892941.286159:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1787892941.286173:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1787892941.286203:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:3.0:1787892941.286229:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed563800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:8412:1874741493257472:0@lo:502: 00000100:00100000:3.0:1787892941.286715:0:8412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892941.292561:0:8412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fd080cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787892941.294309:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493257472 00000100:00100000:2.0:1787892941.294322:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493257472 00000100:00100000:2.0:1787892941.294451:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787892941.294462:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+16:8412:x1874741493257472:12345-0@lo:502: 00000100:00100000:2.0:1787892941.294659:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+16:8412:x1874741493257472:12345-0@lo:502: Request processed in 198us (7944us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892941.294676:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787892941.295917:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed563800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:8412:1874741493257472:0@lo:502: 00000040:00080000:3.0:1787892941.296011:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1787892941.296025:0:8412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1787892941.296833:0:8441:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787892941.296847:0:8441:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9fc9fe140000) 00000020:00000080:3.0:1787892941.296867:0:8441:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1787892941.296959:0:8441:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc9fe136000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787892941.296963:0:8441:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc9fe136000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787892941.296965:0:8441:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc9fe136000 3 00010000:00080000:3.0:1787892941.296991:0:8441:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc9fe097800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.135@tcp at head 00010000:00010000:2.0:1787892941.303664:0:8441:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:2.0:1787892941.303866:0:8441:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787892941.303920:0:8441:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787892941.303931:0:8441:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9232577658cf09c8 00000100:00080000:2.0:1787892941.303940:0:8441:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787892941.303945:0:8441:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9fc9fe097800 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:2.0:1787892941.303976:0:8441:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9d29f8700 x1874741493257600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787892941.304013:0:8441:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787892941.304139:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d29f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3629:1874741493257600:0@lo:38: 00000100:00100000:0.0:1787892941.304223:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892941.304820:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493257728:0@lo:400: 00000100:00100000:0.0:1787892941.304856:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892941.304882:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787892941.304889:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493257856:0@lo:400: 00000100:00100000:0.0:1787892941.304918:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892941.304955:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874741493257984:0@lo:400: 00000100:00100000:0.0:1787892941.304996:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892941.305019:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787892941.305024:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493258112:0@lo:400: 00000100:00100000:0.0:1787892941.305046:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892941.305086:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493257600 00000100:00100000:0.0:1787892941.305094:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493257600 00000100:00100000:0.0:1787892941.305119:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493257728 00000100:00100000:0.0:1787892941.305122:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493257728 00000100:00100000:0.0:1787892941.305144:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493257984 00000100:00100000:0.0:1787892941.305147:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493257984 00000100:00100000:0.0:1787892941.305166:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787892941.305177:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493257728:12345-0@lo:400: 00000100:00100000:0.0:1787892941.305229:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493257728:12345-0@lo:400: Request processed in 55us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892941.305246:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787892941.305263:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787892941.305270:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874741493257984:12345-0@lo:400: 00000100:00100000:0.0:1787892941.305309:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874741493257984:12345-0@lo:400: Request processed in 40us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892941.305315:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787892941.305328:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787892941.305333:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3629:x1874741493257600:12345-0@lo:38: 00010000:00080000:0.0:1787892941.305355:0:6506:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:0.0:1787892941.305385:0:6506:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9232577658cf09cf 00000004:00100000:0.0:1787892941.305400:0:6506:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787892941.305428:0:6506:0:(import.c:65:import_set_state_nolock()) ffff9fc9ffa81800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787892941.305472:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1874741493257600:12345-0@lo:38: Request processed in 136us (1249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892941.305479:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787892941.305520:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493257856 00000100:00100000:0.0:1787892941.305524:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493257856 00000100:00100000:0.0:1787892941.305551:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493258112 00000100:00100000:0.0:1787892941.305554:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493258112 00000100:00100000:0.0:1787892941.305571:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787892941.305578:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493257856:12345-0@lo:400: 00000100:00100000:0.0:1787892941.305616:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493257856:12345-0@lo:400: Request processed in 39us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892941.305622:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787892941.305635:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787892941.305642:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493258112:12345-0@lo:400: 00000100:00100000:0.0:1787892941.305681:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493258112:12345-0@lo:400: Request processed in 40us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892941.305687:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787892941.305733:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493258112:0@lo:400: 00010000:00080000:0.0:1787892941.305760:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc9c3e6fb80 x1874741493257984/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892941.305770:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874741493257984:0@lo:400: 00000100:00100000:0.0:1787892941.305800:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493257856:0@lo:400: 00010000:00080000:0.0:1787892941.305813:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc9c3e6ed80 x1874741493257728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892941.305823:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493257728:0@lo:400: 00010000:00080000:0.0:1787892941.305846:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc9d29f8700 x1874741493257600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787892951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892941.305855:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787892941.305862:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1787892941.305868:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787892941.305873:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787892941.305875:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9fe097800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787892941.305880:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d29f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3629:1874741493257600:0@lo:38: 00000020:01000004:0.0:1787892941.309018:0:8441:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787892941.309036:0:8441:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9fc9ed578000) 00000020:00000080:0.0:1787892941.309059:0:8441:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:0.0:1787892941.309138:0:8441:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc9fe136000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787892941.309142:0:8441:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc9fe136000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787892941.309154:0:8441:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc9fe136000 3 00010000:00080000:0.0:1787892941.309182:0:8441:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc9ffa86000@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.135@tcp at head 00010000:00010000:0.0:1787892941.314432:0:8441:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:0.0:1787892941.314611:0:8441:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1787892941.314645:0:8441:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787892941.314654:0:8441:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x9232577658cf09dd 00000100:00080000:0.0:1787892941.314662:0:8441:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787892941.314667:0:8441:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9fc9ffa86000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:0.0:1787892941.314694:0:8441:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c64b4380 x1874741493258240/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787892941.314710:0:8441:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1787892941.314861:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3629:1874741493258240:0@lo:38: 00000100:00100000:0.0:1787892941.314932:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892941.314979:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493258240 00000100:00100000:0.0:1787892941.314985:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493258240 00000100:00100000:0.0:1787892941.315007:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787892941.315012:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3629:x1874741493258240:12345-0@lo:38: 00010000:00080000:0.0:1787892941.315031:0:6506:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:0.0:1787892941.315076:0:6506:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x9232577658cf09e4 00000004:00100000:0.0:1787892941.315092:0:6506:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787892941.315122:0:6506:0:(import.c:65:import_set_state_nolock()) ffff9fc9fd0b2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787892941.315173:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1874741493258240:12345-0@lo:38: Request processed in 158us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892941.315181:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787892941.315218:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc8c64b4380 x1874741493258240/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787892951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892941.315228:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787892941.315244:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1787892941.315250:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787892941.315254:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787892941.315256:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9ffa86000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787892941.315263:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3629:1874741493258240:0@lo:38: 00000040:00080000:0.0:1787892941.315348:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1787892941.316576:0:8412:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1787892941.316616:0:8412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787892941.316637:0:8412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69de00/0x9232577658cf09b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf09ba expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892941.316649:0:8412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69de00/0x9232577658cf09b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf09ba expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787892941.316698:0:8412:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787892941.316701:0:8412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787892941.316702:0:8412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787892941.316703:0:8412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787892941.316704:0:8412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787892941.316705:0:8412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787892941.316707:0:8412:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787892941.316708:0:8412:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787892941.316710:0:8412:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787892941.316711:0:8412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787892941.316712:0:8412:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787892941.316716:0:8412:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1787892941.316718:0:8412:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787892941.316719:0:8412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787892941.316721:0:8412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787892941.316721:0:8412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787892941.316723:0:8412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787892941.316724:0:8412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787892941.316724:0:8412:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787892941.316726:0:8412:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787892941.316727:0:8412:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787892941.316728:0:8412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787892941.316729:0:8412:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787892941.316762:0:8412:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787892941.316777:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed563800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:8412:1874741493258368:0@lo:253: 00000100:00100000:3.0:1787892941.316836:0:8412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892941.316869:0:8412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fd080840 going to sleep for 11 seconds 00000100:00100000:3.0:1787892941.316893:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493258368 00000100:00100000:3.0:1787892941.316898:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493258368 00000100:00100000:3.0:1787892941.316944:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787892941.316954:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+16:8412:x1874741493258368:12345-0@lo:253: 20000000:01000000:3.0:1787892941.316977:0:6499:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787892941.316991:0:6499:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787892941.334853:0:6499:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787892941.334990:0:6499:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787892941.335368:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+16:8412:x1874741493258368:12345-0@lo:253: Request processed in 18402us (18518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892941.335380:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787892941.335483:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed563800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:8412:1874741493258368:0@lo:253: 10000000:01000000:0.0:1787892941.335521:0:8412:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787892941.335525:0:8412:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787892941.335527:0:8412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787892941.335528:0:8412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787892941.335529:0:8412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787892941.335530:0:8412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787892941.335532:0:8412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787892941.335533:0:8412:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787892941.335535:0:8412:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787892941.335536:0:8412:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787892941.335538:0:8412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787892941.335540:0:8412:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787892941.335552:0:8412:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1787892941.336368:0:6520:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787892941.336376:0:6520:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787892941.336397:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fc9c147d200/0x9232577658cf09eb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892941.336413:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9edb30800/0x9232577658cf08e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf08da expref: 15 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892941.336421:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9dd728c00/0x9232577658cf08fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf08f6 expref: 15 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892941.336429:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fc9c147d200/0x9232577658cf09eb lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892941.336565:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9dd728c00/0x9232577658cf08fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf08f6 expref: 15 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892941.336580:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc9dd728c00/0x9232577658cf08fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf08f6 expref: 15 pid: 6497 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892941.336594:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed560700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6520:1874741493258496:0@lo:104: 00000100:00100000:3.0:1787892941.336891:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787892941.336959:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9edb30800/0x9232577658cf08e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf08da expref: 15 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892941.336965:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1787892941.336970:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc9edb30800/0x9232577658cf08e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf08da expref: 15 pid: 6497 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892941.336981:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed561880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6520:1874741493258624:0@lo:104: 00000100:00100000:2.0:1787892941.336985:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493258496 00000100:00100000:2.0:1787892941.336993:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493258496 00000100:00100000:3.0:1787892941.337009:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892941.337038:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493258624 00000100:00100000:3.0:1787892941.337040:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fd080300 going to sleep for 11 seconds 00000100:00100000:2.0:1787892941.337042:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493258624 00000100:00100000:2.0:1787892941.337061:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787892941.337069:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe12e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+4:6520:x1874741493258496:12345-0@lo:104: 00010000:00010000:2.0:1787892941.337093:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c000/0x9232577658cf08f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf08fd expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892941.337156:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787892941.337162:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe12e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+4:6520:x1874741493258496:12345-0@lo:104: Request processed in 94us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892941.337174:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787892941.337200:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787892941.337203:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ed563b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+3:6520:x1874741493258624:12345-0@lo:104: 00010000:00010000:2.0:1787892941.337217:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf08da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf08e1 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892941.337251:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787892941.337257:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ed563b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+3:6520:x1874741493258624:12345-0@lo:104: Request processed in 52us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892941.337262:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1787892941.337288:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787892941.337293:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c000/0x9232577658cf08f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf08fd expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892941.337298:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c147c000 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:2.0:1787892941.337301:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c000/0x9232577658cf08f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf08fd expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892941.337308:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c000/0x9232577658cf08f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf08fd expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787892941.337313:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c000/0x9232577658cf08f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf08fd expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892941.337316:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787892941.337337:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c000/0x9232577658cf08f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf08fd expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892941.337342:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787892941.337369:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c000/0x9232577658cf08f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf08fd expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892941.337374:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c000/0x9232577658cf08f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf08fd expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892941.337382:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787892941.337384:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf08da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf08e1 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892941.337390:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c147d000 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:2.0:1787892941.337393:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf08da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf08e1 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892941.337399:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf08da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf08e1 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787892941.337404:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf08da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf08e1 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892941.337409:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787892941.337423:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf08da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf08e1 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892941.337428:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787892941.337433:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf08da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf08e1 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892941.337440:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf08da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf08e1 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892941.337452:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892941.337457:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892941.337458:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892941.337463:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787892941.339480:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed560700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6520:1874741493258496:0@lo:104: 00000100:00100000:3.0:1787892941.339524:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed561880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6520:1874741493258624:0@lo:104: 00010000:00010000:3.0:1787892941.339563:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fc9c147d200/0x9232577658cf09eb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892941.340040:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d29fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493258752:0@lo:103: 00000100:00100000:1.0:1787892941.340123:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892941.340178:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787892941.340185:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d29faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493258880:0@lo:103: 00000100:00100000:1.0:1787892941.340213:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892941.340294:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493258752 00000100:00100000:2.0:1787892941.340302:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493258752 00010000:00010000:2.0:1787892941.340336:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9dd728c00/0x9232577658cf08fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf08f6 expref: 16 pid: 6497 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892941.340368:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493258880 00000100:00100000:2.0:1787892941.340371:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493258880 00010000:00010000:2.0:1787892941.340394:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9edb30800/0x9232577658cf08e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf08da expref: 17 pid: 6497 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892941.340409:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787892941.340417:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ad7764-cf95-4087-88aa-57e4229a8397+17:3632:x1874741493258752:12345-0@lo:103: 00010000:00010000:2.0:1787892941.340429:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787892941.340434:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9dd728c00/0x9232577658cf08fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf08f6 expref: 17 pid: 6497 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892941.340445:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9dd728c00/0x9232577658cf08fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf08f6 expref: 17 pid: 6497 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892941.340462:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9dd728c00/0x9232577658cf08fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf08f6 expref: 17 pid: 6497 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892941.340478:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787892941.340532:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ad7764-cf95-4087-88aa-57e4229a8397+16:3632:x1874741493258752:12345-0@lo:103: Request processed in 116us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892941.340540:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787892941.340556:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787892941.340562:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ad7764-cf95-4087-88aa-57e4229a8397+15:3632:x1874741493258880:12345-0@lo:103: 00010000:00010000:2.0:1787892941.340582:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787892941.340587:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9edb30800/0x9232577658cf08e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf08da expref: 15 pid: 6497 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892941.340596:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9edb30800/0x9232577658cf08e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf08da expref: 15 pid: 6497 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892941.340605:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9edb30800/0x9232577658cf08e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf08da expref: 15 pid: 6497 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892941.340615:0:6492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fc9c147d200/0x9232577658cf09eb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892941.340622:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9c147d200/0x9232577658cf09eb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787892941.340636:0:6492:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004261666s 00010000:00010000:2.0:1787892941.340641:0:6492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc9c147d200/0x9232577658cf09eb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892941.340648:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc9c147d200/0x9232577658cf09eb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892941.340655:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fc9c147d200/0x9232577658cf09eb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892941.340661:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fc9c147d200/0x9232577658cf09eb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892941.340667:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c147d200 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787892941.340671:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fc9c147d200/0x9232577658cf09eb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892941.340687:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fc9c147d200/0x9232577658cf09eb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892941.340700:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fc9c147d200/0x9232577658cf09eb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892941.340709:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787892941.340734:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ad7764-cf95-4087-88aa-57e4229a8397+14:3632:x1874741493258880:12345-0@lo:103: Request processed in 172us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892941.340752:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787892941.340815:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d29faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493258880:0@lo:103: 00000100:00100000:1.0:1787892941.340823:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d29fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493258752:0@lo:103: 00010000:00010000:3.0:1787892941.342044:0:6520:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fc9c147d200/0x9232577658cf09eb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892941.342059:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fc9c147d200/0x9232577658cf09eb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892941.342067:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9c147d200/0x9232577658cf09eb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1787892941.352653:0:8412:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1787892941.352828:0:8412:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1787892941.353025:0:8412:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1787892941.353198:0:8412:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1787892941.353398:0:8412:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1787892941.353660:0:8412:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1787892941.355878:0:8412:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1787892941.377808:0:8412:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787892941.377818:0:8412:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787892941.377861:0:8412:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787892941.377902:0:8412:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.135@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787892941.377920:0:8412:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787892941.377938:0:8412:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1787892941.392882:0:8412:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787892941.396205:0:8412:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1787892941.506215:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892942.514956:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787892942.525786:0:8497:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787892942.526389:0:8497:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1787892943.025744:0:6502:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787892943.025751:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc9ed573800 from 30 10000000:01000000:1.0:1787892943.025756:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787892943.025802:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69c800/0x9232577658cf09f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892943.025825:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69c800/0x9232577658cf09f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892943.025836:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69c800/0x9232577658cf09f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892943.025865:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493259008:0@lo:101: 00000100:00100000:1.0:1787892943.025928:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892943.025986:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d0e1fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787892943.026651:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493259008 00000100:00100000:3.0:1787892943.026661:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493259008 00000100:00100000:3.0:1787892943.026706:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787892943.026715:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+14:6502:x1874741493259008:12345-0@lo:101: 00010000:00010000:3.0:1787892943.026739:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787892943.026758:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9c147d200/0x9232577658cf09f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf09f2 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892943.026781:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9c147d200/0x9232577658cf09f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf09f2 expref: 15 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892943.026793:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9c147d200/0x9232577658cf09f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf09f2 expref: 15 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892943.026802:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9c147d200, rc 0) 00000100:00100000:3.0:1787892943.026843:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+15:6502:x1874741493259008:12345-0@lo:101: Request processed in 129us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892943.026850:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787892943.028719:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493259008:0@lo:101: 00010000:00010000:1.0:1787892943.028755:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69c800/0x9232577658cf09f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf09f9 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892943.028767:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69c800/0x9232577658cf09f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf09f9 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892943.028853:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493259136:0@lo:501: 00000100:00100000:1.0:1787892943.028907:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892943.028953:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d0e1fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787892943.029010:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493259136 00000100:00100000:3.0:1787892943.029017:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493259136 00000100:00100000:3.0:1787892943.029061:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787892943.029070:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+15:6502:x1874741493259136:12345-0@lo:501: 00000100:00100000:3.0:1787892943.029189:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+15:6502:x1874741493259136:12345-0@lo:501: Request processed in 120us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892943.029196:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787892943.029270:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493259136:0@lo:501: 00000100:00100000:1.0:1787892943.029295:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493259264:0@lo:503: 00000100:00100000:1.0:1787892943.029335:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892943.029359:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d0e1fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787892943.029373:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493259264 00000100:00100000:1.0:1787892943.029376:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493259264 00000100:00100000:1.0:1787892943.029400:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787892943.029413:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+15:6502:x1874741493259264:12345-0@lo:503: 00000100:00100000:1.0:1787892943.029485:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+15:6502:x1874741493259264:12345-0@lo:503: Request processed in 73us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892943.029517:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787892943.029556:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493259264:0@lo:503: 00000100:00100000:1.0:1787892943.029752:0:8524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:8524:1874741493259392:0@lo:502: 00000100:00100000:1.0:1787892943.029787:0:8524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892943.029805:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493259392 00000100:00100000:1.0:1787892943.029809:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493259392 00000100:00100000:1.0:1787892943.029829:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787892943.029834:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+15:8524:x1874741493259392:12345-0@lo:502: 00000100:00100000:1.0:1787892943.029900:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+15:8524:x1874741493259392:12345-0@lo:502: Request processed in 65us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892943.029907:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787892943.029935:0:8524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d0e1f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787892943.029947:0:8524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:8524:1874741493259392:0@lo:502: 00000100:00100000:1.0:1787892943.029984:0:8524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:8524:1874741493259520:0@lo:502: 00000100:00100000:1.0:1787892943.030019:0:8524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892943.030036:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493259520 00000100:00100000:1.0:1787892943.030039:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493259520 00000100:00100000:1.0:1787892943.030059:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787892943.030065:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+15:8524:x1874741493259520:12345-0@lo:502: 00000100:00100000:1.0:1787892943.030121:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+15:8524:x1874741493259520:12345-0@lo:502: Request processed in 55us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892943.030126:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787892943.030160:0:8524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c4b17480 going to sleep for 11 seconds 00000100:00100000:1.0:1787892943.030172:0:8524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:8524:1874741493259520:0@lo:502: 00000040:00080000:1.0:1787892943.030189:0:8524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787892943.030236:0:6502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787892943.030258:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787892943.030265:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69c800/0x9232577658cf09f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf09f9 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892943.030281:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69c800/0x9232577658cf09f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf09f9 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787892943.030291:0:6502:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787892943.030293:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc9ed573800 from 5 10000000:01000000:0.0:1787892943.030296:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787892943.030321:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf0a00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892943.030329:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf0a00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892943.030338:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf0a00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892943.030349:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493259648:0@lo:101: 00000100:00100000:0.0:1787892943.030376:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892943.030404:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d1d1d900 going to sleep for 11 seconds 00000100:00100000:1.0:1787892943.030807:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493259648 00000100:00100000:1.0:1787892943.030813:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493259648 00000100:00100000:1.0:1787892943.030845:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787892943.030851:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+15:6502:x1874741493259648:12345-0@lo:101: 00010000:00010000:1.0:1787892943.030861:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787892943.030873:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9dd69ce00/0x9232577658cf0a07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0a00 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892943.030891:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9dd69ce00/0x9232577658cf0a07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0a00 expref: 16 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892943.030901:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9dd69ce00/0x9232577658cf0a07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0a00 expref: 16 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892943.030909:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9dd69ce00, rc 0) 00000100:00100000:1.0:1787892943.030987:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+16:6502:x1874741493259648:12345-0@lo:101: Request processed in 135us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892943.030993:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787892943.035940:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493259648:0@lo:101: 00010000:00010000:3.0:1787892943.035968:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf0a00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0a07 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892943.035980:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf0a00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0a07 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892943.036042:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed561880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493259776:0@lo:256: 00000100:00100000:3.0:1787892943.036104:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892943.036158:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fd080d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787892943.036472:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493259776 00000100:00100000:1.0:1787892943.036479:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493259776 00000100:00100000:1.0:1787892943.036550:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787892943.036559:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+16:6502:x1874741493259776:12345-0@lo:256: 20000000:01000000:1.0:1787892943.036577:0:6500:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787892943.036591:0:6500:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787892943.036593:0:6500:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1787892943.036676:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+16:6502:x1874741493259776:12345-0@lo:256: Request processed in 118us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892943.036689:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787892943.036739:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed561880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493259776:0@lo:256: 10000000:01000000:1.0:1787892943.036778:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787892943.036785:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf0a00 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0a07 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892943.036795:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf0a00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0a07 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787892943.036803:0:6502:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1787892943.036805:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:1.0:1787892943.036808:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1787892943.036844:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540a00/0x9232577658cf0a0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892943.036852:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540a00/0x9232577658cf0a0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892943.036862:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540a00/0x9232577658cf0a0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892943.036875:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493259904:0@lo:101: 00000100:00100000:1.0:1787892943.036901:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892943.036917:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9edf37900 going to sleep for 11 seconds 00000100:00100000:1.0:1787892943.036930:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493259904 00000100:00100000:1.0:1787892943.036934:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493259904 00000100:00100000:1.0:1787892943.036956:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787892943.036963:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+16:6502:x1874741493259904:12345-0@lo:101: 00010000:00010000:1.0:1787892943.036977:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787892943.036990:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9fe541200/0x9232577658cf0a15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0a0e expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892943.037007:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9fe541200/0x9232577658cf0a15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0a0e expref: 17 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892943.037016:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9fe541200/0x9232577658cf0a15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0a0e expref: 17 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892943.037026:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe541200, rc 0) 00000100:00100000:1.0:1787892943.037052:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+17:6502:x1874741493259904:12345-0@lo:101: Request processed in 90us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892943.037058:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787892943.037085:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493259904:0@lo:101: 00010000:00010000:1.0:1787892943.037096:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540a00/0x9232577658cf0a0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0a15 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892943.037104:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540a00/0x9232577658cf0a0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0a15 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892943.037151:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493260032:0@lo:501: 00000100:00100000:1.0:1787892943.037175:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892943.037187:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9edf37900 going to sleep for 11 seconds 00000100:00100000:1.0:1787892943.037198:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493260032 00000100:00100000:1.0:1787892943.037201:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493260032 00000100:00100000:1.0:1787892943.037220:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787892943.037226:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+17:6502:x1874741493260032:12345-0@lo:501: 00000100:00100000:1.0:1787892943.037338:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+17:6502:x1874741493260032:12345-0@lo:501: Request processed in 112us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892943.037344:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787892943.037372:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493260032:0@lo:501: 00000100:00100000:1.0:1787892943.037394:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493260160:0@lo:503: 00000100:00100000:1.0:1787892943.037430:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892943.037443:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9edf37900 going to sleep for 11 seconds 00000100:00100000:1.0:1787892943.037453:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493260160 00000100:00100000:1.0:1787892943.037457:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493260160 00000100:00100000:1.0:1787892943.037477:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787892943.037483:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+17:6502:x1874741493260160:12345-0@lo:503: 00000100:00100000:1.0:1787892943.037573:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+17:6502:x1874741493260160:12345-0@lo:503: Request processed in 90us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892943.037579:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787892943.037616:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493260160:0@lo:503: 00000100:00100000:1.0:1787892943.037785:0:8526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:8526:1874741493260288:0@lo:502: 00000100:00100000:1.0:1787892943.037816:0:8526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892943.037833:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493260288 00000100:00100000:1.0:1787892943.037836:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493260288 00000100:00100000:1.0:1787892943.037856:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787892943.037862:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+17:8526:x1874741493260288:12345-0@lo:502: 00000100:00100000:1.0:1787892943.037925:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+17:8526:x1874741493260288:12345-0@lo:502: Request processed in 62us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892943.037931:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787892943.037955:0:8526:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9edf379c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787892943.037970:0:8526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:8526:1874741493260288:0@lo:502: 00000020:01000000:1.0:1787892943.037988:0:8526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787892943.037994:0:8526:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1787892943.038000:0:8526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787892943.038002:0:8526:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787892943.038007:0:8526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787892943.038010:0:8526:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.135@tcp to nid 0x20000c0a8ca87 (192.168.202.135@tcp) 00000020:01000000:1.0:1787892943.038028:0:8526:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1787892943.038030:0:8526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787892943.038050:0:8526:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9fc9e7358000) 00000020:00000080:1.0:1787892943.038068:0:8526:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1787892943.038073:0:8526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787892943.038136:0:8526:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1787892943.038142:0:8526:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787892943.038148:0:8526:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9232577658cf0a23 00010000:00080000:1.0:1787892943.038171:0:8526:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc9fe303800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.135@tcp at head 00010000:00010000:1.0:1787892943.038359:0:8526:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1787892943.047332:0:8526:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787892943.047355:0:8526:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1787892943.047579:0:8526:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787892943.047813:0:8526:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787892943.047907:0:8526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1787892943.047996:0:8526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1787892943.049236:0:8528:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787892943.049242:0:8528:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787892943.050170:0:8526:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787892943.050183:0:8526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787892943.050221:0:8526:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787892943.050245:0:8526:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9232577658cf0a2a 00000100:00080000:3.0:1787892943.050255:0:8526:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787892943.050261:0:8526:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9fc9fe303800 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:3.0:1787892943.051038:0:8526:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9ed560700 x1874741493260416/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787892943.051112:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493260416:0@lo:8: 00000100:00100000:0.0:1787892943.051181:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892943.051283:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493260416 00000100:00100000:1.0:1787892943.051290:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493260416 00000100:00100000:1.0:1787892943.051331:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787892943.051338:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3629:x1874741493260416:12345-0@lo:8: 00010000:00080000:1.0:1787892943.051364:0:8419:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:1.0:1787892943.051399:0:8419:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9232577658cf0a31 00002000:00100000:1.0:1787892943.051430:0:8419:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9fc9fd158800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1787892943.051434:0:8419:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:1.0:1787892943.051438:0:8419:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1787892943.051516:0:8419:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787892943.051739:0:8419:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1787892943.051762:0:8419:0:(import.c:65:import_set_state_nolock()) ffff9fc9fd158000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1787892943.052034:0:8526:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787892943.052110:0:8526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787892943.052115:0:8526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787892943.052117:0:8526:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787892943.052120:0:8526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787892943.052123:0:8526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787892943.052124:0:8526:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787892943.052127:0:8526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787892943.052129:0:8526:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787892943.052151:0:8526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed561180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:8526:1874741493260544:0@lo:502: 00000100:00100000:3.0:1787892943.052194:0:8526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892943.052217:0:8526:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fd080240 going to sleep for 11 seconds 00000100:00100000:3.0:1787892943.052238:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787892943.052246:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d29f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493260800:0@lo:400: 00000100:00100000:2.0:1787892943.052273:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d29f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493261184:0@lo:400: 00000100:00100000:2.0:1787892943.052307:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892943.052328:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787892943.052333:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d29f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493261312:0@lo:400: 00000100:00100000:3.0:1787892943.052344:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892943.052356:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892943.052364:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d29f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1874741493260672:0@lo:400: 00000100:00100000:2.0:1787892943.052376:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d29f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493260928:0@lo:400: 00000100:00100000:3.0:1787892943.052384:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892943.052396:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892943.052405:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787892943.052410:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d29fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493261056:0@lo:400: 00000100:00100000:2.0:1787892943.052440:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892943.052481:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493261184 00000100:00100000:2.0:1787892943.052485:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493261184 00000100:00100000:3.0:1787892943.052518:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493260800 00000100:00100000:3.0:1787892943.052522:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493260800 00000100:00100000:2.0:1787892943.052541:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493261312 00000100:00100000:3.0:1787892943.052542:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493261056 00000100:00100000:2.0:1787892943.052543:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493261312 00000100:00100000:3.0:1787892943.052544:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493261056 00000100:00100000:2.0:1787892943.052554:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493260672 00000100:00100000:2.0:1787892943.052557:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493260672 00000100:00100000:3.0:1787892943.052563:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787892943.052565:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493260928 00000100:00100000:3.0:1787892943.052569:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ed561880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493260800:12345-0@lo:400: 00000100:00100000:2.0:1787892943.052571:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493260928 00000100:00100000:2.0:1787892943.052585:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787892943.052590:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493261184:12345-0@lo:400: 00000100:00100000:3.0:1787892943.052609:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ed561880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493260800:12345-0@lo:400: Request processed in 40us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892943.052616:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787892943.052618:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493261184:12345-0@lo:400: Request processed in 29us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892943.052623:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787892943.052629:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787892943.052632:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787892943.052634:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7200000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493261056:12345-0@lo:400: 00000100:00100000:2.0:1787892943.052636:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493261312:12345-0@lo:400: 00000100:00100000:2.0:1787892943.052659:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493261312:12345-0@lo:400: Request processed in 22us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892943.052660:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7200000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493261056:12345-0@lo:400: Request processed in 27us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892943.052664:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787892943.052666:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787892943.052674:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787892943.052679:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ed563800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1874741493260672:12345-0@lo:400: 00000100:00100000:2.0:1787892943.052704:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ed563800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1874741493260672:12345-0@lo:400: Request processed in 24us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892943.052708:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787892943.052709:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d29f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493260800:0@lo:400: 00000100:00100000:2.0:1787892943.052718:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1787892943.052721:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9d29f9500 x1874741493260672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892943.052736:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493260928:12345-0@lo:400: 00000100:00100000:3.0:1787892943.052741:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d29f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1874741493260672:0@lo:400: 00000100:00100000:2.0:1787892943.052761:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493260928:12345-0@lo:400: Request processed in 38us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892943.052767:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1787892943.052786:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787892943.052790:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787892943.052808:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9d29f9180 x1874741493261312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892943.052816:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d29f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493261312:0@lo:400: 00010000:00080000:2.0:1787892943.052837:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9d29f9880 x1874741493261184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892943.052844:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d29f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493261184:0@lo:400: 00000100:00100000:2.0:1787892943.052865:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d29fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493261056:0@lo:400: 00010000:00080000:2.0:1787892943.052872:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9d29f8e00 x1874741493260928/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892943.052878:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d29f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493260928:0@lo:400: 00000100:00100000:1.0:1787892943.053091:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3629:x1874741493260416:12345-0@lo:8: Request processed in 1751us (1909us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892943.053099:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787892943.053124:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493260544 00000100:00100000:1.0:1787892943.053127:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493260544 00000100:00100000:1.0:1787892943.053188:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787892943.053196:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+17:8526:x1874741493260544:12345-0@lo:502: 00000100:00100000:1.0:1787892943.053314:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+17:8526:x1874741493260544:12345-0@lo:502: Request processed in 118us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892943.053320:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:0.0:1787892943.053394:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9ed560700 x1874741493260416/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787892953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892943.053403:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787892943.053411:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1787892943.053417:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787892943.053422:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787892943.053425:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9fe303800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787892943.053440:0:3629:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787892943.053445:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493260416:0@lo:8: 00000100:00100000:0.0:1787892943.053508:0:8529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8529:1874741493261440:0@lo:700: 00000100:00100000:0.0:1787892943.053536:0:8529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892943.053563:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493261440 00000100:00100000:0.0:1787892943.053566:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493261440 00000100:00100000:0.0:1787892943.053596:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787892943.053602:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8529:x1874741493261440:12345-0@lo:700: 00000100:00100000:0.0:1787892943.053624:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b5500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8427:1874741493261568:0@lo:700: 00000100:00100000:0.0:1787892943.053647:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892943.053663:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d1d1dd80 going to sleep for 11 seconds 00000100:00080000:0.0:1787892943.053674:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787892943.053687:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493261568 00000100:00100000:0.0:1787892943.053691:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493261568 00000100:00100000:0.0:1787892943.053714:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787892943.053720:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8427:x1874741493261568:12345-0@lo:700: 00000100:00100000:0.0:1787892943.053817:0:8529:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d1d1d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787892943.053974:0:8526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed561180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:8526:1874741493260544:0@lo:502: 00000020:01000000:3.0:1787892943.054004:0:8526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787892943.054011:0:8526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787892943.054013:0:8526:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787892943.054017:0:8526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:3.0:1787892943.054074:0:6502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:3.0:1787892943.054091:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1787892943.054100:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540a00/0x9232577658cf0a0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0a15 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892943.054111:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540a00/0x9232577658cf0a0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0a15 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787892943.054131:0:6502:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787892943.054134:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc9d909c800 from 30 10000000:01000000:3.0:1787892943.054137:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787892943.054162:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf0a38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892943.054169:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf0a38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892943.054177:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf0a38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892943.054189:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed561180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493261696:0@lo:101: 00000100:00100000:3.0:1787892943.054220:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892943.054243:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e5e5bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787892943.054257:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493261696 00000100:00100000:3.0:1787892943.054260:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493261696 00000100:00100000:3.0:1787892943.054631:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787892943.054640:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+17:6502:x1874741493261696:12345-0@lo:101: 00010000:00010000:3.0:1787892943.054649:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787892943.054661:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9c147c800/0x9232577658cf0a3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0a38 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892943.054681:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9c147c800/0x9232577658cf0a3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0a38 expref: 18 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892943.054691:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9c147c800/0x9232577658cf0a3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0a38 expref: 18 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892943.054711:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9c147c800, rc 0) 00000100:00100000:3.0:1787892943.054756:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+18:6502:x1874741493261696:12345-0@lo:101: Request processed in 117us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892943.054762:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787892943.054796:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed561180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493261696:0@lo:101: 00010000:00010000:3.0:1787892943.054808:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf0a38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0a3f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892943.054817:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf0a38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0a3f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892943.054861:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed561180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493261824:0@lo:501: 00000100:00100000:3.0:1787892943.054885:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892943.054902:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e5e5bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787892943.054913:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493261824 00000100:00100000:3.0:1787892943.054916:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493261824 00000100:00100000:3.0:1787892943.054933:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787892943.054939:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+18:6502:x1874741493261824:12345-0@lo:501: 00000100:00100000:3.0:1787892943.055024:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+18:6502:x1874741493261824:12345-0@lo:501: Request processed in 85us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892943.055031:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787892943.055058:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed561180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493261824:0@lo:501: 00000100:00100000:3.0:1787892943.055080:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed561180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493261952:0@lo:503: 00000100:00100000:3.0:1787892943.055112:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892943.055124:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fd02a600 going to sleep for 11 seconds 00000100:00100000:3.0:1787892943.055139:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493261952 00000100:00100000:3.0:1787892943.055143:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493261952 00000100:00100000:3.0:1787892943.055159:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787892943.055164:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+18:6502:x1874741493261952:12345-0@lo:503: 00000100:00100000:3.0:1787892943.055228:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+18:6502:x1874741493261952:12345-0@lo:503: Request processed in 62us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892943.055234:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787892943.055267:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed561180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493261952:0@lo:503: 00000004:00080000:1.0:1787892943.055670:0:8528:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787892943.055762:0:8528:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 186877270432ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787892943.055769:0:8528:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1787892943.057309:0:7436:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1787892943.057800:0:8530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed561180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:8530:1874741493262080:0@lo:502: 00000100:00100000:3.0:1787892943.057869:0:8530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892943.057908:0:8530:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fd02a780 going to sleep for 11 seconds 00000100:00100000:0.0:1787892943.057963:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493262080 00000100:00100000:0.0:1787892943.057970:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493262080 00000100:00100000:0.0:1787892943.058013:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787892943.058022:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+18:8530:x1874741493262080:12345-0@lo:502: 00000100:00100000:0.0:1787892943.058139:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+18:8530:x1874741493262080:12345-0@lo:502: Request processed in 118us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892943.058146:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787892943.058307:0:8530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed561180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:8530:1874741493262080:0@lo:502: 00000100:00100000:3.0:1787892943.058352:0:8530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed561180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:8530:1874741493262208:0@lo:502: 00000100:00100000:3.0:1787892943.058386:0:8530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892943.058409:0:8530:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fd02a780 going to sleep for 11 seconds 00000100:00100000:0.0:1787892943.058522:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493262208 00000100:00100000:0.0:1787892943.058528:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493262208 00000100:00100000:0.0:1787892943.058563:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787892943.058569:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+18:8530:x1874741493262208:12345-0@lo:502: 00000100:00100000:0.0:1787892943.058634:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+18:8530:x1874741493262208:12345-0@lo:502: Request processed in 64us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892943.058640:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787892943.060523:0:8530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed561180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:8530:1874741493262208:0@lo:502: 00000040:00080000:2.0:1787892943.060560:0:8530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787892943.061804:0:6502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787892943.061834:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787892943.061844:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf0a38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0a3f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892943.061856:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf0a38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0a3f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787892943.061865:0:6502:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787892943.061867:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc9d909c800 from 5 10000000:01000000:0.0:1787892943.061870:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787892943.061904:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30800/0x9232577658cf0a46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892943.061912:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30800/0x9232577658cf0a46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892943.061922:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30800/0x9232577658cf0a46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892943.061942:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493262336:0@lo:101: 00000100:00100000:0.0:1787892943.062003:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892943.062039:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d1d1d180 going to sleep for 11 seconds 00000100:00100000:0.0:1787892943.062058:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493262336 00000100:00100000:0.0:1787892943.062065:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493262336 00000100:00100000:0.0:1787892943.062108:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787892943.062117:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+18:6502:x1874741493262336:12345-0@lo:101: 00010000:00010000:0.0:1787892943.062129:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787892943.062139:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0a4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0a46 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892943.062159:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0a4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0a46 expref: 19 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892943.062168:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0a4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0a46 expref: 19 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892943.062176:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb30c00, rc 0) 00000100:00100000:0.0:1787892943.062839:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+19:6502:x1874741493262336:12345-0@lo:101: Request processed in 719us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892943.062846:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787892943.063198:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493262336:0@lo:101: 00010000:00010000:0.0:1787892943.063218:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30800/0x9232577658cf0a46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0a4d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892943.063229:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30800/0x9232577658cf0a46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0a4d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892943.063293:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493262464:0@lo:256: 00000100:00100000:0.0:1787892943.063867:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892943.063942:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d1d1d180 going to sleep for 11 seconds 00000100:00100000:1.0:1787892943.066176:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493262464 00000100:00100000:1.0:1787892943.066188:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493262464 00000100:00100000:1.0:1787892943.066239:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787892943.066245:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+19:6502:x1874741493262464:12345-0@lo:256: 20000000:01000000:1.0:1787892943.066264:0:6500:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787892943.066554:0:6500:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787892943.066557:0:6500:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1787892943.066672:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+19:6502:x1874741493262464:12345-0@lo:256: Request processed in 425us (2804us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892943.066684:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787892943.067039:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493262464:0@lo:256: 10000000:01000000:0.0:1787892943.067092:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787892943.067106:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30800/0x9232577658cf0a46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0a4d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892943.067116:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30800/0x9232577658cf0a46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0a4d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787892943.067125:0:6502:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787892943.067127:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1787892943.067130:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787892943.067155:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31c00/0x9232577658cf0a54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892943.067163:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31c00/0x9232577658cf0a54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892943.067172:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31c00/0x9232577658cf0a54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892943.067188:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493262592:0@lo:101: 00000100:00100000:0.0:1787892943.067223:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892943.067254:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d1d1d180 going to sleep for 11 seconds 00000100:00100000:2.0:1787892943.067258:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493262592 00000100:00100000:2.0:1787892943.067264:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493262592 00000100:00100000:2.0:1787892943.067300:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787892943.067308:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+19:6502:x1874741493262592:12345-0@lo:101: 00010000:00010000:2.0:1787892943.067319:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787892943.067331:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9dd729a00/0x9232577658cf0a5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0a54 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892943.067352:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9dd729a00/0x9232577658cf0a5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0a54 expref: 20 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892943.067363:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9dd729a00/0x9232577658cf0a5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0a54 expref: 20 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892943.067370:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9dd729a00, rc 0) 00000100:00100000:2.0:1787892943.067404:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+20:6502:x1874741493262592:12345-0@lo:101: Request processed in 97us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892943.067418:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787892943.067452:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493262592:0@lo:101: 00010000:00010000:2.0:1787892943.067463:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31c00/0x9232577658cf0a54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0a5b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892943.067472:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31c00/0x9232577658cf0a54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0a5b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892943.067542:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7203480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493262720:0@lo:501: 00000100:00100000:2.0:1787892943.067566:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892943.067586:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c8534300 going to sleep for 11 seconds 00000100:00100000:0.0:1787892943.067644:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493262720 00000100:00100000:0.0:1787892943.067649:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493262720 00000100:00100000:0.0:1787892943.067680:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787892943.067687:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+20:6502:x1874741493262720:12345-0@lo:501: 00000100:00100000:0.0:1787892943.067811:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+20:6502:x1874741493262720:12345-0@lo:501: Request processed in 124us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892943.067818:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787892943.067828:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7203480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493262720:0@lo:501: 00000100:00100000:2.0:1787892943.067852:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7203480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493262848:0@lo:503: 00000100:00100000:2.0:1787892943.067902:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892943.067923:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c8534300 going to sleep for 11 seconds 00000100:00100000:0.0:1787892943.068398:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493262848 00000100:00100000:0.0:1787892943.068405:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493262848 00000100:00100000:0.0:1787892943.068436:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787892943.068442:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+20:6502:x1874741493262848:12345-0@lo:503: 00000100:00100000:0.0:1787892943.068541:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+20:6502:x1874741493262848:12345-0@lo:503: Request processed in 98us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892943.068548:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787892943.069026:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7203480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493262848:0@lo:503: 00000100:00100000:2.0:1787892943.069261:0:8532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7203480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:8532:1874741493262976:0@lo:502: 00000100:00100000:2.0:1787892943.070239:0:8532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892943.070276:0:8532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c8534000 going to sleep for 11 seconds 00000100:00100000:1.0:1787892943.071559:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493262976 00000100:00100000:1.0:1787892943.071572:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493262976 00000100:00100000:1.0:1787892943.071626:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787892943.071636:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+20:8532:x1874741493262976:12345-0@lo:502: 00000100:00100000:1.0:1787892943.071809:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+20:8532:x1874741493262976:12345-0@lo:502: Request processed in 173us (1571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892943.071817:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 40000000:02000000:0.0:1787892943.072579:0:6511:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:2.0:1787892943.073358:0:8532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7203480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:8532:1874741493262976:0@lo:502: 00000020:01000000:2.0:1787892943.073397:0:8532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787892943.073405:0:8532:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787892943.073412:0:8532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787892943.073414:0:8532:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787892943.073419:0:8532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787892943.073428:0:8532:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.135@tcp to nid 0x20000c0a8ca87 (192.168.202.135@tcp) 00000020:01000000:2.0:1787892943.073453:0:8532:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787892943.073456:0:8532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787892943.073471:0:8532:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9fc9d911cd28) 00000020:00000080:2.0:1787892943.073507:0:8532:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1787892943.073514:0:8532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787892943.073632:0:8532:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787892943.073639:0:8532:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787892943.073645:0:8532:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9232577658cf0a69 00010000:00080000:2.0:1787892943.073673:0:8532:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc8c64bd000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.135@tcp at head 00010000:00010000:2.0:1787892943.073935:0:8532:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:0.0:1787892943.087675:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8427:x1874741493261568:12345-0@lo:700: Request processed in 33946us (34017us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892943.087691:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787892943.087886:0:8427:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c64b5500 x1874741493261568/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787892959 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892943.087900:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b5500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8427:1874741493261568:0@lo:700: 40000000:02000000:1.0:1787892943.087914:0:8427:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:01000000:3.0:1787892943.096328:0:8532:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787892943.096347:0:8532:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787892943.096582:0:8532:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787892943.096807:0:8532:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787892943.096909:0:8532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1787892943.097011:0:8532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1787892943.097484:0:8533:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787892943.097512:0:8533:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787892943.106488:0:8532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787892943.106524:0:8532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787892943.106566:0:8532:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787892943.106589:0:8532:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9232577658cf0a70 00000100:00080000:0.0:1787892943.106599:0:8532:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787892943.106604:0:8532:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fc8c64bd000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:0.0:1787892943.106664:0:8532:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c64b5c00 x1874741493263104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787892943.107339:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493263104:0@lo:8: 00000100:00100000:1.0:1787892943.107412:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787892943.107474:0:8532:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787892943.107590:0:8532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787892943.107596:0:8532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787892943.107598:0:8532:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787892943.107602:0:8532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787892943.107606:0:8532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787892943.107607:0:8532:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787892943.107611:0:8532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787892943.107613:0:8532:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787892943.107665:0:8532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f73800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:8532:1874741493263232:0@lo:502: 00000100:00100000:1.0:1787892943.107710:0:8532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892943.107718:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493263104 00000100:00100000:0.0:1787892943.107735:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493263104 00000100:00100000:1.0:1787892943.107748:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493263232 00000100:00100000:1.0:1787892943.107754:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493263232 00000100:00100000:0.0:1787892943.107771:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787892943.107780:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3629:x1874741493263104:12345-0@lo:8: 00000100:00100000:1.0:1787892943.107801:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00010000:00080000:0.0:1787892943.107807:0:8421:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 186 last 0 00000100:00100000:1.0:1787892943.107811:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+20:8532:x1874741493263232:12345-0@lo:502: 00000020:00000080:0.0:1787892943.107839:0:8421:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9232577658cf0a77 00002000:00100000:0.0:1787892943.107855:0:8421:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9fc8c64bb800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787892943.107859:0:8421:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787892943.107863:0:8421:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1787892943.107922:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+20:8532:x1874741493263232:12345-0@lo:502: Request processed in 114us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892943.107930:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787892943.107981:0:8532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c3aa9240 going to sleep for 11 seconds 00000100:00100000:1.0:1787892943.108000:0:8532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f73800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:8532:1874741493263232:0@lo:502: 00000020:01000000:1.0:1787892943.108025:0:8532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787892943.108029:0:8532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787892943.108030:0:8532:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787892943.108033:0:8532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00002000:00080000:0.0:1787892943.108196:0:8421:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787892943.108219:0:8421:0:(import.c:65:import_set_state_nolock()) ffff9fc8c64bb000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787892943.109803:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3629:x1874741493263104:12345-0@lo:8: Request processed in 2016us (2383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892943.109816:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000000:2.0:1787892943.110011:0:6502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1787892943.110038:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787892943.110049:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31c00/0x9232577658cf0a54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0a5b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892943.110061:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31c00/0x9232577658cf0a54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0a5b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892943.110070:0:6502:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787892943.110073:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fc9e2e3b370 from 1 10000000:01000000:2.0:1787892943.110076:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787892943.110109:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf0a7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892943.110116:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf0a7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892943.110126:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf0a7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892943.110158:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7203480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493263360:0@lo:101: 00000100:00100000:2.0:1787892943.110206:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892943.110243:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c8534180 going to sleep for 11 seconds 00000100:00100000:0.0:1787892943.110305:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493263360 00000100:00100000:0.0:1787892943.110312:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493263360 00000100:00100000:0.0:1787892943.110357:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787892943.110367:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+20:6502:x1874741493263360:12345-0@lo:101: 00010000:00010000:0.0:1787892943.110378:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787892943.110390:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9edb30e00/0x9232577658cf0a85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0a7e expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892943.110411:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9edb30e00/0x9232577658cf0a85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0a7e expref: 21 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892943.110421:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9edb30e00/0x9232577658cf0a85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0a7e expref: 21 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892943.110430:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb30e00, rc 0) 00000100:00100000:0.0:1787892943.110470:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+21:6502:x1874741493263360:12345-0@lo:101: Request processed in 104us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892943.110475:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000001:00100000:3.0:1787892943.110600:0:8413:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1787892943.110755:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8529:x1874741493261440:12345-0@lo:700: Request processed in 57151us (57217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892943.110764:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787892943.111248:0:8529:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c64b4700 x1874741493261440/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787892959 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892943.111263:0:8529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8529:1874741493261440:0@lo:700: 00000100:00100000:2.0:1787892943.111445:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7203480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493263360:0@lo:101: 00010000:00010000:2.0:1787892943.111460:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf0a7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0a85 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892943.111470:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf0a7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0a85 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892943.111589:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7203480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493263488:0@lo:501: 00000100:00100000:2.0:1787892943.111635:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892943.111661:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c8534180 going to sleep for 11 seconds 00000100:00100000:0.0:1787892943.111711:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493263488 00000100:00100000:0.0:1787892943.111717:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493263488 00000100:00100000:0.0:1787892943.111764:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787892943.111772:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+21:6502:x1874741493263488:12345-0@lo:501: 00000100:00100000:0.0:1787892943.111860:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+21:6502:x1874741493263488:12345-0@lo:501: Request processed in 88us (223us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787892943.111943:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787892943.111957:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7203480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493263488:0@lo:501: 10000000:01000000:2.0:1787892943.111989:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787892943.111995:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf0a7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0a85 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892943.112003:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf0a7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0a85 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1787892943.112123:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c64b5c00 x1874741493263104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787892953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892943.112133:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787892943.112141:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787892943.112148:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787892943.112154:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787892943.112157:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc8c64bd000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787892943.112180:0:3629:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787892943.112186:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493263104:0@lo:8: 00000004:00080000:3.0:1787892943.112232:0:8533:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787892943.112283:0:8533:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 186933791431ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787892943.112289:0:8533:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1787892943.114877:0:6484:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1787892943.123257:0:8534:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787892943.123289:0:8534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed563480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8534:1874741493263744:0@lo:7: 00000100:00100000:1.0:1787892943.123336:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787892943.123352:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed561500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493263616:0@lo:13: 00000100:00100000:3.0:1787892943.123360:0:8534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1787892943.123528:0:8529:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1787892943.123543:0:8529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8529:1874741493264000:0@lo:7: 00000100:00100000:2.0:1787892943.123597:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787892943.123609:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493263872:0@lo:13: 00000100:00100000:1.0:1787892943.125171:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892943.125233:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493263744 00000100:00100000:1.0:1787892943.125242:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493263744 00000100:00100000:1.0:1787892943.125428:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787892943.125437:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ed562680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8534:x1874741493263744:12345-0@lo:7: 00000100:00100000:3.0:1787892943.128188:0:8534:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c623f600 going to sleep for 11 seconds 00000100:00080000:3.0:1787892943.130574:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787892943.130629:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493263616 00000100:00100000:3.0:1787892943.130642:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493263616 00000100:00100000:3.0:1787892943.130706:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787892943.130717:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3633:x1874741493263616:12345-0@lo:13: 00002000:00000024:3.0:1787892943.130752:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3924074496 avail 3692552192 00000100:00100000:3.0:1787892943.130845:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3633:x1874741493263616:12345-0@lo:13: Request processed in 129us (5678us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892943.130853:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787892943.131291:0:8529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892943.131341:0:8529:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d1d1d000 going to sleep for 11 seconds 00000100:00100000:3.0:1787892943.131545:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787892943.131554:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1787892943.132153:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493264000 00000100:00100000:0.0:1787892943.132160:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493264000 00000100:00100000:0.0:1787892943.132269:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787892943.132278:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8529:x1874741493264000:12345-0@lo:7: 00000100:00100000:2.0:1787892943.132788:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787892943.133229:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9ed561500 x1874741493263616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892959 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892943.133252:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed561500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493263616:0@lo:13: 00000100:00100000:3.0:1787892943.135321:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493263872 00000100:00100000:3.0:1787892943.135334:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493263872 00000100:00100000:3.0:1787892943.135382:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787892943.135394:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7203480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3632:x1874741493263872:12345-0@lo:13: 00002000:00000024:3.0:1787892943.135421:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3924074496 avail 3692552192 00000100:00100000:3.0:1787892943.135524:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7203480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3632:x1874741493263872:12345-0@lo:13: Request processed in 131us (2734us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892943.135533:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787892943.136668:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c64b7100 x1874741493263872/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892959 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892943.136765:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493263872:0@lo:13: 00002000:00080000:0.0:1787892943.137014:0:8419:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1787892943.137020:0:8419:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1787892943.137137:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ed562680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8534:x1874741493263744:12345-0@lo:7: Request processed in 11699us (13777us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892943.137145:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787892943.143077:0:8534:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9ed563480 x1874741493263744/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787892959 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892943.143127:0:8534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed563480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8534:1874741493263744:0@lo:7: 00000004:00080000:3.0:1787892943.143146:0:8534:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787892943.147529:0:8534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7200a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8534:1874741493264128:0@lo:5: 00000100:00100000:2.0:1787892943.147596:0:8534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892943.147626:0:8534:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c8534180 going to sleep for 11 seconds 00000100:00100000:2.0:1787892943.147783:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493264128 00000100:00100000:2.0:1787892943.147792:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493264128 00000100:00100000:2.0:1787892943.147847:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787892943.147858:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7200380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8534:x1874741493264128:12345-0@lo:5: 00002000:00080000:2.0:1787892943.147886:0:8535:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787892943.147889:0:8535:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00002000:00080000:1.0:1787892943.149686:0:8420:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1787892943.149693:0:8420:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1787892943.149780:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8529:x1874741493264000:12345-0@lo:7: Request processed in 17500us (18487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892943.149794:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787892943.150031:0:8529:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c64b4e00 x1874741493264000/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787892959 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892943.150057:0:8529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8529:1874741493264000:0@lo:7: 00000004:00080000:0.0:1787892943.150072:0:8529:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:0.0:1787892943.150105:0:8529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8529:1874741493264256:0@lo:5: 00000100:00100000:0.0:1787892943.150146:0:8529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892943.150180:0:8529:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d1d1d000 going to sleep for 11 seconds 00000100:00100000:2.0:1787892943.150232:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493264256 00000100:00100000:2.0:1787892943.150239:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493264256 00000100:00100000:2.0:1787892943.150281:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787892943.150290:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8529:x1874741493264256:12345-0@lo:5: 00002000:00080000:2.0:1787892943.150313:0:8419:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1787892943.150348:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8529:x1874741493264256:12345-0@lo:5: Request processed in 60us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892943.150354:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787892943.150418:0:8529:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c64b4e00 x1874741493264256/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787892959 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892943.150440:0:8529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8529:1874741493264256:0@lo:5: 00000004:00080000:0.0:1787892943.150448:0:8529:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1787892943.150469:0:8529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8529:1874741493264384:0@lo:5: 00000100:00100000:0.0:1787892943.150519:0:8529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892943.150537:0:8529:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d1d1d000 going to sleep for 11 seconds 00000100:00100000:2.0:1787892943.150584:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493264384 00000100:00100000:2.0:1787892943.150588:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493264384 00000100:00100000:2.0:1787892943.150619:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787892943.150626:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8529:x1874741493264384:12345-0@lo:5: 00002000:00080000:2.0:1787892943.150648:0:8420:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1787892943.156696:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8529:x1874741493264384:12345-0@lo:5: Request processed in 6064us (6197us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787892943.156711:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000001:00080000:3.0:1787892943.158079:0:8413:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1787892943.158095:0:8413:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:0.0:1787892943.158842:0:8529:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c64b4e00 x1874741493264384/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787892959 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892943.158857:0:8529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8529:1874741493264384:0@lo:5: 00000004:00080000:0.0:1787892943.158871:0:8529:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1787892943.158906:0:8529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8529:1874741493264512:0@lo:900: 00000100:00100000:0.0:1787892943.158948:0:8529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892943.158972:0:8529:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d1d1d000 going to sleep for 11 seconds 00000100:00100000:3.0:1787892943.159368:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493264512 00000100:00100000:3.0:1787892943.159375:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493264512 00000100:00100000:3.0:1787892943.160762:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787892943.160778:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8529:x1874741493264512:12345-0@lo:900: 00000100:00100000:3.0:1787892943.160886:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8529:x1874741493264512:12345-0@lo:900: Request processed in 113us (1936us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892943.160893:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787892943.161875:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7200380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8534:x1874741493264128:12345-0@lo:5: Request processed in 14015us (14275us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787892943.161885:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787892943.163151:0:8529:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c64b6680 x1874741493264512/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787892959 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892943.163168:0:8529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8529:1874741493264512:0@lo:900: 00010000:00080000:2.0:1787892943.163352:0:8534:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9e7200a80 x1874741493264128/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787892959 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892943.163362:0:8534:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787892943.163376:0:8534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7200a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8534:1874741493264128:0@lo:5: 00000004:00080000:2.0:1787892943.163388:0:8534:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787892943.163433:0:8534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7200a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8534:1874741493264640:0@lo:700: 00000100:00100000:2.0:1787892943.163480:0:8534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892943.163528:0:8534:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c8534180 going to sleep for 11 seconds 00000100:00100000:0.0:1787892943.165777:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493264640 00000100:00100000:0.0:1787892943.165791:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493264640 00000100:00100000:0.0:1787892943.165860:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787892943.165870:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7202d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8534:x1874741493264640:12345-0@lo:700: 00000001:00080000:1.0:1787892943.173304:0:8413:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:0.0:1787892943.173673:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7202d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8534:x1874741493264640:12345-0@lo:700: Request processed in 7800us (10187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892943.173685:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787892943.173790:0:8534:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9e7200a80 x1874741493264640/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787892959 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892943.173806:0:8534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7200a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8534:1874741493264640:0@lo:700: 00000004:02000040:2.0:1787892943.176162:0:8534:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:2.0:1787892943.184547:0:8534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7200a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8534:1874741493264768:0@lo:5: 00000100:00100000:2.0:1787892943.184614:0:8534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892943.184654:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493264768 00000100:00100000:2.0:1787892943.184661:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493264768 00000100:00100000:2.0:1787892943.184709:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787892943.184718:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7201180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8534:x1874741493264768:12345-0@lo:5: 00000100:00100000:3.0:1787892943.193577:0:8534:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c8534180 going to sleep for 11 seconds 00002000:00080000:2.0:1787892943.194169:0:8421:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1787892943.194902:0:8421:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:2.0:1787892943.196445:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7201180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8534:x1874741493264768:12345-0@lo:5: Request processed in 11722us (11825us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787892943.196456:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787892943.196861:0:8534:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9e7200a80 x1874741493264768/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787892959 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892943.196886:0:8534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7200a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8534:1874741493264768:0@lo:5: 00000004:00080000:0.0:1787892943.196900:0:8534:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:0.0:1787892943.548565:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892944.562063:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787892944.562178:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed563480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493264896:0@lo:41: 00000100:00100000:0.0:1787892944.562242:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892944.562293:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493264896 00000100:00100000:3.0:1787892944.562302:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493264896 00000100:00100000:3.0:1787892944.562365:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787892944.562374:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493264896:12345-0@lo:41: 00000004:00000024:3.0:1787892944.562407:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1787892944.562469:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493264896:12345-0@lo:41: Request processed in 96us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892944.562478:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787892944.562544:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed563480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493264896:0@lo:41: 00010000:00010000:2.0:1787892945.587770:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787892945.592439:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7200700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493265024:0@lo:41: 00000100:00100000:3.0:1787892945.592540:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892945.592657:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493265024 00000100:00100000:0.0:1787892945.592665:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493265024 00000100:00100000:0.0:1787892945.592725:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787892945.592735:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ed563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493265024:12345-0@lo:41: 00000004:00000024:0.0:1787892945.592777:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1787892945.601507:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ed563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493265024:12345-0@lo:41: Request processed in 8750us (8954us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892945.601524:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787892945.612564:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7200700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493265024:0@lo:41: 00010000:00010000:2.0:1787892946.612658:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892947.634731:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787892947.812086:0:8796:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg235-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1787892948.145887:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787892948.145912:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493265152:0@lo:13: 00000100:00100000:0.0:1787892948.145981:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892948.146058:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493265152 00000100:00100000:0.0:1787892948.146066:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493265152 00000100:00100000:0.0:1787892948.146116:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787892948.146125:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493265152:12345-0@lo:13: 00002000:00000024:0.0:1787892948.146457:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787892948.146527:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493265152:12345-0@lo:13: Request processed in 403us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892948.146535:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787892948.146557:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787892948.146585:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c64b7100 x1874741493265152/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892964 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892948.146603:0:3633:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787892948.146704:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493265152:0@lo:13: 00000100:00100000:3.0:1787892948.146995:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493265408:0@lo:400: 00000100:00100000:3.0:1787892948.147048:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892948.147070:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d29f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493265920:0@lo:400: 00000100:00100000:3.0:1787892948.147095:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892948.147114:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787892948.147120:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493265536:0@lo:400: 00000100:00100000:3.0:1787892948.147354:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892948.147374:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d29f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493266048:0@lo:400: 00000100:00100000:3.0:1787892948.147397:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892948.147424:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493265408 00000100:00100000:3.0:1787892948.147429:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493265408 00000100:00100000:3.0:1787892948.147456:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493265920 00000100:00100000:3.0:1787892948.147458:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493265920 00000100:00100000:3.0:1787892948.147473:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493266048 00000100:00100000:3.0:1787892948.147475:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493266048 00000100:00100000:3.0:1787892948.147508:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787892948.147516:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493265408:12345-0@lo:400: 00000100:00100000:3.0:1787892948.147553:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493265408:12345-0@lo:400: Request processed in 38us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892948.147560:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787892948.147575:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787892948.147581:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe349500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493265920:12345-0@lo:400: 00000100:00100000:3.0:1787892948.147606:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe349500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493265920:12345-0@lo:400: Request processed in 25us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892948.147611:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787892948.147621:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787892948.147710:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe34aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493266048:12345-0@lo:400: 00000100:00100000:3.0:1787892948.147739:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe34aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493266048:12345-0@lo:400: Request processed in 112us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892948.147751:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787892948.147772:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493265536 00000100:00100000:3.0:1787892948.147776:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493265536 00000100:00100000:3.0:1787892948.147800:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787892948.147806:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe349c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493265536:12345-0@lo:400: 00000100:00100000:3.0:1787892948.147837:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe349c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493265536:12345-0@lo:400: Request processed in 31us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892948.147843:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1787892948.147996:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787892948.148000:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787892948.148020:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed561500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493265280:0@lo:400: 00000100:00100000:0.0:1787892948.148049:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892948.148073:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d29fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493265792:0@lo:400: 00000100:00100000:0.0:1787892948.148092:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892948.148108:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787892948.148113:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d29f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874741493265664:0@lo:400: 00000100:00100000:0.0:1787892948.148132:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892948.148418:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d29f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493266176:0@lo:400: 00000100:00100000:0.0:1787892948.148442:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892948.148470:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493265280 00000100:00100000:0.0:1787892948.148474:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493265280 00000100:00100000:0.0:1787892948.148520:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787892948.148527:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+21:3633:x1874741493265280:12345-0@lo:400: 00000100:00100000:0.0:1787892948.148557:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+21:3633:x1874741493265280:12345-0@lo:400: Request processed in 31us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892948.148563:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787892948.148589:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493265792 00000100:00100000:0.0:1787892948.148592:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493265792 00000100:00100000:0.0:1787892948.148612:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787892948.148618:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493265792:12345-0@lo:400: 00000100:00100000:0.0:1787892948.148659:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493265792:12345-0@lo:400: Request processed in 41us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892948.148671:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787892948.148699:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493266176 00000100:00100000:0.0:1787892948.148703:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493266176 00000100:00100000:0.0:1787892948.148736:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787892948.148741:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3633:x1874741493266176:12345-0@lo:400: 00000100:00100000:0.0:1787892948.148771:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3633:x1874741493266176:12345-0@lo:400: Request processed in 30us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892948.148776:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787892948.148793:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787892948.148802:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493265664 00000100:00100000:0.0:1787892948.148805:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493265664 00000100:00100000:0.0:1787892948.148824:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787892948.148829:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1874741493265664:12345-0@lo:400: 00000100:00100000:0.0:1787892948.148855:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1874741493265664:12345-0@lo:400: Request processed in 25us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892948.148860:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787892948.149132:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493265536:0@lo:400: 00010000:00080000:3.0:1787892948.149215:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9d29f9180 x1874741493266048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892948.149225:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d29f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493266048:0@lo:400: 00010000:00080000:3.0:1787892948.149237:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9ed561180 x1874741493265408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892948.149244:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493265408:0@lo:400: 00010000:00080000:3.0:1787892948.149254:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9d29f9880 x1874741493265920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892948.149262:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d29f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493265920:0@lo:400: 00000100:00100000:0.0:1787892948.149364:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493266304:0@lo:13: 00000100:00100000:0.0:1787892948.149392:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787892948.149425:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9d29f8e00 x1874741493265664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892948.149434:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d29f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874741493265664:0@lo:400: 00010000:00080000:0.0:1787892948.149441:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9d29f9500 x1874741493266176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892948.149449:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d29f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493266176:0@lo:400: 00000100:00100000:0.0:1787892948.149456:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed561500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493265280:0@lo:400: 00000100:00100000:0.0:1787892948.149475:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d29fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493265792:0@lo:400: 00000100:00100000:3.0:1787892948.149573:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493266304 00000100:00100000:3.0:1787892948.149577:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493266304 00000100:00100000:3.0:1787892948.149608:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787892948.149616:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3633:x1874741493266304:12345-0@lo:13: 00002000:00000024:3.0:1787892948.149697:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787892948.149740:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3633:x1874741493266304:12345-0@lo:13: Request processed in 125us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892948.149752:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787892948.149774:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c64b5500 x1874741493266304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892964 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892948.149787:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493266304:0@lo:13: 00010000:00010000:2.0:1787892948.657852:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787892948.760787:0:8848:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787892948.762397:0:8848:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000001:00080000:0.0:1787892949.207882:0:8413:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:2.0:1787892949.689382:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787892949.689636:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787892949.689659:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe34bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493266432:0@lo:41: 00000100:00100000:3.0:1787892949.689749:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892949.689826:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493266432 00000100:00100000:3.0:1787892949.689836:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493266432 00000100:00100000:3.0:1787892949.689906:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787892949.689917:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe348700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493266432:12345-0@lo:41: 00000004:00000024:3.0:1787892949.689955:0:7865:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1787892949.690003:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe348700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493266432:12345-0@lo:41: Request processed in 88us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892949.690009:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787892949.690057:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe34bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493266432:0@lo:41: 00010000:00010000:1.0:1787892950.712896:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787892950.720326:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe34bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493266560:0@lo:41: 00000100:00100000:3.0:1787892950.720396:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892950.720472:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493266560 00000100:00100000:3.0:1787892950.720480:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493266560 00000100:00100000:3.0:1787892950.720544:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787892950.720552:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493266560:12345-0@lo:41: 00000004:00000024:3.0:1787892950.720584:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1787892950.720630:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493266560:12345-0@lo:41: Request processed in 79us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892950.720638:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787892950.720694:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe34bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493266560:0@lo:41: 00000020:00000004:3.0:1787892951.465085:0:8949:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787892951.465915:0:8949:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787892951.729599:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787892952.208342:0:8997:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787892952.208353:0:8997:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1787892952.753703:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787892953.269337:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493266688:0@lo:13: 00000100:00100000:0.0:1787892953.269463:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892953.269556:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493266688 00000100:00100000:0.0:1787892953.269563:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493266688 00000100:00100000:0.0:1787892953.269612:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787892953.269623:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493266688:12345-0@lo:13: 00002000:00000024:0.0:1787892953.269665:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787892953.269710:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493266688:12345-0@lo:13: Request processed in 89us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892953.269717:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1787892953.269739:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787892953.269993:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c64b4380 x1874741493266688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892969 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892953.270005:0:3632:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1787892953.270027:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493266688:0@lo:13: 00000100:00100000:2.0:1787892953.270298:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787892953.270309:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493266816:0@lo:13: 00000100:00100000:2.0:1787892953.270342:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892953.270381:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493266816 00000100:00100000:2.0:1787892953.270386:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493266816 00000100:00100000:2.0:1787892953.270418:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787892953.270425:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7201500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493266816:12345-0@lo:13: 00002000:00000024:2.0:1787892953.270437:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787892953.270469:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7201500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493266816:12345-0@lo:13: Request processed in 43us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892953.270475:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1787892953.270517:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787892953.270539:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9e7202a00 x1874741493266816/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892969 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892953.270553:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493266816:0@lo:13: 00000100:00100000:2.0:1787892953.271771:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493266944:0@lo:400: 00000100:00100000:2.0:1787892953.271828:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892953.271869:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7203100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493267456:0@lo:400: 00000100:00100000:2.0:1787892953.271910:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892953.271940:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787892953.271946:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7203b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493267072:0@lo:400: 00000100:00100000:2.0:1787892953.271971:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892953.271991:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7200e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493267584:0@lo:400: 00000100:00100000:2.0:1787892953.272032:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892953.272068:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493267456 00000100:00100000:3.0:1787892953.272083:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493267456 00000100:00100000:2.0:1787892953.272092:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493266944 00000100:00100000:2.0:1787892953.272099:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493266944 00000100:00100000:2.0:1787892953.272169:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787892953.272176:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787892953.272184:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+21:3630:x1874741493266944:12345-0@lo:400: 00000100:00100000:3.0:1787892953.272194:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7201880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493267456:12345-0@lo:400: 00000100:00100000:2.0:1787892953.272238:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+21:3630:x1874741493266944:12345-0@lo:400: Request processed in 59us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892953.272248:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787892953.272291:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493267072 00000100:00100000:3.0:1787892953.272292:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7201880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493267456:12345-0@lo:400: Request processed in 100us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892953.272301:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493267072 00000100:00100000:3.0:1787892953.272307:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787892953.272338:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493267584 00000100:00100000:2.0:1787892953.272343:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493267584 00000100:00100000:2.0:1787892953.272378:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1787892953.272380:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787892953.272389:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7202300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493267072:12345-0@lo:400: 00000100:00100000:2.0:1787892953.272434:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7202300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493267072:12345-0@lo:400: Request processed in 48us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892953.272441:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787892953.272453:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787892953.272459:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7202680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493267584:12345-0@lo:400: 00000100:00100000:2.0:1787892953.272483:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7202680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493267584:12345-0@lo:400: Request processed in 24us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892953.272523:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787892953.272551:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7203800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493267200:0@lo:400: 00000100:00100000:2.0:1787892953.272578:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892953.272595:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7201f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493267712:0@lo:400: 00000100:00100000:2.0:1787892953.272613:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892953.272653:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787892953.272661:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7201c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493267328:0@lo:400: 00000100:00100000:2.0:1787892953.272700:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892953.272727:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493267712 00000100:00100000:2.0:1787892953.272731:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493267712 00000100:00100000:2.0:1787892953.272759:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493267328 00000100:00100000:2.0:1787892953.272762:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493267328 00000100:00100000:2.0:1787892953.272781:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787892953.272789:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7200700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493267712:12345-0@lo:400: 00000100:00100000:3.0:1787892953.272815:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493267200 00000100:00100000:3.0:1787892953.272823:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493267200 00000100:00100000:2.0:1787892953.272838:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7200700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493267712:12345-0@lo:400: Request processed in 49us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892953.272847:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787892953.272870:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787892953.272878:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787892953.272886:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493267328:12345-0@lo:400: 00000100:00100000:3.0:1787892953.272895:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7200a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493267200:12345-0@lo:400: 00000100:00100000:2.0:1787892953.272931:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493267328:12345-0@lo:400: Request processed in 51us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892953.272939:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787892953.272963:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7200a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493267200:12345-0@lo:400: Request processed in 70us (380us total) trans 0 rc 0/0 00000100:00080000:2.0:1787892953.272969:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787892953.272977:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1787892953.273014:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9e7201c00 x1874741493267328/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892953.273028:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7201c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493267328:0@lo:400: 00000100:00100000:2.0:1787892953.273039:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7203800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493267200:0@lo:400: 00010000:00080000:2.0:1787892953.273047:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9e7201f80 x1874741493267712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892953.273056:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7201f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493267712:0@lo:400: 00010000:00080000:2.0:1787892953.273093:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9e7203b80 x1874741493267072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892953.273110:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7203b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493267072:0@lo:400: 00010000:00080000:2.0:1787892953.273122:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9e7200e00 x1874741493267584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892953.273129:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7200e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493267584:0@lo:400: 00000100:00100000:2.0:1787892953.273137:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493266944:0@lo:400: 00000100:00100000:2.0:1787892953.273147:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7203100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493267456:0@lo:400: 00010000:00010000:3.0:1787892953.778691:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892954.801599:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892954.805031:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787892954.805057:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493267840:0@lo:41: 00000100:00100000:1.0:1787892954.805135:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892954.805283:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493267840 00000100:00100000:2.0:1787892954.805291:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493267840 00000100:00100000:2.0:1787892954.805350:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787892954.805361:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493267840:12345-0@lo:41: 00000004:00000024:2.0:1787892954.805393:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1787892954.805887:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493267840:12345-0@lo:41: Request processed in 526us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892954.805895:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787892954.805943:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493267840:0@lo:41: 00010000:00010000:2.0:1787892955.825745:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787892955.829176:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787892955.829202:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493267968:0@lo:41: 00000100:00100000:3.0:1787892955.829272:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892955.829393:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493267968 00000100:00100000:1.0:1787892955.829402:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493267968 00000100:00100000:1.0:1787892955.829460:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787892955.829483:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493267968:12345-0@lo:41: 00000004:00000024:1.0:1787892955.829538:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1787892955.829590:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493267968:12345-0@lo:41: Request processed in 108us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892955.829597:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787892955.829794:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493267968:0@lo:41: 00010000:00010000:3.0:1787892956.851915:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892957.883698:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787892958.386004:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493268096:0@lo:13: 00000100:00100000:0.0:1787892958.386087:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892958.386166:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493268096 00000100:00100000:0.0:1787892958.386174:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493268096 00000100:00100000:0.0:1787892958.386229:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787892958.386239:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493268096:12345-0@lo:13: 00002000:00000024:0.0:1787892958.386267:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787892958.386310:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493268096:12345-0@lo:13: Request processed in 74us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892958.386331:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1787892958.386354:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787892958.386383:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c64b4380 x1874741493268096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892974 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892958.386402:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493268096:0@lo:13: 00000100:00100000:2.0:1787892958.386889:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493268224:0@lo:13: 00000100:00100000:2.0:1787892958.386923:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892958.387386:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493268352:0@lo:400: 00000100:00100000:0.0:1787892958.387424:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892958.387450:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493268864:0@lo:400: 00000100:00100000:0.0:1787892958.387474:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892958.387514:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787892958.387520:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874741493268736:0@lo:400: 00000100:00100000:0.0:1787892958.387547:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892958.387577:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493268352 00000100:00100000:0.0:1787892958.387594:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493268352 00000100:00100000:0.0:1787892958.387631:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787892958.387639:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ec8ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+21:3633:x1874741493268352:12345-0@lo:400: 00000100:00100000:0.0:1787892958.387676:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ec8ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+21:3633:x1874741493268352:12345-0@lo:400: Request processed in 38us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892958.387682:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787892958.387708:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493268864 00000100:00100000:0.0:1787892958.387712:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493268864 00000100:00100000:0.0:1787892958.387732:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787892958.387738:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493268864:12345-0@lo:400: 00000100:00100000:0.0:1787892958.387770:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493268864:12345-0@lo:400: Request processed in 32us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892958.387787:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787892958.387804:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493268736 00000100:00100000:0.0:1787892958.387807:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493268736 00000100:00100000:0.0:1787892958.387833:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787892958.387838:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1874741493268736:12345-0@lo:400: 00000100:00100000:0.0:1787892958.387866:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1874741493268736:12345-0@lo:400: Request processed in 27us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892958.387871:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1787892958.387906:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9c3e6ce00 x1874741493268736/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892958.387919:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874741493268736:0@lo:400: 00000100:00100000:0.0:1787892958.387928:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493268352:0@lo:400: 00000100:00100000:0.0:1787892958.387937:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493268864:0@lo:400: 00000100:00100000:0.0:1787892958.387960:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493268224 00000100:00100000:0.0:1787892958.387964:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493268224 00000100:00100000:3.0:1787892958.388064:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493268480:0@lo:400: 00000100:00100000:3.0:1787892958.388094:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892958.388114:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493268992:0@lo:400: 00000100:00100000:3.0:1787892958.388146:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892958.388162:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787892958.388167:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493268608:0@lo:400: 00000100:00100000:3.0:1787892958.388188:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892958.388204:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493269120:0@lo:400: 00000100:00100000:3.0:1787892958.388223:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892958.388244:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493268480 00000100:00100000:3.0:1787892958.388247:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493268480 00000100:00100000:3.0:1787892958.388264:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493268992 00000100:00100000:3.0:1787892958.388267:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493268992 00000100:00100000:3.0:1787892958.388284:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493269120 00000100:00100000:3.0:1787892958.388287:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493269120 00000100:00100000:3.0:1787892958.388299:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787892958.388304:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493268480:12345-0@lo:400: 00000100:00100000:3.0:1787892958.388339:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493268480:12345-0@lo:400: Request processed in 33us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892958.388345:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787892958.388355:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787892958.388361:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493268992:12345-0@lo:400: 00000100:00100000:3.0:1787892958.388385:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493268992:12345-0@lo:400: Request processed in 24us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892958.388390:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787892958.388399:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787892958.388405:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe34bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493269120:12345-0@lo:400: 00000100:00100000:3.0:1787892958.388430:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe34bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493269120:12345-0@lo:400: Request processed in 26us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892958.388436:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787892958.388459:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493268608 00000100:00100000:3.0:1787892958.388463:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493268608 00000100:00100000:3.0:1787892958.388482:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787892958.388488:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493268608:12345-0@lo:400: 00000100:00100000:3.0:1787892958.388540:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493268608:12345-0@lo:400: Request processed in 52us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892958.388546:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787892958.388569:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493268608:0@lo:400: 00010000:00080000:3.0:1787892958.388579:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9c3e6fb80 x1874741493269120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892958.388600:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493269120:0@lo:400: 00010000:00080000:3.0:1787892958.388611:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9c3e6ea00 x1874741493268480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892958.388619:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493268480:0@lo:400: 00010000:00080000:3.0:1787892958.388627:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9c3e6ca80 x1874741493268992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892958.388635:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493268992:0@lo:400: 00000100:00100000:0.0:1787892958.388828:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787892958.388834:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493268224:12345-0@lo:13: 00002000:00000024:0.0:1787892958.388847:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787892958.388876:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493268224:12345-0@lo:13: Request processed in 43us (1953us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892958.388882:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1787892958.388899:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787892958.388903:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787892958.388905:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787892958.389046:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c67a8000 x1874741493268224/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892974 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892958.389060:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493268224:0@lo:13: 00010000:00010000:2.0:1787892958.902052:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892959.922076:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1787892959.922081:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892959.922103:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493269248:0@lo:41: 00000100:00100000:1.0:1787892959.922170:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892959.922548:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493269248 00000100:00100000:2.0:1787892959.922557:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493269248 00000100:00100000:2.0:1787892959.922620:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787892959.922630:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493269248:12345-0@lo:41: 00000004:00000024:2.0:1787892959.922661:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1787892959.922721:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493269248:12345-0@lo:41: Request processed in 93us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892959.922728:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787892959.922765:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493269248:0@lo:41: 00000100:00100000:3.0:1787892960.949368:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493269376:0@lo:41: 00000100:00100000:3.0:1787892960.949446:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892960.953252:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493269376 00000100:00100000:2.0:1787892960.953269:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493269376 00000100:00100000:2.0:1787892960.953339:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787892960.953350:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ed561500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493269376:12345-0@lo:41: 00000004:00000024:2.0:1787892960.953394:0:7865:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00010000:00010000:1.0:1787892960.953883:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787892960.964537:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ed561500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493269376:12345-0@lo:41: Request processed in 11179us (15081us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892960.964554:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787892960.968284:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493269376:0@lo:41: 00000020:01000004:1.0:1787892961.227815:0:9496:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787892961.227819:0:9496:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1787892961.227821:0:9496:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1787892961.230097:0:9496:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fc9e70bc000 00000020:01000004:1.0:1787892961.230116:0:9496:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787892961.230131:0:9496:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787892961.230144:0:9496:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9fc9e735cd28) 00000020:00000080:1.0:1787892961.230161:0:9496:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787892961.267612:0:9496:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1787892961.267677:0:9496:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:3.0:1787892961.299941:0:9496:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787892961.301519:0:9496:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787892961.301535:0:9496:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787892961.301548:0:9496:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9232577658cf0a93 00000020:01000004:3.0:1787892961.301554:0:9496:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1787892961.301597:0:9496:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.135@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787892961.301600:0:9496:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.135@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787892961.301607:0:9496:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787892961.301638:0:9496:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1787892961.301642:0:9496:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.135@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787892961.333454:0:9496:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.135@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787892961.333611:0:9496:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.135@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1787892961.333615:0:9496:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787892961.333617:0:9496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787892961.333619:0:9496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787892961.333620:0:9496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787892961.333621:0:9496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787892961.333622:0:9496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787892961.333623:0:9496:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787892961.333625:0:9496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787892961.333626:0:9496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787892961.333627:0:9496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787892961.333629:0:9496:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787892961.333632:0:9496:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1787892961.333634:0:9496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787892961.333641:0:9496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787892961.333642:0:9496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787892961.333643:0:9496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787892961.333644:0:9496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787892961.333645:0:9496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787892961.333646:0:9496:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787892961.333647:0:9496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787892961.333648:0:9496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787892961.333649:0:9496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787892961.333649:0:9496:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787892961.333675:0:9496:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787892961.333695:0:9496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:9496:1874741493269504:0@lo:253: 00000100:00100000:2.0:1787892961.333774:0:9496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892961.333874:0:9496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9ddf41b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787892961.333918:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493269504 00000100:00100000:0.0:1787892961.333926:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493269504 00000100:00100000:0.0:1787892961.334007:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787892961.334077:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ec8bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+21:9496:x1874741493269504:12345-0@lo:253: 20000000:01000000:0.0:1787892961.334112:0:6499:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787892961.334116:0:6499:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1787892961.334121:0:6499:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1787892961.334124:0:6499:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1787892961.334456:0:6499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787892961.334665:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:0.0:1787892961.334678:0:6499:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1787892961.334696:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:0.0:1787892961.334703:0:6499:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1787892961.334714:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:0.0:1787892961.334726:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:0.0:1787892961.334803:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:0.0:1787892961.334816:0:6499:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.135@tcp 20000000:01000000:0.0:1787892961.334818:0:6499:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.135@tcp (null) (null) (null) 00000040:00080000:0.0:1787892961.334832:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:0.0:1787892961.334838:0:6499:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787892961.334850:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:0.0:1787892961.334855:0:6499:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.135@tcp (null) (null) 00000040:00080000:0.0:1787892961.334867:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:0.0:1787892961.334873:0:6499:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1787892961.334884:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:0.0:1787892961.334898:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:0.0:1787892961.334958:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:0.0:1787892961.334968:0:6499:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.135@tcp 20000000:01000000:0.0:1787892961.334970:0:6499:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.135@tcp (null) (null) (null) 00000040:00080000:0.0:1787892961.334982:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:0.0:1787892961.334987:0:6499:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787892961.335007:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:0.0:1787892961.335080:0:6499:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.202.135@tcp (null) (null) 00000040:00080000:0.0:1787892961.335099:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:0.0:1787892961.335105:0:6499:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1787892961.335118:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:0.0:1787892961.335133:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:0.0:1787892961.335845:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:0.0:1787892961.335860:0:6499:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.135@tcp 20000000:01000000:0.0:1787892961.335862:0:6499:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.135@tcp (null) (null) (null) 00000040:00080000:0.0:1787892961.335875:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:0.0:1787892961.335881:0:6499:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787892961.335892:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:0.0:1787892961.335896:0:6499:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.135@tcp (null) (null) 00000040:00080000:0.0:1787892961.335909:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:0.0:1787892961.335915:0:6499:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1787892961.335927:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:0.0:1787892961.335941:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:0.0:1787892961.335953:0:6499:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787892961.335956:0:6499:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787892961.335960:0:6499:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787892961.336002:0:6499:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787892961.336005:0:6499:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787892961.336674:0:9502:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1787892961.336699:0:9502:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1787892961.336713:0:9502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:0.0:1787892961.336906:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:0.0:1787892961.336945:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:0.0:1787892961.336962:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:0.0:1787892961.336974:0:6499:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787892961.336976:0:6499:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787892961.337439:0:9503:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 26 1->4: lustre sys.timeout 20000000:01000000:2.0:1787892961.337464:0:9503:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 26 2->4: lustre sys.timeout 00000040:00080000:2.0:1787892961.337473:0:9503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1787892961.337692:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1787892961.337709:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:0.0:1787892961.337722:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:0.0:1787892961.337730:0:6499:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1787892961.337731:0:6499:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787892961.338099:0:9504:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:2.0:1787892961.338119:0:9504:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:2.0:1787892961.338133:0:9504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:0.0:1787892961.338328:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:0.0:1787892961.338413:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:0.0:1787892961.338428:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:0.0:1787892961.338437:0:6499:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787892961.338439:0:6499:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787892961.338882:0:9505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:0.0:1787892961.339092:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:0.0:1787892961.339112:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:0.0:1787892961.339126:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:0.0:1787892961.339134:0:6499:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787892961.339135:0:6499:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787892961.339571:0:9506:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 28 1->4: lustre sys.timeout 20000000:01000000:0.0:1787892961.339665:0:9506:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 28 2->4: lustre sys.timeout 00000040:00080000:0.0:1787892961.339685:0:9506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:2.0:1787892961.339843:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:2.0:1787892961.339861:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:2.0:1787892961.339875:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 10000000:01000000:2.0:1787892961.339889:0:6499:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787892961.339909:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fc9dd729400/0x9232577658cf0a9a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.339927:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9edb31600/0x9232577658cf0990 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0989 expref: 21 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.339946:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9dd69d800/0x9232577658cf09ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf09b3 expref: 21 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.339953:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9c147d200/0x9232577658cf09f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf09f2 expref: 21 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.339959:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9fe541200/0x9232577658cf0a15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0a0e expref: 21 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.339965:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9c147c800/0x9232577658cf0a3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0a38 expref: 21 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.339972:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9dd729a00/0x9232577658cf0a5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0a54 expref: 21 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.339979:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9edb30e00/0x9232577658cf0a85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0a7e expref: 21 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.339986:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fc9dd729400/0x9232577658cf0a9a lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.340086:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9edb30e00/0x9232577658cf0a85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf0a7e expref: 21 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.340099:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc9edb30e00/0x9232577658cf0a85 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf0a7e expref: 21 pid: 6499 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892961.340113:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67a8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6499:1874741493269632:0@lo:104: 00000100:00100000:2.0:1787892961.341270:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892961.341423:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493269632 00000100:00100000:1.0:1787892961.341433:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493269632 00010000:00010000:2.0:1787892961.341569:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9dd729a00/0x9232577658cf0a5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf0a54 expref: 21 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.341582:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc9dd729a00/0x9232577658cf0a5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf0a54 expref: 21 pid: 6499 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892961.341594:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67a9180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6499:1874741493269760:0@lo:104: 00000100:00100000:2.0:1787892961.341628:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787892961.341699:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9c147c800/0x9232577658cf0a3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf0a38 expref: 21 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.341708:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc9c147c800/0x9232577658cf0a3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf0a38 expref: 21 pid: 6497 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892961.341716:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67aaa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6499:1874741493269888:0@lo:104: 00000100:00100000:2.0:1787892961.341737:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787892961.348426:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9fe541200/0x9232577658cf0a15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf0a0e expref: 21 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.348445:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc9fe541200/0x9232577658cf0a15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf0a0e expref: 21 pid: 6499 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892961.348460:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67abb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6499:1874741493270016:0@lo:104: 00000100:00100000:2.0:1787892961.348534:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892961.351254:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493269760 00000100:00100000:3.0:1787892961.351270:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493269760 00000100:00100000:3.0:1787892961.351326:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493269888 00000100:00100000:3.0:1787892961.351329:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493269888 00000100:00100000:3.0:1787892961.351413:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787892961.351424:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+5:6499:x1874741493269632:12345-0@lo:104: 00010000:00010000:3.0:1787892961.351442:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf0a7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0a85 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.351545:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787892961.351551:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+5:6499:x1874741493269632:12345-0@lo:104: Request processed in 130us (10285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892961.351570:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787892961.351590:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787892961.351596:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+4:6499:x1874741493269760:12345-0@lo:104: 00010000:00010000:3.0:1787892961.351604:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31c00/0x9232577658cf0a54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0a5b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.351637:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787892961.351642:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+4:6499:x1874741493269760:12345-0@lo:104: Request processed in 48us (10014us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892961.351649:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787892961.351661:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787892961.351667:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+3:6499:x1874741493269888:12345-0@lo:104: 00010000:00010000:3.0:1787892961.351688:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf0a38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0a3f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.351720:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787892961.351725:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+3:6499:x1874741493269888:12345-0@lo:104: Request processed in 59us (9988us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892961.351732:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:2.0:1787892961.352151:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9c147d200/0x9232577658cf09f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf09f2 expref: 21 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.352165:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc9c147d200/0x9232577658cf09f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf09f2 expref: 21 pid: 6497 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892961.352248:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67a9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6499:1874741493270144:0@lo:104: 00000100:00100000:2.0:1787892961.352287:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787892961.352305:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9dd69d800/0x9232577658cf09ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf09b3 expref: 21 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.352314:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc9dd69d800/0x9232577658cf09ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf09b3 expref: 21 pid: 6499 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892961.352323:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67a8e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6499:1874741493270272:0@lo:104: 00000100:00100000:2.0:1787892961.352415:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787892961.352433:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9edb31600/0x9232577658cf0990 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf0989 expref: 21 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.352442:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc9edb31600/0x9232577658cf0990 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf0989 expref: 21 pid: 6500 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892961.352450:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67a9f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6499:1874741493270400:0@lo:104: 00000100:00100000:2.0:1787892961.352466:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c5ffe840 going to sleep for 11 seconds 00000100:00100000:2.0:1787892961.352486:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67a8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6499:1874741493269632:0@lo:104: 00000100:00100000:2.0:1787892961.352511:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67a9180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6499:1874741493269760:0@lo:104: 00000100:00100000:2.0:1787892961.352519:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67aaa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6499:1874741493269888:0@lo:104: 00010000:00010000:3.0:1787892961.352583:0:8435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787892961.352590:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf0a7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0a85 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.352597:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd728200 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:3.0:1787892961.352601:0:8435:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf0a7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf0a85 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.352610:0:8435:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf0a7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf0a85 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787892961.352617:0:8435:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf0a7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf0a85 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787892961.352623:0:8435:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787892961.352692:0:8435:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf0a7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0a85 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.352699:0:8435:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787892961.352716:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf0a7e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0a85 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.352724:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf0a7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0a85 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.352745:0:8435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787892961.352748:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31c00/0x9232577658cf0a54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0a5b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.352753:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31c00 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:3.0:1787892961.352756:0:8435:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31c00/0x9232577658cf0a54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf0a5b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.352762:0:8435:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31c00/0x9232577658cf0a54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf0a5b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787892961.352768:0:8435:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31c00/0x9232577658cf0a54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf0a5b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787892961.352773:0:8435:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787892961.355300:0:8435:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31c00/0x9232577658cf0a54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0a5b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.355318:0:8435:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787892961.355332:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31c00/0x9232577658cf0a54 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0a5b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.355406:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31c00/0x9232577658cf0a54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0a5b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.355419:0:8435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787892961.355424:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf0a38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0a3f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.355441:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c147ce00 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:3.0:1787892961.355444:0:8435:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf0a38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf0a3f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.355453:0:8435:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf0a38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf0a3f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787892961.355458:0:8435:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf0a38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf0a3f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787892961.355463:0:8435:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787892961.355521:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493270016 00000100:00100000:1.0:1787892961.355531:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493270016 00000100:00100000:1.0:1787892961.355594:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787892961.355632:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892961.355651:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493270144 00000100:00100000:1.0:1787892961.355654:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493270144 00000100:00100000:1.0:1787892961.355669:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493270272 00010000:00010000:3.0:1787892961.355757:0:8435:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf0a38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0a3f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.355764:0:8435:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787892961.355787:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf0a38 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0a3f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892961.355791:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493270272 00010000:00010000:3.0:1787892961.355794:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf0a38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0a3f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.355802:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892961.355804:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892961.355806:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892961.355807:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493270400 00000100:00100000:1.0:1787892961.355809:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493270400 00010000:00010000:3.0:1787892961.355812:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892961.355818:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892961.355821:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787892961.355831:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493270528:0@lo:103: 00000100:00100000:1.0:1787892961.355834:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ad7764-cf95-4087-88aa-57e4229a8397+6:6499:x1874741493270016:12345-0@lo:104: 00010000:00010000:1.0:1787892961.355843:0:6488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540a00/0x9232577658cf0a0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0a15 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892961.355874:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787892961.355889:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787892961.355894:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ad7764-cf95-4087-88aa-57e4229a8397+6:6499:x1874741493270016:12345-0@lo:104: Request processed in 61us (7361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892961.355901:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787892961.355904:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787892961.355916:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493270656:0@lo:103: 00000100:00100000:1.0:1787892961.355917:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787892961.355922:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ad7764-cf95-4087-88aa-57e4229a8397+5:6499:x1874741493270144:12345-0@lo:104: 00000100:00100000:3.0:1787892961.355936:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892961.356102:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c71b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493270784:0@lo:103: 00000100:00100000:0.0:1787892961.356130:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892961.356163:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493270528 00000100:00100000:0.0:1787892961.356235:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493270528 00010000:00010000:0.0:1787892961.356258:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9edb30e00/0x9232577658cf0a85 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0a7e expref: 22 pid: 6499 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892961.356272:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493270656 00000100:00100000:0.0:1787892961.356275:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493270656 00010000:00010000:0.0:1787892961.356285:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9dd729a00/0x9232577658cf0a5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0a54 expref: 23 pid: 6499 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892961.356294:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493270784 00000100:00100000:0.0:1787892961.356297:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493270784 00010000:00010000:0.0:1787892961.356306:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9c147c800/0x9232577658cf0a3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0a38 expref: 24 pid: 6497 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892961.356317:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787892961.356323:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c71b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ad7764-cf95-4087-88aa-57e4229a8397+24:3630:x1874741493270528:12345-0@lo:103: 00010000:00010000:0.0:1787892961.356332:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787892961.356353:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9edb30e00/0x9232577658cf0a85 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0a7e expref: 24 pid: 6499 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.356363:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9edb30e00/0x9232577658cf0a85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf0a7e expref: 24 pid: 6499 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.356376:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9edb30e00/0x9232577658cf0a85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf0a7e expref: 24 pid: 6499 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.356389:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787892961.356406:0:6488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69c800/0x9232577658cf09f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf09f9 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892961.356415:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c71b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ad7764-cf95-4087-88aa-57e4229a8397+23:3630:x1874741493270528:12345-0@lo:103: Request processed in 93us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892961.356421:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787892961.356436:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787892961.356441:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c71b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ad7764-cf95-4087-88aa-57e4229a8397+22:3630:x1874741493270656:12345-0@lo:103: 00010000:00010000:0.0:1787892961.356448:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787892961.356452:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9dd729a00/0x9232577658cf0a5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0a54 expref: 22 pid: 6499 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.356460:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9dd729a00/0x9232577658cf0a5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf0a54 expref: 22 pid: 6499 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.356469:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9dd729a00/0x9232577658cf0a5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf0a54 expref: 22 pid: 6499 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.356478:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787892961.356516:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c71b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ad7764-cf95-4087-88aa-57e4229a8397+21:3630:x1874741493270656:12345-0@lo:103: Request processed in 74us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892961.356522:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1787892961.356528:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787892961.356533:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ad7764-cf95-4087-88aa-57e4229a8397+5:6499:x1874741493270144:12345-0@lo:104: Request processed in 611us (4245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892961.356534:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787892961.356539:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787892961.356544:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ad7764-cf95-4087-88aa-57e4229a8397+20:3632:x1874741493270784:12345-0@lo:103: 00000100:00100000:1.0:1787892961.356550:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1787892961.356551:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787892961.356566:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9c147c800/0x9232577658cf0a3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0a38 expref: 20 pid: 6497 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.356575:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9c147c800/0x9232577658cf0a3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf0a38 expref: 20 pid: 6497 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.356586:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9c147c800/0x9232577658cf0a3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf0a38 expref: 20 pid: 6497 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.356594:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787892961.356620:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ad7764-cf95-4087-88aa-57e4229a8397+19:3632:x1874741493270784:12345-0@lo:103: Request processed in 76us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892961.356626:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787892961.356654:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c17b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ad7764-cf95-4087-88aa-57e4229a8397+4:6499:x1874741493270272:12345-0@lo:104: 00000100:00100000:0.0:1787892961.356655:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c71b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493270784:0@lo:103: 00010000:00010000:1.0:1787892961.356662:0:6488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69de00/0x9232577658cf09b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf09ba expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892961.356829:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787892961.356834:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c17b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ad7764-cf95-4087-88aa-57e4229a8397+4:6499:x1874741493270272:12345-0@lo:104: Request processed in 279us (4420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892961.356840:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787892961.356870:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787892961.356883:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ad7764-cf95-4087-88aa-57e4229a8397+3:6499:x1874741493270400:12345-0@lo:104: 00010000:00010000:1.0:1787892961.356890:0:6488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729200/0x9232577658cf0989 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0990 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892961.356916:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787892961.356920:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ad7764-cf95-4087-88aa-57e4229a8397+3:6499:x1874741493270400:12345-0@lo:104: Request processed in 39us (1291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892961.356925:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1787892961.357096:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787892961.357102:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540a00/0x9232577658cf0a0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0a15 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.357110:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540a00 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:0.0:1787892961.357114:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540a00/0x9232577658cf0a0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf0a15 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.357123:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540a00/0x9232577658cf0a0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf0a15 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787892961.357130:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540a00/0x9232577658cf0a0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf0a15 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787892961.357146:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787892961.357258:0:8435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787892961.357263:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69c800/0x9232577658cf09f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf09f9 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.357271:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd69c800 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:3.0:1787892961.357274:0:8435:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69c800/0x9232577658cf09f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf09f9 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.357281:0:8435:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69c800/0x9232577658cf09f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf09f9 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787892961.357288:0:8435:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69c800/0x9232577658cf09f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf09f9 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787892961.357294:0:8435:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1787892961.357365:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67abb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6499:1874741493270016:0@lo:104: 00000100:00100000:2.0:1787892961.357375:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67a9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6499:1874741493270144:0@lo:104: 00000100:00100000:2.0:1787892961.357382:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67a8e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6499:1874741493270272:0@lo:104: 00000100:00100000:2.0:1787892961.357390:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67a9f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6499:1874741493270400:0@lo:104: 00010000:00010000:2.0:1787892961.357416:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fc9dd729400/0x9232577658cf0a9a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.357519:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540a00/0x9232577658cf0a0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0a15 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.357526:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787892961.357544:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540a00/0x9232577658cf0a0e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0a15 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892961.357550:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493270912:0@lo:103: 00010000:00010000:0.0:1787892961.357551:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540a00/0x9232577658cf0a0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0a15 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.357573:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787892961.357577:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69de00/0x9232577658cf09b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf09ba expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.357582:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd69de00 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:0.0:1787892961.357585:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69de00/0x9232577658cf09b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf09ba expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.357592:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69de00/0x9232577658cf09b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf09ba expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892961.357594:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:0.0:1787892961.357598:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69de00/0x9232577658cf09b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf09ba expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787892961.357604:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787892961.357616:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69de00/0x9232577658cf09b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf09ba expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.357621:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787892961.357647:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69de00/0x9232577658cf09b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf09ba expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.357654:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69de00/0x9232577658cf09b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf09ba expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.357667:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787892961.357670:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729200/0x9232577658cf0989 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0990 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.357676:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd729200 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:0.0:1787892961.357679:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729200/0x9232577658cf0989 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf0990 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.357686:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729200/0x9232577658cf0989 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf0990 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787892961.357691:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729200/0x9232577658cf0989 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf0990 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787892961.357696:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787892961.357710:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729200/0x9232577658cf0989 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0990 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.357715:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787892961.357720:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729200/0x9232577658cf0989 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0990 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.357725:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729200/0x9232577658cf0989 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0990 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.357733:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787892961.357739:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787892961.357741:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787892961.357754:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493270912 00000100:00100000:0.0:1787892961.357759:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493270912 00010000:00010000:0.0:1787892961.357778:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9fe541200/0x9232577658cf0a15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0a0e expref: 19 pid: 6499 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892961.357798:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787892961.357806:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e73450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ad7764-cf95-4087-88aa-57e4229a8397+19:3633:x1874741493270912:12345-0@lo:103: 00010000:00010000:0.0:1787892961.357814:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787892961.357819:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9fe541200/0x9232577658cf0a15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0a0e expref: 19 pid: 6499 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.357827:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9fe541200/0x9232577658cf0a15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf0a0e expref: 19 pid: 6499 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.357837:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9fe541200/0x9232577658cf0a15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf0a0e expref: 19 pid: 6499 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.357847:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787892961.357875:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e73450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ad7764-cf95-4087-88aa-57e4229a8397+18:3633:x1874741493270912:12345-0@lo:103: Request processed in 71us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892961.357881:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787892961.357926:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493270912:0@lo:103: 00000100:00100000:1.0:1787892961.357945:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493271168:0@lo:103: 00000100:00100000:1.0:1787892961.357971:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892961.357997:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787892961.358002:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493271040:0@lo:103: 00000100:00100000:0.0:1787892961.358002:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493271168 00000100:00100000:0.0:1787892961.358005:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493271168 00000100:00100000:1.0:1787892961.358022:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787892961.358027:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9edb31600/0x9232577658cf0990 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0989 expref: 18 pid: 6500 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892961.358039:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493271040 00000100:00100000:0.0:1787892961.358047:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493271040 00010000:00010000:0.0:1787892961.358059:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9dd69d800/0x9232577658cf09ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf09b3 expref: 19 pid: 6499 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892961.358072:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787892961.358077:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ad7764-cf95-4087-88aa-57e4229a8397+19:3631:x1874741493271168:12345-0@lo:103: 00010000:00010000:0.0:1787892961.358083:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787892961.358087:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9edb31600/0x9232577658cf0990 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0989 expref: 19 pid: 6500 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.358095:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9edb31600/0x9232577658cf0990 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf0989 expref: 19 pid: 6500 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.358104:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9edb31600/0x9232577658cf0990 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf0989 expref: 19 pid: 6500 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.358114:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787892961.358147:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ad7764-cf95-4087-88aa-57e4229a8397+18:3631:x1874741493271168:12345-0@lo:103: Request processed in 70us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892961.358153:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787892961.358165:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787892961.358289:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ad7764-cf95-4087-88aa-57e4229a8397+17:3631:x1874741493271040:12345-0@lo:103: 00010000:00010000:0.0:1787892961.358297:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787892961.358302:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9dd69d800/0x9232577658cf09ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf09b3 expref: 17 pid: 6499 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.358310:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9dd69d800/0x9232577658cf09ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf09b3 expref: 17 pid: 6499 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.358320:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9dd69d800/0x9232577658cf09ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf09b3 expref: 17 pid: 6499 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.358335:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787892961.358357:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ad7764-cf95-4087-88aa-57e4229a8397+16:3631:x1874741493271040:12345-0@lo:103: Request processed in 70us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892961.358363:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1787892961.358735:0:8435:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69c800/0x9232577658cf09f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf09f9 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.358743:0:8435:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787892961.358763:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69c800/0x9232577658cf09f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf09f9 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.358770:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69c800/0x9232577658cf09f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf09f9 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.358784:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892961.358786:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892961.358787:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787892961.358806:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493270656:0@lo:103: 00000100:00100000:3.0:1787892961.358824:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493270528:0@lo:103: 00010000:00010000:3.0:1787892961.358844:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787892961.358864:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787892961.358870:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c71b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493271296:0@lo:103: 00000100:00100000:3.0:1787892961.358896:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892961.358926:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493271296 00000100:00100000:3.0:1787892961.358930:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493271296 00010000:00010000:3.0:1787892961.358945:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9c147d200/0x9232577658cf09f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf09f2 expref: 16 pid: 6497 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892961.358964:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787892961.358971:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c71b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ad7764-cf95-4087-88aa-57e4229a8397+16:3633:x1874741493271296:12345-0@lo:103: 00010000:00010000:3.0:1787892961.358978:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787892961.358982:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9c147d200/0x9232577658cf09f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf09f2 expref: 16 pid: 6497 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.358992:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9c147d200/0x9232577658cf09f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf09f2 expref: 16 pid: 6497 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.359002:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9c147d200/0x9232577658cf09f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf09f2 expref: 16 pid: 6497 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.359108:0:6492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fc9dd729400/0x9232577658cf0a9a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.359117:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9dd729400/0x9232577658cf0a9a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.359131:0:6492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc9dd729400/0x9232577658cf0a9a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.359144:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc9dd729400/0x9232577658cf0a9a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.359151:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fc9dd729400/0x9232577658cf0a9a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.359157:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fc9dd729400/0x9232577658cf0a9a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.359162:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd729400 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:3.0:1787892961.359166:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fc9dd729400/0x9232577658cf0a9a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.359278:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fc9dd729400/0x9232577658cf0a9a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.359357:0:6499:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fc9dd729400/0x9232577658cf0a9a lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.359366:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fc9dd729400/0x9232577658cf0a9a lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787892961.359373:0:6499:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787892961.360895:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493271040:0@lo:103: 00000100:00100000:0.0:1787892961.360909:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493271168:0@lo:103: 00010000:00010000:3.0:1787892961.361077:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fc9dd729400/0x9232577658cf0a9a lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.361090:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9dd729400/0x9232577658cf0a9a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.361109:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787892961.361322:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c71b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493271296:0@lo:103: 00000100:00100000:2.0:1787892961.361393:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ec8bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+15:9496:x1874741493269504:12345-0@lo:253: Request processed in 27377us (27619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892961.361403:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787892961.361460:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c71b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ad7764-cf95-4087-88aa-57e4229a8397+14:3633:x1874741493271296:12345-0@lo:103: Request processed in 2488us (2561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892961.361467:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787892961.361906:0:9496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:9496:1874741493269504:0@lo:253: 10000000:01000000:0.0:1787892961.361919:0:9496:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787892961.361922:0:9496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787892961.361924:0:9496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787892961.361926:0:9496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787892961.361927:0:9496:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1787892961.361929:0:9496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787892961.361930:0:9496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787892961.361932:0:9496:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787892961.361933:0:9496:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787892961.361935:0:9496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787892961.361936:0:9496:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787892961.361952:0:9496:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fc9e70bc000 from lustre-OST0001 10000000:01000000:0.0:1787892961.361981:0:9496:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787892961.361985:0:9496:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787892961.361994:0:9496:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fc9e2e3b370 local copy 10000000:01000000:0.0:1787892961.361998:0:9496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787892961.362091:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31400/0x9232577658cf0aa1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.362103:0:9496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31400/0x9232577658cf0aa1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.362113:0:9496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31400/0x9232577658cf0aa1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892961.362137:0:9496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:9496:1874741493271424:0@lo:101: 00000100:00100000:0.0:1787892961.362241:0:9496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892961.362315:0:9496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fd080540 going to sleep for 11 seconds 00000100:00100000:3.0:1787892961.362675:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493271424 00000100:00100000:3.0:1787892961.362683:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493271424 00000100:00100000:3.0:1787892961.362753:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787892961.362762:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ec8b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+14:9496:x1874741493271424:12345-0@lo:101: 00010000:00010000:3.0:1787892961.362781:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787892961.362793:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9c147c200/0x9232577658cf0aa8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0aa1 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.362815:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9c147c200/0x9232577658cf0aa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0aa1 expref: 15 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.362825:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9c147c200/0x9232577658cf0aa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0aa1 expref: 15 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.362833:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9c147c200, rc 0) 00000100:00100000:3.0:1787892961.362867:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ec8b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+15:9496:x1874741493271424:12345-0@lo:101: Request processed in 106us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892961.362873:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787892961.362939:0:9496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:9496:1874741493271424:0@lo:101: 00010000:00010000:0.0:1787892961.362951:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31400/0x9232577658cf0aa1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x9232577658cf0aa8 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.362959:0:9496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31400/0x9232577658cf0aa1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9232577658cf0aa8 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892961.363051:0:9496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:9496:1874741493271552:0@lo:501: 00000100:00100000:0.0:1787892961.363075:0:9496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892961.363097:0:9496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fd080540 going to sleep for 11 seconds 00000100:00100000:3.0:1787892961.363230:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493271552 00000100:00100000:3.0:1787892961.363235:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493271552 00000100:00100000:3.0:1787892961.363261:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787892961.363267:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ec8b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+15:9496:x1874741493271552:12345-0@lo:501: 00000100:00100000:3.0:1787892961.363319:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ec8b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+15:9496:x1874741493271552:12345-0@lo:501: Request processed in 51us (243us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787892961.363325:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787892961.363386:0:9496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:9496:1874741493271552:0@lo:501: 10000000:01000000:0.0:1787892961.363397:0:9496:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.135@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787892961.363413:0:9496:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.135@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787892961.363418:0:9496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31400/0x9232577658cf0aa1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9232577658cf0aa8 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.363425:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31400/0x9232577658cf0aa1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9232577658cf0aa8 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.363431:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31400/0x9232577658cf0aa1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9232577658cf0aa8 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.363453:0:9496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787892961.363482:0:9496:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fc9e70bc000 10000000:01000000:0.0:1787892961.363486:0:9496:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787892961.363515:0:9496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787892961.363518:0:9496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787892961.363523:0:9496:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787892961.363525:0:9496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787892961.363539:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31600/0x9232577658cf0aaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.363546:0:9496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31600/0x9232577658cf0aaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.363553:0:9496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31600/0x9232577658cf0aaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892961.363574:0:9496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:9496:1874741493271680:0@lo:101: 00000100:00100000:0.0:1787892961.363598:0:9496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892961.363609:0:9496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fd080e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787892961.363661:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493271680 00000100:00100000:3.0:1787892961.363666:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493271680 00000100:00100000:3.0:1787892961.363694:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787892961.363701:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ec8b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+15:9496:x1874741493271680:12345-0@lo:101: 00010000:00010000:3.0:1787892961.363708:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787892961.363715:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9c147d600/0x9232577658cf0ab6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0aaf expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.363740:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9c147d600/0x9232577658cf0ab6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0aaf expref: 16 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.363748:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9c147d600/0x9232577658cf0ab6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0aaf expref: 16 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.363754:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9c147d600, rc 0) 00000100:00100000:3.0:1787892961.363779:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ec8b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+16:9496:x1874741493271680:12345-0@lo:101: Request processed in 79us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892961.363784:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00010000:00010000:3.0:1787892961.363805:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787892961.363810:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31400/0x9232577658cf0aa1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9232577658cf0aa8 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.363817:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31400 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:3.0:1787892961.363820:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31400/0x9232577658cf0aa1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9232577658cf0aa8 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.363827:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31400/0x9232577658cf0aa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x9232577658cf0aa8 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787892961.363834:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31400/0x9232577658cf0aa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x9232577658cf0aa8 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787892961.363839:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787892961.363855:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31400/0x9232577658cf0aa1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9232577658cf0aa8 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.363862:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787892961.363884:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31400/0x9232577658cf0aa1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9232577658cf0aa8 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.363892:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31400/0x9232577658cf0aa1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9232577658cf0aa8 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.363904:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892961.363906:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892961.363908:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787892961.363915:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787892961.363925:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c71b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493271808:0@lo:103: 00000100:00100000:3.0:1787892961.363950:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892961.363980:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493271808 00000100:00100000:3.0:1787892961.363984:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493271808 00000100:00100000:3.0:1787892961.364009:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787892961.364105:0:9496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:9496:1874741493271680:0@lo:101: 00010000:00010000:0.0:1787892961.364115:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31600/0x9232577658cf0aaf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0ab6 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.364123:0:9496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31600/0x9232577658cf0aaf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0ab6 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892961.364246:0:9496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:9496:1874741493271936:0@lo:501: 00000100:00100000:0.0:1787892961.364269:0:9496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892961.364281:0:9496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fd080e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787892961.364318:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c71b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ad7764-cf95-4087-88aa-57e4229a8397+16:3632:x1874741493271808:12345-0@lo:103: 00010000:00010000:3.0:1787892961.364328:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787892961.364339:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9c147c200/0x9232577658cf0aa8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9232577658cf0aa1 expref: 16 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.364349:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787892961.364416:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c71b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ad7764-cf95-4087-88aa-57e4229a8397+15:3632:x1874741493271808:12345-0@lo:103: Request processed in 100us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892961.364422:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787892961.364438:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493271936 00000100:00100000:3.0:1787892961.364441:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493271936 00000100:00100000:3.0:1787892961.364461:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787892961.364467:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+15:9496:x1874741493271936:12345-0@lo:501: 00000100:00100000:3.0:1787892961.364580:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+15:9496:x1874741493271936:12345-0@lo:501: Request processed in 113us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892961.364591:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787892961.364780:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c71b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493271808:0@lo:103: 00000100:00100000:0.0:1787892961.364826:0:9496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:9496:1874741493271936:0@lo:501: 00000100:00100000:0.0:1787892961.364850:0:9496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:9496:1874741493272064:0@lo:503: 00000100:00100000:0.0:1787892961.364886:0:9496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892961.364946:0:9496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fd080e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787892961.367071:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493272064 00000100:00100000:3.0:1787892961.367085:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493272064 00000100:00100000:0.0:1787892961.367242:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787892961.367252:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+15:9496:x1874741493272064:12345-0@lo:503: 00000100:00100000:0.0:1787892961.367415:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+15:9496:x1874741493272064:12345-0@lo:503: Request processed in 164us (2528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892961.367422:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787892961.367617:0:9496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:9496:1874741493272064:0@lo:503: 00000040:00080000:2.0:1787892961.367849:0:9496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787892961.367906:0:9496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:9496:1874741493272192:0@lo:502: 00000100:00100000:2.0:1787892961.367941:0:9496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892961.367976:0:9496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c5ffe000 going to sleep for 11 seconds 00000100:00100000:0.0:1787892961.368103:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493272192 00000100:00100000:0.0:1787892961.368107:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493272192 00000100:00100000:0.0:1787892961.368132:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787892961.368139:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+15:9496:x1874741493272192:12345-0@lo:502: 00000100:00100000:0.0:1787892961.368223:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+15:9496:x1874741493272192:12345-0@lo:502: Request processed in 82us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892961.368230:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787892961.368290:0:9496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:9496:1874741493272192:0@lo:502: 00000040:00080000:2.0:1787892961.368479:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787892961.368519:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787892961.368536:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787892961.368550:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787892961.368578:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787892961.368597:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787892961.368618:0:9496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:9496:1874741493272320:0@lo:502: 00000100:00100000:2.0:1787892961.368651:0:9496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892961.368683:0:9496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c5ffe000 going to sleep for 11 seconds 00000100:00100000:1.0:1787892961.368742:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493272320 00000100:00100000:1.0:1787892961.368748:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493272320 00000100:00100000:1.0:1787892961.368783:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787892961.368791:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+15:9496:x1874741493272320:12345-0@lo:502: 00000100:00100000:1.0:1787892961.368867:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+15:9496:x1874741493272320:12345-0@lo:502: Request processed in 76us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892961.368874:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787892961.368976:0:9496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:9496:1874741493272320:0@lo:502: 00000040:00080000:2.0:1787892961.369089:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787892961.369098:0:9496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:0.0:1787892961.369744:0:9507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787892961.369753:0:9507:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1787892961.369760:0:9507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787892961.369762:0:9507:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787892961.369767:0:9507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787892961.369790:0:9507:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9fc8c71b99b8) 00000020:00000080:0.0:1787892961.369812:0:9507:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787892961.369818:0:9507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787892961.369892:0:9507:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc9e70bc000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787892961.369901:0:9507:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787892961.369909:0:9507:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9232577658cf0ac4 00010000:00010000:0.0:1787892961.374205:0:9507:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:0.0:1787892961.374484:0:9507:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1787892961.376688:0:9507:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1787892961.376985:0:9507:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1787892961.380907:0:9507:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1787892961.381193:0:9507:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1787892961.385677:0:9507:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1787892961.387515:0:9507:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787892961.387526:0:9507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787892961.387533:0:9507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787892961.387535:0:9507:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787892961.387539:0:9507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787892961.387542:0:9507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787892961.387544:0:9507:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787892961.387547:0:9507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787892961.387550:0:9507:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787892961.387583:0:9507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787892961.387586:0:9507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787892961.387588:0:9507:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787892961.387591:0:9507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787892961.387768:0:9496:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1787892961.387795:0:9496:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787892961.387817:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31600/0x9232577658cf0aaf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0ab6 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892961.387835:0:9496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31600/0x9232577658cf0aaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0ab6 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787892961.387844:0:9496:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc9e70bc000 from 1 10000000:01000000:1.0:1787892961.387847:0:9496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787892961.387880:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540c00/0x9232577658cf0acb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892961.387889:0:9496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540c00/0x9232577658cf0acb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892961.387900:0:9496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540c00/0x9232577658cf0acb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892961.387922:0:9496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f70a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:9496:1874741493272448:0@lo:101: 00000100:00100000:1.0:1787892961.387985:0:9496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892961.388031:0:9496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c4d87f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787892961.390168:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493272448 00000100:00100000:0.0:1787892961.390179:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493272448 00000100:00100000:0.0:1787892961.390235:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787892961.390245:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+15:9496:x1874741493272448:12345-0@lo:101: 00010000:00010000:0.0:1787892961.390261:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787892961.390277:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9edb30e00/0x9232577658cf0ad2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0acb expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.390305:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9edb30e00/0x9232577658cf0ad2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0acb expref: 16 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.390316:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9edb30e00/0x9232577658cf0ad2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0acb expref: 16 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.390325:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb30e00, rc 0) 00000100:00100000:0.0:1787892961.390396:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+16:9496:x1874741493272448:12345-0@lo:101: Request processed in 152us (2411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892961.390402:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787892961.390457:0:9496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f70a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:9496:1874741493272448:0@lo:101: 00010000:00010000:0.0:1787892961.390475:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540c00/0x9232577658cf0acb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0ad2 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.390484:0:9496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540c00/0x9232577658cf0acb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0ad2 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892961.390638:0:9496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:9496:1874741493272576:0@lo:501: 00000100:00100000:0.0:1787892961.390667:0:9496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892961.390695:0:9496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d1ea6240 going to sleep for 11 seconds 00000100:00100000:3.0:1787892961.390877:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493272576 00000100:00100000:3.0:1787892961.390882:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493272576 00000100:00100000:3.0:1787892961.390907:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787892961.390914:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+16:9496:x1874741493272576:12345-0@lo:501: 00000100:00100000:3.0:1787892961.391004:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+16:9496:x1874741493272576:12345-0@lo:501: Request processed in 89us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892961.391022:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787892961.391055:0:9496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:9496:1874741493272576:0@lo:501: 00000100:00100000:3.0:1787892961.391079:0:9496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c71b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:9496:1874741493272704:0@lo:503: 00000100:00100000:3.0:1787892961.391112:0:9496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892961.391123:0:9496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c63c53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787892961.391135:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493272704 00000100:00100000:3.0:1787892961.391138:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493272704 00000100:00100000:3.0:1787892961.391162:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787892961.391167:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+16:9496:x1874741493272704:12345-0@lo:503: 00000100:00100000:3.0:1787892961.391237:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+16:9496:x1874741493272704:12345-0@lo:503: Request processed in 69us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892961.391243:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787892961.391279:0:9496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c71b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:9496:1874741493272704:0@lo:503: 00000040:00080000:3.0:1787892961.391516:0:9496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787892961.391580:0:9496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c71b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:9496:1874741493272832:0@lo:502: 00000100:00100000:3.0:1787892961.391610:0:9496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892961.391623:0:9496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c63c53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787892961.391635:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493272832 00000100:00100000:3.0:1787892961.391639:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493272832 00000100:00100000:3.0:1787892961.391659:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787892961.391665:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+16:9496:x1874741493272832:12345-0@lo:502: 00000100:00100000:3.0:1787892961.391735:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+16:9496:x1874741493272832:12345-0@lo:502: Request processed in 69us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892961.391741:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787892961.391778:0:9496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c71b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:9496:1874741493272832:0@lo:502: 00000040:00080000:3.0:1787892961.391965:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787892961.391989:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787892961.392008:0:9496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c71b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:9496:1874741493272960:0@lo:502: 00000100:00100000:3.0:1787892961.392037:0:9496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892961.392050:0:9496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c63c53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787892961.392062:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493272960 00000100:00100000:3.0:1787892961.392066:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493272960 00000100:00100000:3.0:1787892961.392084:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787892961.392090:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+16:9496:x1874741493272960:12345-0@lo:502: 00000100:00100000:3.0:1787892961.392148:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+16:9496:x1874741493272960:12345-0@lo:502: Request processed in 57us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892961.392154:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787892961.392187:0:9496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c71b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:9496:1874741493272960:0@lo:502: 00000040:00080000:3.0:1787892961.392219:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787892961.392226:0:9496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787892961.401655:0:9511:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787892961.401669:0:9511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787892961.401672:0:9511:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787892961.401679:0:9511:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc9e70bc000 00000020:00000080:2.0:1787892961.401682:0:9511:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787892961.401694:0:9511:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787892961.401697:0:9511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787892961.401699:0:9511:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787892961.401701:0:9511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787892961.401854:0:9496:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787892961.401886:0:9496:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787892961.401934:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540c00/0x9232577658cf0acb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0ad2 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.401948:0:9496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540c00/0x9232577658cf0acb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0ad2 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787892961.401995:0:9496:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787892961.401998:0:9496:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fc9e70bc000 10000000:01000000:3.0:1787892961.402001:0:9496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fc9e70bc000 10000000:01000000:3.0:1787892961.402005:0:9496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787892961.402011:0:9496:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc9e70bc000 from 1 10000000:01000000:3.0:1787892961.402080:0:9496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787892961.402115:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c200/0x9232577658cf0ad9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.402125:0:9496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c200/0x9232577658cf0ad9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.402136:0:9496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c200/0x9232577658cf0ad9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892961.402157:0:9496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c71b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:9496:1874741493273088:0@lo:101: 00000100:00100000:3.0:1787892961.402227:0:9496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892961.402270:0:9496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c5e93f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787892961.402319:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493273088 00000100:00100000:0.0:1787892961.402327:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493273088 00000100:00100000:0.0:1787892961.402370:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787892961.402380:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+16:9496:x1874741493273088:12345-0@lo:101: 00010000:00010000:0.0:1787892961.402393:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787892961.402405:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9edb30000/0x9232577658cf0ae0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0ad9 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.402428:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9edb30000/0x9232577658cf0ae0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0ad9 expref: 17 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.402438:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9edb30000/0x9232577658cf0ae0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0ad9 expref: 17 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892961.402447:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb30000, rc 0) 00000100:00100000:0.0:1787892961.402573:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+17:9496:x1874741493273088:12345-0@lo:101: Request processed in 194us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892961.402580:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787892961.402800:0:9496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c71b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:9496:1874741493273088:0@lo:101: 00010000:00010000:1.0:1787892961.402815:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c200/0x9232577658cf0ad9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0ae0 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892961.402824:0:9496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c200/0x9232577658cf0ad9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0ae0 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892961.402908:0:9496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:9496:1874741493273216:0@lo:501: 00000100:00100000:1.0:1787892961.403124:0:9496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892961.403184:0:9496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c4d87e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787892961.403225:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493273216 00000100:00100000:2.0:1787892961.403229:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493273216 00000100:00100000:2.0:1787892961.403289:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787892961.403298:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+17:9496:x1874741493273216:12345-0@lo:501: 00000100:00100000:2.0:1787892961.403405:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+17:9496:x1874741493273216:12345-0@lo:501: Request processed in 108us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892961.403413:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787892961.403467:0:9496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:9496:1874741493273216:0@lo:501: 00000100:00100000:1.0:1787892961.403616:0:9496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:9496:1874741493273344:0@lo:503: 00000100:00100000:1.0:1787892961.403654:0:9496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892961.403871:0:9496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c4d87e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787892961.406433:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493273344 00000100:00100000:0.0:1787892961.406447:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493273344 00000100:00100000:0.0:1787892961.406518:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787892961.406528:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+17:9496:x1874741493273344:12345-0@lo:503: 00000100:00100000:0.0:1787892961.406701:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+17:9496:x1874741493273344:12345-0@lo:503: Request processed in 174us (3045us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892961.406717:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787892961.406845:0:9496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:9496:1874741493273344:0@lo:503: 00000040:00080000:0.0:1787892961.407257:0:9496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787892961.407342:0:9496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:9496:1874741493273472:0@lo:502: 00000100:00100000:0.0:1787892961.407388:0:9496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892961.407427:0:9496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c623ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1787892961.407737:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493273472 00000100:00100000:1.0:1787892961.407743:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493273472 00000100:00100000:1.0:1787892961.407772:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787892961.407780:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+17:9496:x1874741493273472:12345-0@lo:502: 00000100:00100000:1.0:1787892961.407870:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+17:9496:x1874741493273472:12345-0@lo:502: Request processed in 90us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892961.407877:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787892961.408283:0:9496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:9496:1874741493273472:0@lo:502: 00000040:00080000:0.0:1787892961.408466:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787892961.408524:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787892961.408542:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787892961.408566:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787892961.408582:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787892961.408597:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787892961.408623:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787892961.408636:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787892961.408648:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787892961.408660:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787892961.408671:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787892961.408685:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787892961.408698:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787892961.408710:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787892961.408721:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787892961.408732:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787892961.408743:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787892961.408754:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787892961.408766:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787892961.408778:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787892961.408791:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787892961.408804:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787892961.408833:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787892961.408847:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787892961.408860:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1787892961.408872:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1787892961.408883:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1787892961.408895:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1787892961.408907:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1787892961.408918:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1787892961.408929:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1787892961.408942:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1787892961.408954:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1787892961.408966:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1787892961.408978:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1787892961.408991:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1787892961.409004:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:0.0:1787892961.409279:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1787892961.409305:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:0.0:1787892961.409319:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:0.0:1787892961.409332:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:0.0:1787892961.409344:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:0.0:1787892961.409356:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:0.0:1787892961.409368:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:0.0:1787892961.409381:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:0.0:1787892961.409393:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:0.0:1787892961.409427:0:9496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:9496:1874741493273600:0@lo:502: 00000100:00100000:0.0:1787892961.409482:0:9496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892961.409551:0:9496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c623ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1787892961.409636:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493273600 00000100:00100000:1.0:1787892961.409643:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493273600 00000100:00100000:1.0:1787892961.409684:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787892961.409694:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+17:9496:x1874741493273600:12345-0@lo:502: 00000100:00100000:1.0:1787892961.409790:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+17:9496:x1874741493273600:12345-0@lo:502: Request processed in 97us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892961.409798:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787892961.409884:0:9496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:9496:1874741493273600:0@lo:502: 00000040:00080000:0.0:1787892961.409925:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:0.0:1787892961.409933:0:9496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:3.0:1787892961.410743:0:9513:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787892961.410757:0:9513:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9fc9fe144d28) 00000020:00000080:3.0:1787892961.410780:0:9513:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:3.0:1787892961.410853:0:9513:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc9e70bc000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787892961.410857:0:9513:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc9e70bc000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787892961.410859:0:9513:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc9e70bc000 3 00010000:00080000:3.0:1787892961.410883:0:9513:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc9e70be000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.135@tcp at head 00010000:00010000:3.0:1787892961.412795:0:9513:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:3.0:1787892961.412987:0:9513:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787892961.414209:0:9513:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787892961.414224:0:9513:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9232577658cf0aee 00000100:00080000:3.0:1787892961.414234:0:9513:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787892961.414240:0:9513:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fc9e70be000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:3.0:1787892961.414273:0:9513:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c71b2a00 x1874741493273728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787892961.414334:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c71b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3629:1874741493273728:0@lo:38: 00000100:00100000:1.0:1787892961.414403:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892961.414484:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493273728 00000100:00100000:2.0:1787892961.414507:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493273728 00000100:00100000:2.0:1787892961.414541:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787892961.414549:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3629:x1874741493273728:12345-0@lo:38: 00010000:00080000:2.0:1787892961.414583:0:6505:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:2.0:1787892961.414612:0:6505:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9232577658cf0af5 00000004:00100000:2.0:1787892961.414626:0:6505:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787892961.414654:0:6505:0:(import.c:65:import_set_state_nolock()) ffff9fc9ffb44000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1787892961.414718:0:9513:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787892961.414819:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c71b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493273856:0@lo:400: 00000100:00100000:3.0:1787892961.414846:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892961.414864:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c71b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493274368:0@lo:400: 00000100:00100000:3.0:1787892961.414882:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892961.414895:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787892961.414900:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c71b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493273984:0@lo:400: 00000100:00100000:3.0:1787892961.414921:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892961.414936:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c71b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493274496:0@lo:400: 00000100:00100000:3.0:1787892961.414953:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892961.414980:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c71b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493274112:0@lo:400: 00000100:00100000:3.0:1787892961.415000:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892961.415010:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c71b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493274624:0@lo:400: 00000100:00100000:3.0:1787892961.415101:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892961.415119:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787892961.415125:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c71b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493274240:0@lo:400: 00000100:00100000:3.0:1787892961.415143:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892961.415158:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c71b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493274752:0@lo:400: 00000100:00100000:3.0:1787892961.415187:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892961.415215:0:6504:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787892961.415223:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1787892961.415237:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493273984 00000100:00100000:3.0:1787892961.415241:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493273984 00000100:00100000:3.0:1787892961.415269:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493274240 00000100:00100000:3.0:1787892961.415271:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493274240 00000100:00100000:3.0:1787892961.415284:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787892961.415291:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c71b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493273984:12345-0@lo:400: 00000100:00100000:3.0:1787892961.415326:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c71b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493273984:12345-0@lo:400: Request processed in 35us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892961.415333:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787892961.415348:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787892961.415354:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c71b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493274240:12345-0@lo:400: 00000100:00100000:3.0:1787892961.415380:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c71b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493274240:12345-0@lo:400: Request processed in 26us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892961.415386:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787892961.415401:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493274624 00000100:00100000:3.0:1787892961.415404:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493274624 00000100:00100000:3.0:1787892961.415430:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493274752 00000100:00100000:3.0:1787892961.415438:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493274752 00000100:00100000:3.0:1787892961.415459:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787892961.415465:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c71b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493274624:12345-0@lo:400: 00000100:00100000:3.0:1787892961.415512:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c71b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493274624:12345-0@lo:400: Request processed in 48us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892961.415518:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787892961.415530:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787892961.415535:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7526d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493274752:12345-0@lo:400: 00000100:00100000:3.0:1787892961.418214:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7526d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493274752:12345-0@lo:400: Request processed in 2670us (3018us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892961.418230:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1787892961.418274:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787892961.418422:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c71b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493273984:0@lo:400: 00000100:00100000:3.0:1787892961.418473:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c71b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493274240:0@lo:400: 00010000:00080000:3.0:1787892961.418506:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c71b1880 x1874741493274752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892961.418518:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c71b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493274752:0@lo:400: 00010000:00080000:3.0:1787892961.418535:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c71b1f80 x1874741493274624/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892961.418543:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c71b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493274624:0@lo:400: 00000100:00100000:3.0:1787892961.420575:0:6506:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787892961.420592:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493273856 00000100:00100000:3.0:1787892961.420600:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493273856 00000100:00100000:3.0:1787892961.420634:0:6506:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787892961.420639:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493274368 00000100:00100000:3.0:1787892961.420641:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493274368 00000100:00100000:3.0:1787892961.420671:0:6506:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787892961.420677:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493274496 00000100:00100000:3.0:1787892961.420680:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493274496 00000100:00100000:3.0:1787892961.420691:0:6506:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787892961.420695:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493274112 00000100:00100000:3.0:1787892961.420698:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493274112 00000100:00100000:3.0:1787892961.420707:0:6506:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787892961.420727:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787892961.420737:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c71b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493273856:12345-0@lo:400: 00000100:00100000:3.0:1787892961.420816:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c71b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493273856:12345-0@lo:400: Request processed in 81us (5969us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892961.420824:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787892961.420838:0:6506:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787892961.420843:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787892961.420849:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c71b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493274368:12345-0@lo:400: 00000100:00100000:3.0:1787892961.420873:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c71b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493274368:12345-0@lo:400: Request processed in 25us (5990us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892961.420879:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787892961.420887:0:6506:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787892961.420892:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787892961.420897:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c71b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493274496:12345-0@lo:400: 00000100:00100000:3.0:1787892961.420919:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c71b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493274496:12345-0@lo:400: Request processed in 23us (5966us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892961.420925:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787892961.420933:0:6506:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787892961.420938:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787892961.420943:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c71b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493274112:12345-0@lo:400: 00000100:00100000:3.0:1787892961.420972:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c71b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493274112:12345-0@lo:400: Request processed in 29us (5971us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892961.420983:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1787892961.421001:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787892961.421005:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787892961.421102:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c71b0e00 x1874741493274496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892961.421118:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c71b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493274496:0@lo:400: 00010000:00080000:3.0:1787892961.421130:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c71b1500 x1874741493273856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892961.421139:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c71b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493273856:0@lo:400: 00010000:00080000:3.0:1787892961.421148:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c71b3100 x1874741493274368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892961.421156:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c71b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493274368:0@lo:400: 00010000:00080000:3.0:1787892961.421194:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c71b3800 x1874741493274112/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892961.421202:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c71b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493274112:0@lo:400: 00000100:00100000:2.0:1787892961.421528:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1874741493273728:12345-0@lo:38: Request processed in 6977us (7122us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892961.421536:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:01000004:3.0:1787892961.421720:0:9513:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787892961.421735:0:9513:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9fc9fe1419b8) 00000020:00000080:3.0:1787892961.421757:0:9513:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:3.0:1787892961.421829:0:9513:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc9e70bc000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787892961.421833:0:9513:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc9e70bc000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787892961.421835:0:9513:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc9e70bc000 3 00010000:00080000:3.0:1787892961.421860:0:9513:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc9e5eac000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.135@tcp at head 00000100:00080000:2.0:1787892961.424221:0:9516:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9fc8c67a9f80 x1874741493274880/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892961.424235:0:9516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c5ffe780 going to sleep for 0 seconds 00010000:00080000:1.0:1787892961.424326:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c71b2a00 x1874741493273728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787892971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892961.424338:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787892961.424347:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1787892961.424356:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787892961.424360:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787892961.424370:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9e70be000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1787892961.424376:0:3629:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000042e4d36c): req@ffff9fc8c67a9f80 x1874741493274880/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892961.424400:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c71b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3629:1874741493273728:0@lo:38: 00000100:00100000:2.0:1787892961.424591:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892961.424616:0:9516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c5ffe780 going to sleep for 11 seconds 00000100:00100000:1.0:1787892961.424733:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493274880 00000100:00100000:1.0:1787892961.424740:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493274880 00000100:00100000:1.0:1787892961.424797:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787892961.424806:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9516:x1874741493274880:12345-0@lo:901: 00000100:00100000:1.0:1787892961.424898:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9516:x1874741493274880:12345-0@lo:901: Request processed in 92us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892961.424905:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787892961.424958:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787892961.424977:0:9516:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c67a9f80 x1874741493274880/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787892977 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892961.424988:0:9516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67a9f80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9516:1874741493274880:0@lo:901: 00010000:00010000:3.0:1787892961.427984:0:9513:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:3.0:1787892961.428306:0:9513:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1787892961.428358:0:9513:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787892961.428374:0:9513:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x9232577658cf0b03 00000100:00080000:3.0:1787892961.428385:0:9513:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787892961.428390:0:9513:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9fc9e5eac000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:3.0:1787892961.428432:0:9513:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c7525180 x1874741493275008/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787892961.428458:0:9513:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1787892961.428719:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3629:1874741493275008:0@lo:38: 00000100:00100000:1.0:1787892961.428788:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1787892961.428968:0:9513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000100:00100000:3.0:1787892961.429176:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493275008 00000100:00100000:3.0:1787892961.429184:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493275008 00000100:00100000:3.0:1787892961.429223:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787892961.429232:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3629:x1874741493275008:12345-0@lo:38: 00010000:00080000:3.0:1787892961.429257:0:6506:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:3.0:1787892961.429286:0:6506:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x9232577658cf0b0a 00000004:00100000:3.0:1787892961.429302:0:6506:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787892961.429335:0:6506:0:(import.c:65:import_set_state_nolock()) ffff9fc8c5f17000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787892961.429396:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1874741493275008:12345-0@lo:38: Request processed in 163us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892961.429402:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787892961.429440:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c7525180 x1874741493275008/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787892971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892961.429450:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787892961.429457:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1787892961.429464:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787892961.429467:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787892961.429469:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9e5eac000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787892961.429475:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3629:1874741493275008:0@lo:38: 00000020:01000000:2.0:1787892961.430603:0:9496:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:2.0:1787892961.430643:0:9496:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787892961.430663:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c200/0x9232577658cf0ad9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0ae0 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.430675:0:9496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c200/0x9232577658cf0ad9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0ae0 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787892961.430721:0:9496:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787892961.430724:0:9496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787892961.430725:0:9496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787892961.430726:0:9496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787892961.430728:0:9496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787892961.430729:0:9496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787892961.430730:0:9496:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787892961.430732:0:9496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787892961.430733:0:9496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787892961.430735:0:9496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787892961.430736:0:9496:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787892961.430740:0:9496:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1787892961.430742:0:9496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787892961.430744:0:9496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787892961.430750:0:9496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787892961.430751:0:9496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787892961.430752:0:9496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787892961.430753:0:9496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787892961.430753:0:9496:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787892961.430754:0:9496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787892961.430755:0:9496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787892961.430756:0:9496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787892961.430757:0:9496:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787892961.430777:0:9496:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787892961.430793:0:9496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:9496:1874741493275136:0@lo:253: 00000100:00100000:2.0:1787892961.430845:0:9496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892961.430881:0:9496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c5ffe780 going to sleep for 11 seconds 00000100:00100000:1.0:1787892961.430928:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493275136 00000100:00100000:1.0:1787892961.430935:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493275136 00000100:00100000:1.0:1787892961.430977:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787892961.430987:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+17:9496:x1874741493275136:12345-0@lo:253: 20000000:01000000:1.0:1787892961.431010:0:6500:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787892961.431074:0:6500:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787892961.440230:0:6500:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787892961.440257:0:6500:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787892961.440398:0:6520:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787892961.440403:0:6520:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787892961.440425:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fc9dd728c00/0x9232577658cf0b11 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.440443:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9dd69ce00/0x9232577658cf0a07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0a00 expref: 17 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.440451:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0a4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0a46 expref: 17 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.440458:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fc9dd728c00/0x9232577658cf0b11 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.440563:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0a4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf0a46 expref: 17 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.440578:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0a4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf0a46 expref: 17 pid: 6500 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892961.440593:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67a9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6520:1874741493275264:0@lo:104: 00000100:00100000:2.0:1787892961.440665:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787892961.440710:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9dd69ce00/0x9232577658cf0a07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf0a00 expref: 17 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.440719:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc9dd69ce00/0x9232577658cf0a07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf0a00 expref: 17 pid: 6497 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892961.440727:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67aaa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6520:1874741493275392:0@lo:104: 00000100:00100000:2.0:1787892961.440747:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892961.440762:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c5ffef00 going to sleep for 11 seconds 00000100:00100000:2.0:1787892961.440780:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493275264 00000100:00100000:2.0:1787892961.440787:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493275264 00000100:00100000:2.0:1787892961.440819:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493275392 00000100:00100000:2.0:1787892961.440822:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493275392 00000100:00100000:2.0:1787892961.440835:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787892961.440844:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+4:6520:x1874741493275264:12345-0@lo:104: 00010000:00010000:2.0:1787892961.440856:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30800/0x9232577658cf0a46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0a4d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.440903:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787892961.440909:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+4:6520:x1874741493275264:12345-0@lo:104: Request processed in 66us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892961.440916:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787892961.440932:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787892961.440938:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+3:6520:x1874741493275392:12345-0@lo:104: 00010000:00010000:2.0:1787892961.440945:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf0a00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0a07 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.440973:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787892961.440983:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+3:6520:x1874741493275392:12345-0@lo:104: Request processed in 46us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892961.440989:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1787892961.441006:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787892961.441075:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30800/0x9232577658cf0a46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0a4d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.441083:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30800 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:2.0:1787892961.441088:0:6493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30800/0x9232577658cf0a46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf0a4d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.441097:0:6493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30800/0x9232577658cf0a46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf0a4d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787892961.441105:0:6493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30800/0x9232577658cf0a46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf0a4d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892961.441112:0:6493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787892961.441138:0:6493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30800/0x9232577658cf0a46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0a4d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.441145:0:6493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787892961.441162:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30800/0x9232577658cf0a46 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0a4d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.441169:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30800/0x9232577658cf0a46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0a4d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.441179:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787892961.441181:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf0a00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0a07 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.441196:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31200 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:2.0:1787892961.441199:0:6493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf0a00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf0a07 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.441206:0:6493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf0a00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf0a07 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787892961.441212:0:6493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf0a00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf0a07 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892961.441217:0:6493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787892961.441230:0:6493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf0a00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0a07 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.441236:0:6493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787892961.441241:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf0a00 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0a07 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.441249:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf0a00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0a07 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.441260:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892961.441262:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892961.441264:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787892961.441275:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493275520:0@lo:103: 00000100:00100000:2.0:1787892961.441302:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892961.441322:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787892961.441327:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493275648:0@lo:103: 00000100:00100000:2.0:1787892961.441356:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892961.441385:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493275520 00000100:00100000:2.0:1787892961.441389:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493275520 00010000:00010000:2.0:1787892961.441406:0:6490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0a4d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0a46 expref: 18 pid: 6500 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892961.441425:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493275648 00000100:00100000:2.0:1787892961.441428:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493275648 00010000:00010000:2.0:1787892961.441436:0:6490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9dd69ce00/0x9232577658cf0a07 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0a00 expref: 19 pid: 6497 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892961.441448:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787892961.441453:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ad7764-cf95-4087-88aa-57e4229a8397+19:3630:x1874741493275520:12345-0@lo:103: 00010000:00010000:2.0:1787892961.441462:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787892961.441467:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0a4d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0a46 expref: 19 pid: 6500 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.441476:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0a4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf0a46 expref: 19 pid: 6500 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.441513:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787892961.441541:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ad7764-cf95-4087-88aa-57e4229a8397+19:3630:x1874741493275520:12345-0@lo:103: Request processed in 87us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892961.441548:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787892961.441573:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787892961.441580:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ad7764-cf95-4087-88aa-57e4229a8397+18:3630:x1874741493275648:12345-0@lo:103: 00010000:00010000:2.0:1787892961.441587:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787892961.441592:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9dd69ce00/0x9232577658cf0a07 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0a00 expref: 18 pid: 6497 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.441610:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9dd69ce00/0x9232577658cf0a07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf0a00 expref: 18 pid: 6497 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.441622:0:6490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fc9dd728c00/0x9232577658cf0b11 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.441631:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9dd728c00/0x9232577658cf0b11 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787892961.441643:0:6490:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004261666s 00010000:00010000:2.0:1787892961.441647:0:6490:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc9dd728c00/0x9232577658cf0b11 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.441654:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc9dd728c00/0x9232577658cf0b11 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.441661:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fc9dd728c00/0x9232577658cf0b11 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.441669:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fc9dd728c00/0x9232577658cf0b11 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.441674:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd728c00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787892961.441678:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fc9dd728c00/0x9232577658cf0b11 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.441684:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fc9dd728c00/0x9232577658cf0b11 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.441691:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fc9dd728c00/0x9232577658cf0b11 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.441709:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787892961.441730:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ad7764-cf95-4087-88aa-57e4229a8397+18:3630:x1874741493275648:12345-0@lo:103: Request processed in 151us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892961.441736:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787892961.441773:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493275648:0@lo:103: 00000100:00100000:2.0:1787892961.441781:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493275520:0@lo:103: 00010000:00010000:2.0:1787892961.441805:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0a4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf0a46 expref: 17 pid: 6500 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892961.441815:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67a9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6520:1874741493275264:0@lo:104: 00010000:00010000:2.0:1787892961.441822:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9dd69ce00/0x9232577658cf0a07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf0a00 expref: 16 pid: 6497 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892961.441831:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67aaa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6520:1874741493275392:0@lo:104: 00010000:00010000:2.0:1787892961.441843:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fc9dd728c00/0x9232577658cf0b11 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.441852:0:6520:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fc9dd728c00/0x9232577658cf0b11 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.441859:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fc9dd728c00/0x9232577658cf0b11 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892961.441866:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9dd728c00/0x9232577658cf0b11 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892961.441993:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787892961.442059:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+15:9496:x1874741493275136:12345-0@lo:253: Request processed in 11072us (11213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892961.442067:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787892961.442774:0:9496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ad7764-cf95-4087-88aa-57e4229a8397:9496:1874741493275136:0@lo:253: 10000000:01000000:3.0:1787892961.442786:0:9496:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787892961.442789:0:9496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787892961.442790:0:9496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787892961.442792:0:9496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787892961.442793:0:9496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787892961.442795:0:9496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787892961.442796:0:9496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787892961.442798:0:9496:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787892961.442799:0:9496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787892961.442801:0:9496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787892961.442802:0:9496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787892961.442804:0:9496:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787892961.442814:0:9496:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787892961.447010:0:9496:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1787892961.447253:0:9496:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1787892961.447447:0:9496:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1787892961.447700:0:9496:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1787892961.447892:0:9496:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1787892961.448163:0:9496:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1787892961.449310:0:9496:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1787892961.456638:0:9496:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787892961.456651:0:9496:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787892961.456696:0:9496:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787892961.456733:0:9496:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.135@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787892961.456755:0:9496:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1787892961.456775:0:9496:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1787892961.457815:0:9496:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787892961.458000:0:9496:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1787892961.969701:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787892962.254393:0:9570:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787892962.254632:0:9570:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787892962.996852:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787892963.508762:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787892963.508789:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493275776:0@lo:13: 00000100:00100000:0.0:1787892963.508863:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892963.509076:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493275776 00000100:00100000:1.0:1787892963.509085:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493275776 00000100:00080000:3.0:1787892963.509188:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787892963.510117:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787892963.510129:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493275776:12345-0@lo:13: 00002000:00000024:1.0:1787892963.510157:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787892963.510218:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493275776:12345-0@lo:13: Request processed in 92us (1356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892963.510226:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787892963.510483:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787892963.510518:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493275904:0@lo:13: 00000100:00100000:3.0:1787892963.510566:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787892963.512213:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e5f72d80 x1874741493275776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892979 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892963.512244:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493275776:0@lo:13: 00000100:00100000:0.0:1787892963.520586:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493275904 00000100:00100000:0.0:1787892963.520601:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493275904 00000100:00080000:3.0:1787892963.520727:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787892963.521095:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787892963.521106:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493275904:12345-0@lo:13: 00002000:00000024:0.0:1787892963.521134:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787892963.521750:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493275904:12345-0@lo:13: Request processed in 643us (11180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892963.521758:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1787892963.524330:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7525180 x1874741493275904/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892979 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892963.524356:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493275904:0@lo:13: 00010000:00010000:2.0:1787892964.019383:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787892965.043325:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787892965.044019:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493276032:0@lo:41: 00000100:00100000:3.0:1787892965.044101:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892965.044398:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493276032 00000100:00100000:1.0:1787892965.044405:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493276032 00000100:00100000:1.0:1787892965.044457:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787892965.044467:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493276032:12345-0@lo:41: 00000004:00000024:1.0:1787892965.044535:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1787892965.044588:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493276032:12345-0@lo:41: Request processed in 122us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892965.044595:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787892965.044653:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493276032:0@lo:41: 00010000:00010000:3.0:1787892966.068731:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787892966.068837:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787892966.068860:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493276160:0@lo:41: 00000100:00100000:2.0:1787892966.068926:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892966.068984:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493276160 00000100:00100000:2.0:1787892966.068991:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493276160 00000100:00100000:2.0:1787892966.069035:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787892966.069043:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493276160:12345-0@lo:41: 00000004:00000024:2.0:1787892966.069076:0:7865:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1787892966.069117:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493276160:12345-0@lo:41: Request processed in 74us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892966.069124:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787892966.069166:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493276160:0@lo:41: 00000100:00100000:1.0:1787892966.578142:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1874741493276672:0@lo:400: 00000100:00100000:1.0:1787892966.578212:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892966.578268:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c778b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493277184:0@lo:400: 00000100:00100000:1.0:1787892966.578296:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892966.578328:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787892966.578334:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493276544:0@lo:400: 00000100:00100000:1.0:1787892966.578357:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892966.578374:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7788000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1874741493277056:0@lo:400: 00000100:00100000:1.0:1787892966.578398:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892966.578414:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c778ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1874741493277568:0@lo:400: 00000100:00100000:1.0:1787892966.578435:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892966.578465:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493276672 00000100:00100000:1.0:1787892966.578472:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493276672 00000100:00100000:1.0:1787892966.578536:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493277056 00000100:00100000:1.0:1787892966.578540:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493277056 00000100:00100000:1.0:1787892966.578564:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493277568 00000100:00100000:1.0:1787892966.578567:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493277568 00000100:00100000:1.0:1787892966.578583:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787892966.578598:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7789180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1874741493276672:12345-0@lo:400: 00000100:00100000:1.0:1787892966.578650:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7789180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1874741493276672:12345-0@lo:400: Request processed in 52us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892966.578658:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787892966.578676:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787892966.578682:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7789500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1874741493277056:12345-0@lo:400: 00000100:00100000:1.0:1787892966.578708:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7789500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1874741493277056:12345-0@lo:400: Request processed in 27us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892966.578714:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787892966.578725:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787892966.578731:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c778bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1874741493277568:12345-0@lo:400: 00000100:00100000:1.0:1787892966.578757:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c778bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1874741493277568:12345-0@lo:400: Request processed in 26us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892966.578824:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787892966.578844:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493277184 00000100:00100000:1.0:1787892966.578848:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493277184 00000100:00100000:1.0:1787892966.578872:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787892966.578879:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7788700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493277184:12345-0@lo:400: 00000100:00100000:1.0:1787892966.578909:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7788700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493277184:12345-0@lo:400: Request processed in 30us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892966.578915:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787892966.578931:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493276544 00000100:00100000:1.0:1787892966.578935:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493276544 00000100:00100000:1.0:1787892966.578955:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787892966.578960:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c778aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493276544:12345-0@lo:400: 00000100:00100000:1.0:1787892966.578989:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c778aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493276544:12345-0@lo:400: Request processed in 28us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892966.579000:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1787892966.579023:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787892966.579028:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787892966.579056:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493276544:0@lo:400: 00010000:00080000:1.0:1787892966.579069:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7788000 x1874741493277056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892966.579079:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7788000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1874741493277056:0@lo:400: 00010000:00080000:1.0:1787892966.579088:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c778ad80 x1874741493277568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892966.579096:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c778ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1874741493277568:0@lo:400: 00010000:00080000:1.0:1787892966.579105:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ed561180 x1874741493276672/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892966.579112:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1874741493276672:0@lo:400: 00010000:00080000:1.0:1787892966.579120:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c778b480 x1874741493277184/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892966.579127:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c778b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493277184:0@lo:400: 00000100:00100000:2.0:1787892966.579435:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493276288:0@lo:400: 00000100:00100000:2.0:1787892966.579473:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892966.579536:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493276800:0@lo:400: 00000100:00100000:2.0:1787892966.579561:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892966.579578:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7788a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493277312:0@lo:400: 00000100:00100000:2.0:1787892966.579600:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892966.579619:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787892966.579625:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493276416:0@lo:400: 00000100:00100000:2.0:1787892966.579645:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892966.579662:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed563b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493276928:0@lo:400: 00000100:00100000:2.0:1787892966.579692:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892966.579707:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7788380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1874741493277440:0@lo:400: 00000100:00100000:2.0:1787892966.579722:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892966.579751:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493276416 00000100:00100000:2.0:1787892966.579755:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493276416 00000100:00100000:2.0:1787892966.579785:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493276928 00000100:00100000:2.0:1787892966.579787:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493276928 00000100:00100000:2.0:1787892966.579802:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493277440 00000100:00100000:2.0:1787892966.579804:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493277440 00000100:00100000:2.0:1787892966.579815:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787892966.579820:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493276416:12345-0@lo:400: 00000100:00100000:2.0:1787892966.579850:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493276416:12345-0@lo:400: Request processed in 30us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892966.579856:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787892966.579867:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787892966.579872:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493276928:12345-0@lo:400: 00000100:00100000:2.0:1787892966.579891:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493276928:12345-0@lo:400: Request processed in 20us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892966.579896:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787892966.579904:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787892966.579909:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1874741493277440:12345-0@lo:400: 00000100:00100000:2.0:1787892966.579927:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1874741493277440:12345-0@lo:400: Request processed in 18us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892966.579932:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787892966.579945:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493276800 00000100:00100000:2.0:1787892966.579948:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493276800 00000100:00100000:2.0:1787892966.579965:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787892966.579970:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493276800:12345-0@lo:400: 00000100:00100000:2.0:1787892966.580000:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493276800:12345-0@lo:400: Request processed in 30us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892966.580006:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787892966.580023:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493277312 00000100:00100000:2.0:1787892966.580026:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493277312 00000100:00100000:2.0:1787892966.580045:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787892966.580051:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493277312:12345-0@lo:400: 00000100:00100000:2.0:1787892966.580075:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493277312:12345-0@lo:400: Request processed in 25us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892966.580080:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787892966.580098:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787892966.580100:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787892966.580119:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e5f71c00 x1874741493276416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892966.580129:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493276416:0@lo:400: 00010000:00080000:2.0:1787892966.580137:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ed563b80 x1874741493276928/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892966.580144:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed563b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493276928:0@lo:400: 00010000:00080000:2.0:1787892966.580151:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7788380 x1874741493277440/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892966.580159:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7788380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1874741493277440:0@lo:400: 00000100:00100000:2.0:1787892966.580168:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493276800:0@lo:400: 00010000:00080000:2.0:1787892966.580176:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7788a80 x1874741493277312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892966.580183:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7788a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493277312:0@lo:400: 00000100:00100000:1.0:1787892966.580327:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493276288 00000100:00100000:1.0:1787892966.580331:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493276288 00000100:00100000:1.0:1787892966.580366:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787892966.580373:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+15:3632:x1874741493276288:12345-0@lo:400: 00000100:00100000:1.0:1787892966.580406:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+15:3632:x1874741493276288:12345-0@lo:400: Request processed in 34us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892966.580412:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787892966.580447:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493276288:0@lo:400: 00010000:00010000:2.0:1787892967.092755:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787892967.490475:0:9859:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg235-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787892968.113669:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787892968.350334:0:9912:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787892968.350649:0:9912:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787892968.634927:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493277696:0@lo:13: 00000100:00100000:2.0:1787892968.635012:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892968.637647:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493277696 00000100:00100000:3.0:1787892968.637661:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493277696 00000100:00100000:3.0:1787892968.637736:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787892968.637747:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493277696:12345-0@lo:13: 00000100:00100000:1.0:1787892968.637889:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c778b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493277824:0@lo:13: 00000100:00100000:1.0:1787892968.637956:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892968.638003:0:8422:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1787892968.638012:0:8422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1787892968.638927:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493277824 00000100:00100000:1.0:1787892968.638936:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493277824 00000100:00100000:1.0:1787892968.639654:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787892968.639668:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c778ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493277824:12345-0@lo:13: 00002000:00000024:1.0:1787892968.639710:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787892968.639808:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c778ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493277824:12345-0@lo:13: Request processed in 144us (1851us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892968.639816:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00002000:00000024:3.0:1787892968.640044:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787892968.640098:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493277696:12345-0@lo:13: Request processed in 2353us (5085us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892968.640105:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1787892968.642651:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787892968.642706:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7526a00 x1874741493277696/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892984 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892968.642744:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493277696:0@lo:13: 00010000:00080000:1.0:1787892968.642938:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c778b480 x1874741493277824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892984 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892968.642953:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c778b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493277824:0@lo:13: 00010000:00010000:0.0:1787892969.137837:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892970.162033:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787892970.162414:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787892970.162440:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c778b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493277952:0@lo:41: 00000100:00100000:3.0:1787892970.162600:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892970.164271:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493277952 00000100:00100000:0.0:1787892970.164289:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493277952 00000100:00100000:0.0:1787892970.164529:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787892970.164542:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493277952:12345-0@lo:41: 00000004:00000024:0.0:1787892970.164594:0:7865:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1787892970.164781:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493277952:12345-0@lo:41: Request processed in 241us (2180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892970.164790:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787892970.166261:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c778b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493277952:0@lo:41: 00000100:00100000:2.0:1787892971.187111:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493278080:0@lo:41: 00000100:00100000:2.0:1787892971.187180:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892971.187270:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493278080 00000100:00100000:2.0:1787892971.187277:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493278080 00000100:00100000:2.0:1787892971.187322:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787892971.187331:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493278080:12345-0@lo:41: 00000004:00000024:2.0:1787892971.187365:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1787892971.187410:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493278080:12345-0@lo:41: Request processed in 79us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892971.187417:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:2.0:1787892971.187484:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787892971.187532:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493278080:0@lo:41: 10000000:01000000:2.0:1787892971.202060:0:6502:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787892971.202067:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc9fe136000 from 39 10000000:01000000:2.0:1787892971.202073:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787892971.202119:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729a00/0x9232577658cf0b18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892971.202130:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729a00/0x9232577658cf0b18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892971.202141:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729a00/0x9232577658cf0b18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892971.202162:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493278208:0@lo:101: 00000100:00100000:2.0:1787892971.202583:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892971.202645:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c5e93180 going to sleep for 11 seconds 00000100:00100000:1.0:1787892971.202710:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493278208 00000100:00100000:1.0:1787892971.202719:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493278208 00000100:00100000:1.0:1787892971.202775:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787892971.202785:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+15:6502:x1874741493278208:12345-0@lo:101: 00010000:00010000:1.0:1787892971.202798:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787892971.202812:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9fe541e00/0x9232577658cf0b1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0b18 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892971.202850:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9fe541e00/0x9232577658cf0b1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0b18 expref: 16 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892971.202860:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9fe541e00/0x9232577658cf0b1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0b18 expref: 16 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892971.202877:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe541e00, rc 0) 00000100:00100000:1.0:1787892971.202917:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+16:6502:x1874741493278208:12345-0@lo:101: Request processed in 134us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892971.202924:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787892971.203456:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493278208:0@lo:101: 00010000:00010000:2.0:1787892971.203483:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729a00/0x9232577658cf0b18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0b1f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892971.203518:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729a00/0x9232577658cf0b18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0b1f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892971.203587:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493278336:0@lo:501: 00000100:00100000:2.0:1787892971.203619:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892971.203648:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c5e93180 going to sleep for 11 seconds 00000100:00100000:1.0:1787892971.205611:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493278336 00000100:00100000:1.0:1787892971.205624:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493278336 00000100:00100000:1.0:1787892971.205675:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787892971.205686:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+16:6502:x1874741493278336:12345-0@lo:501: 00000100:00100000:1.0:1787892971.205977:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+16:6502:x1874741493278336:12345-0@lo:501: Request processed in 293us (2356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892971.205984:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787892971.213261:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493278336:0@lo:501: 00000100:00100000:2.0:1787892971.213321:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493278464:0@lo:503: 00000100:00100000:2.0:1787892971.213393:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892971.213429:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c5e93180 going to sleep for 11 seconds 00000100:00100000:2.0:1787892971.213450:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493278464 00000100:00100000:2.0:1787892971.213456:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493278464 00000100:00100000:2.0:1787892971.216527:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787892971.216548:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+16:6502:x1874741493278464:12345-0@lo:503: 00000100:00100000:2.0:1787892971.216726:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+16:6502:x1874741493278464:12345-0@lo:503: Request processed in 185us (3332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892971.216734:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787892971.216855:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493278464:0@lo:503: 00000100:00100000:0.0:1787892971.230478:0:9993:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:9993:1874741493278592:0@lo:502: 00000100:00100000:0.0:1787892971.230608:0:9993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892971.230648:0:9993:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d0c4bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787892971.230711:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493278592 00000100:00100000:1.0:1787892971.230719:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493278592 00000100:00100000:1.0:1787892971.230766:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787892971.230775:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+16:9993:x1874741493278592:12345-0@lo:502: 00000100:00100000:1.0:1787892971.230907:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+16:9993:x1874741493278592:12345-0@lo:502: Request processed in 133us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892971.230915:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787892971.231030:0:9993:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:9993:1874741493278592:0@lo:502: 00000100:00100000:2.0:1787892971.231071:0:9993:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67aa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:9993:1874741493278720:0@lo:502: 00000100:00100000:2.0:1787892971.231105:0:9993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892971.231129:0:9993:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c5e93d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787892971.231237:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493278720 00000100:00100000:1.0:1787892971.231242:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493278720 00000100:00100000:1.0:1787892971.231280:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787892971.231288:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+16:9993:x1874741493278720:12345-0@lo:502: 00000100:00100000:1.0:1787892971.231352:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+16:9993:x1874741493278720:12345-0@lo:502: Request processed in 64us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892971.231358:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787892971.231517:0:9993:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67aa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:9993:1874741493278720:0@lo:502: 00000040:00080000:2.0:1787892971.231538:0:9993:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1787892971.231707:0:6502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1787892971.231728:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787892971.231738:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729a00/0x9232577658cf0b18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0b1f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892971.231748:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729a00/0x9232577658cf0b18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0b1f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787892971.231756:0:6502:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787892971.231758:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1787892971.231761:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787892971.231788:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540400/0x9232577658cf0b26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892971.231796:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540400/0x9232577658cf0b26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892971.231806:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540400/0x9232577658cf0b26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892971.231830:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7788000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493278848:0@lo:101: 00000100:00100000:1.0:1787892971.231860:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892971.231889:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9f6d11a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787892971.232190:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493278848 00000100:00100000:0.0:1787892971.232202:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493278848 00000100:00100000:0.0:1787892971.232244:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787892971.232259:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+16:6502:x1874741493278848:12345-0@lo:101: 00010000:00010000:0.0:1787892971.232268:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787892971.232280:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9edb30a00/0x9232577658cf0b2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0b26 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892971.232299:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9edb30a00/0x9232577658cf0b2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0b26 expref: 17 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892971.232308:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9edb30a00/0x9232577658cf0b2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0b26 expref: 17 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892971.232316:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb30a00, rc 0) 00000100:00100000:0.0:1787892971.232347:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+17:6502:x1874741493278848:12345-0@lo:101: Request processed in 90us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892971.232352:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787892971.232604:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7788000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493278848:0@lo:101: 00010000:00010000:1.0:1787892971.232619:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540400/0x9232577658cf0b26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0b2d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892971.232628:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540400/0x9232577658cf0b26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0b2d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892971.232698:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7788000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493278976:0@lo:501: 00000100:00100000:1.0:1787892971.232726:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892971.232750:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9f6d11a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787892971.233131:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493278976 00000100:00100000:0.0:1787892971.233137:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493278976 00000100:00100000:0.0:1787892971.233162:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787892971.233170:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+17:6502:x1874741493278976:12345-0@lo:501: 00000100:00100000:0.0:1787892971.233303:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+17:6502:x1874741493278976:12345-0@lo:501: Request processed in 133us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892971.233310:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787892971.233443:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7788000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493278976:0@lo:501: 00000100:00100000:1.0:1787892971.233481:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7788000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493279104:0@lo:503: 00000100:00100000:1.0:1787892971.233545:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892971.233562:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9f6d11a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787892971.237794:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493279104 00000100:00100000:0.0:1787892971.237807:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493279104 00000100:00100000:0.0:1787892971.237866:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787892971.237877:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+17:6502:x1874741493279104:12345-0@lo:503: 00000100:00100000:0.0:1787892971.238045:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+17:6502:x1874741493279104:12345-0@lo:503: Request processed in 168us (4498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892971.238059:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787892971.244639:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7788000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493279104:0@lo:503: 00000100:00100000:1.0:1787892971.244997:0:9996:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c778b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:9996:1874741493279232:0@lo:502: 00000100:00100000:1.0:1787892971.245076:0:9996:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892971.245120:0:9996:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9f6d11600 going to sleep for 11 seconds 00000100:00100000:2.0:1787892971.245226:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493279232 00000100:00100000:2.0:1787892971.245244:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493279232 00000100:00100000:2.0:1787892971.245304:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787892971.245313:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+17:9996:x1874741493279232:12345-0@lo:502: 00000100:00100000:2.0:1787892971.245427:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+17:9996:x1874741493279232:12345-0@lo:502: Request processed in 115us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892971.245435:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787892971.245621:0:9996:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c778b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:9996:1874741493279232:0@lo:502: 00000020:01000000:1.0:1787892971.245643:0:9996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787892971.245654:0:9996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787892971.245656:0:9996:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787892971.245662:0:9996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787892971.245663:0:9996:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787892971.245678:0:9996:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c778b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:9996:1874741493279360:0@lo:502: 00000100:00100000:1.0:1787892971.245709:0:9996:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892971.245728:0:9996:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9f6d11600 going to sleep for 11 seconds 00000100:00100000:2.0:1787892971.246182:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493279360 00000100:00100000:2.0:1787892971.246187:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493279360 00000100:00100000:2.0:1787892971.246315:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787892971.246324:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+17:9996:x1874741493279360:12345-0@lo:502: 00000100:00100000:2.0:1787892971.246418:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+17:9996:x1874741493279360:12345-0@lo:502: Request processed in 95us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892971.246425:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787892971.246580:0:9996:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c778b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:9996:1874741493279360:0@lo:502: 00000020:01000000:3.0:1787892971.246602:0:9996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787892971.246608:0:9996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787892971.246610:0:9996:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787892971.246617:0:9996:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1787892971.246944:0:6502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1787892971.246968:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787892971.246976:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540400/0x9232577658cf0b26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0b2d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892971.246986:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540400/0x9232577658cf0b26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0b2d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892971.247005:0:6502:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787892971.247007:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc9ed573800 from 39 10000000:01000000:2.0:1787892971.247010:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787892971.247048:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729200/0x9232577658cf0b34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892971.247055:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729200/0x9232577658cf0b34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892971.247063:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729200/0x9232577658cf0b34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892971.247078:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493279488:0@lo:101: 00000100:00100000:2.0:1787892971.247110:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892971.247134:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c5e93180 going to sleep for 11 seconds 00000100:00100000:1.0:1787892971.247260:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493279488 00000100:00100000:1.0:1787892971.247265:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493279488 00000100:00100000:1.0:1787892971.247302:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787892971.247309:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+17:6502:x1874741493279488:12345-0@lo:101: 00010000:00010000:1.0:1787892971.247318:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787892971.247330:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9fe541a00/0x9232577658cf0b3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0b34 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892971.247355:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9fe541a00/0x9232577658cf0b3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0b34 expref: 18 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892971.247365:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9fe541a00/0x9232577658cf0b3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0b34 expref: 18 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892971.247372:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe541a00, rc 0) 00000100:00100000:1.0:1787892971.247412:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+18:6502:x1874741493279488:12345-0@lo:101: Request processed in 104us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892971.247418:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787892971.247582:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493279488:0@lo:101: 00010000:00010000:3.0:1787892971.247595:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729200/0x9232577658cf0b34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0b3b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892971.247603:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729200/0x9232577658cf0b34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0b3b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892971.247656:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7525500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493279616:0@lo:501: 00000100:00100000:3.0:1787892971.247682:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892971.247705:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c77a5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787892971.247815:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493279616 00000100:00100000:2.0:1787892971.247829:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493279616 00000100:00100000:2.0:1787892971.247860:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787892971.247867:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+18:6502:x1874741493279616:12345-0@lo:501: 00000100:00100000:2.0:1787892971.247972:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+18:6502:x1874741493279616:12345-0@lo:501: Request processed in 105us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892971.247978:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787892971.248008:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7525500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493279616:0@lo:501: 00000100:00100000:2.0:1787892971.248046:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493279744:0@lo:503: 00000100:00100000:2.0:1787892971.248082:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892971.248096:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c5e93180 going to sleep for 11 seconds 00000100:00100000:2.0:1787892971.248107:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493279744 00000100:00100000:2.0:1787892971.248119:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493279744 00000100:00100000:2.0:1787892971.248136:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787892971.248142:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+18:6502:x1874741493279744:12345-0@lo:503: 00000100:00100000:2.0:1787892971.248210:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+18:6502:x1874741493279744:12345-0@lo:503: Request processed in 67us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892971.248216:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787892971.248556:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493279744:0@lo:503: 00000100:00100000:3.0:1787892971.249058:0:9997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7527b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:9997:1874741493279872:0@lo:502: 00000100:00100000:3.0:1787892971.249098:0:9997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892971.249129:0:9997:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c77a56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787892971.249223:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493279872 00000100:00100000:1.0:1787892971.249228:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493279872 00000100:00100000:1.0:1787892971.249277:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787892971.249284:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+18:9997:x1874741493279872:12345-0@lo:502: 00000100:00100000:1.0:1787892971.249377:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+18:9997:x1874741493279872:12345-0@lo:502: Request processed in 93us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892971.249384:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787892971.249590:0:9997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7527b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:9997:1874741493279872:0@lo:502: 00000100:00100000:3.0:1787892971.249638:0:9997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7527b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:9997:1874741493280000:0@lo:502: 00000100:00100000:3.0:1787892971.249671:0:9997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892971.249681:0:9997:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c77a56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787892971.249736:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493280000 00000100:00100000:2.0:1787892971.249741:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493280000 00000100:00100000:2.0:1787892971.249770:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787892971.249777:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+18:9997:x1874741493280000:12345-0@lo:502: 00000100:00100000:2.0:1787892971.249860:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+18:9997:x1874741493280000:12345-0@lo:502: Request processed in 83us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892971.249866:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787892971.249901:0:9997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7527b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:9997:1874741493280000:0@lo:502: 00000040:00080000:2.0:1787892971.249918:0:9997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1787892971.249969:0:6502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1787892971.249986:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787892971.249995:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729200/0x9232577658cf0b34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0b3b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892971.250003:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729200/0x9232577658cf0b34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0b3b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892971.250011:0:6502:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787892971.250025:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc9ed573800 from 6 10000000:01000000:2.0:1787892971.250028:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787892971.250049:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf0b42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892971.250066:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf0b42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892971.250075:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf0b42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892971.250087:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493280128:0@lo:101: 00000100:00100000:2.0:1787892971.250112:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892971.250125:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c5c9f480 going to sleep for 11 seconds 00000100:00100000:2.0:1787892971.250140:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493280128 00000100:00100000:2.0:1787892971.250143:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493280128 00000100:00100000:2.0:1787892971.250160:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787892971.250165:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+18:6502:x1874741493280128:12345-0@lo:101: 00010000:00010000:2.0:1787892971.250172:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787892971.250184:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9dd729400/0x9232577658cf0b49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0b42 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892971.250201:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9dd729400/0x9232577658cf0b49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0b42 expref: 19 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892971.250209:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9dd729400/0x9232577658cf0b49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0b42 expref: 19 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892971.250217:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9dd729400, rc 0) 00000100:00100000:2.0:1787892971.250547:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+19:6502:x1874741493280128:12345-0@lo:101: Request processed in 380us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892971.250554:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787892971.250588:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493280128:0@lo:101: 00010000:00010000:2.0:1787892971.250606:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf0b42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0b49 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892971.250614:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf0b42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0b49 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892971.250655:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493280256:0@lo:256: 00000100:00100000:2.0:1787892971.250684:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892971.250698:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9f3517180 going to sleep for 11 seconds 00000100:00100000:2.0:1787892971.250710:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493280256 00000100:00100000:2.0:1787892971.250714:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493280256 00000100:00100000:2.0:1787892971.250732:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787892971.250737:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+19:6502:x1874741493280256:12345-0@lo:256: 20000000:01000000:2.0:1787892971.250748:0:6497:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787892971.250764:0:6497:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787892971.250767:0:6497:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1787892971.250916:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+19:6502:x1874741493280256:12345-0@lo:256: Request processed in 178us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892971.250923:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787892971.250950:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493280256:0@lo:256: 10000000:01000000:2.0:1787892971.250986:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787892971.250991:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf0b42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0b49 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892971.250998:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf0b42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0b49 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892971.251005:0:6502:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1787892971.251139:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:2.0:1787892971.251143:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787892971.251159:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728c00/0x9232577658cf0b50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892971.251167:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728c00/0x9232577658cf0b50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892971.251175:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728c00/0x9232577658cf0b50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892971.251184:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493280384:0@lo:101: 00000100:00100000:2.0:1787892971.251208:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892971.251322:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9f3517180 going to sleep for 11 seconds 00000100:00100000:3.0:1787892971.257860:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493280384 00000100:00100000:3.0:1787892971.257877:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493280384 00000100:00100000:2.0:1787892971.258743:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787892971.258754:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+19:6502:x1874741493280384:12345-0@lo:101: 00010000:00010000:2.0:1787892971.258771:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787892971.258801:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c771ec00/0x9232577658cf0b57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0b50 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892971.258834:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c771ec00/0x9232577658cf0b57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0b50 expref: 20 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892971.258842:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c771ec00/0x9232577658cf0b57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0b50 expref: 20 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892971.258849:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c771ec00, rc 0) 00000100:00100000:2.0:1787892971.258918:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+20:6502:x1874741493280384:12345-0@lo:101: Request processed in 166us (7709us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892971.258925:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787892971.258948:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493280384:0@lo:101: 00010000:00010000:0.0:1787892971.258967:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728c00/0x9232577658cf0b50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0b57 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892971.258983:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728c00/0x9232577658cf0b50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0b57 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892971.259058:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493280512:0@lo:501: 00000100:00100000:0.0:1787892971.259092:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892971.259601:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d0c4b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787892971.262280:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493280512 00000100:00100000:1.0:1787892971.262295:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493280512 00000100:00100000:1.0:1787892971.262372:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787892971.262381:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+20:6502:x1874741493280512:12345-0@lo:501: 00000100:00100000:1.0:1787892971.262762:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+20:6502:x1874741493280512:12345-0@lo:501: Request processed in 381us (3669us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892971.262771:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787892971.263336:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493280512:0@lo:501: 00000100:00100000:2.0:1787892971.263384:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493280640:0@lo:503: 00000100:00100000:2.0:1787892971.263433:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892971.263480:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9f3517600 going to sleep for 11 seconds 00000100:00100000:0.0:1787892971.263575:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493280640 00000100:00100000:0.0:1787892971.263581:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493280640 00000100:00100000:0.0:1787892971.263616:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787892971.263623:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+20:6502:x1874741493280640:12345-0@lo:503: 00000100:00100000:0.0:1787892971.263718:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+20:6502:x1874741493280640:12345-0@lo:503: Request processed in 95us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892971.263724:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787892971.263788:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493280640:0@lo:503: 00000100:00100000:2.0:1787892971.264845:0:9998:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67a9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:9998:1874741493280768:0@lo:502: 00000100:00100000:2.0:1787892971.264898:0:9998:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892971.264926:0:9998:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9f3517e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787892971.264932:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493280768 00000100:00100000:3.0:1787892971.264939:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493280768 00000100:00100000:3.0:1787892971.264981:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787892971.264991:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+20:9998:x1874741493280768:12345-0@lo:502: 00000100:00100000:3.0:1787892971.265105:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+20:9998:x1874741493280768:12345-0@lo:502: Request processed in 115us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892971.265113:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787892971.265123:0:9998:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67a9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:9998:1874741493280768:0@lo:502: 00000020:01000000:2.0:1787892971.265156:0:9998:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787892971.265164:0:9998:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1787892971.265170:0:9998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787892971.265173:0:9998:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787892971.265179:0:9998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787892971.265183:0:9998:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.135@tcp to nid 0x20000c0a8ca87 (192.168.202.135@tcp) 00000020:01000000:2.0:1787892971.265200:0:9998:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1787892971.265201:0:9998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787892971.265224:0:9998:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9fc8c77319b8) 00000020:00000080:2.0:1787892971.265363:0:9998:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1787892971.265372:0:9998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787892971.265437:0:9998:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1787892971.265442:0:9998:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787892971.265447:0:9998:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9232577658cf0b65 00010000:00080000:2.0:1787892971.265481:0:9998:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc9ffb13000@lustre-OST0001-osc-MDT0001: add connection 192.168.202.135@tcp at head 00010000:00010000:2.0:1787892971.265718:0:9998:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:2.0:1787892971.266584:0:9998:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1787892971.266605:0:9998:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1787892971.266794:0:9998:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787892971.266915:0:9998:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787892971.267043:0:9998:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1787892971.267132:0:9998:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1787892971.268189:0:9999:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787892971.268195:0:9999:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787892971.269291:0:9998:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787892971.269303:0:9998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787892971.269341:0:9998:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787892971.269366:0:9998:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9232577658cf0b6c 00000100:00080000:0.0:1787892971.269376:0:9998:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787892971.269381:0:9998:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9fc9ffb13000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:0.0:1787892971.269414:0:9998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9c3e6d180 x1874741493280896/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787892971.269566:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493280896:0@lo:8: 00000100:00100000:3.0:1787892971.269631:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787892971.269717:0:9998:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787892971.269772:0:9998:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787892971.269788:0:9998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787892971.269790:0:9998:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787892971.269793:0:9998:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787892971.269796:0:9998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787892971.269798:0:9998:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787892971.269800:0:9998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787892971.269802:0:9998:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787892971.269833:0:9998:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:9998:1874741493281024:0@lo:502: 00000100:00100000:0.0:1787892971.269873:0:9998:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892971.269900:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493281024 00000100:00100000:0.0:1787892971.269906:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493281024 00000100:00100000:0.0:1787892971.269940:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787892971.269948:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+20:9998:x1874741493281024:12345-0@lo:502: 00000100:00100000:0.0:1787892971.270050:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+20:9998:x1874741493281024:12345-0@lo:502: Request processed in 101us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892971.270057:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787892971.270096:0:9998:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d0c4b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787892971.270116:0:9998:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:9998:1874741493281024:0@lo:502: 00000020:01000000:0.0:1787892971.270139:0:9998:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787892971.270143:0:9998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787892971.270145:0:9998:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787892971.270148:0:9998:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00100000:1.0:1787892971.270705:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493280896 00000100:00100000:1.0:1787892971.270711:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493280896 00000100:00100000:1.0:1787892971.270742:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787892971.270757:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3629:x1874741493280896:12345-0@lo:8: 00010000:00080000:1.0:1787892971.270782:0:8420:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:1.0:1787892971.270808:0:8420:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9232577658cf0b73 00002000:00100000:1.0:1787892971.270833:0:8420:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9fc8c75f8000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1787892971.270837:0:8420:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:1.0:1787892971.270841:0:8420:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1787892971.270898:0:8420:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787892971.271140:0:8420:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1787892971.271164:0:8420:0:(import.c:65:import_set_state_nolock()) ffff9fc8c75fc000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787892971.271650:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7203100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493281536:0@lo:400: 00000100:00100000:2.0:1787892971.271689:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892971.271717:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7201f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1874741493282048:0@lo:400: 00000100:00100000:2.0:1787892971.271750:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892971.271775:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787892971.271797:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493281152:0@lo:400: 00000100:00100000:2.0:1787892971.271829:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892971.271848:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493281664:0@lo:400: 00000100:00100000:2.0:1787892971.271869:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892971.271882:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7203800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1874741493282176:0@lo:400: 00000100:00100000:2.0:1787892971.271905:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892971.271922:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493281280:0@lo:400: 00000100:00100000:2.0:1787892971.271943:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892971.271953:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7200e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493281792:0@lo:400: 00000100:00100000:2.0:1787892971.271973:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892971.271990:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787892971.271994:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493281408:0@lo:400: 00000100:00100000:2.0:1787892971.272014:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892971.272032:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7203b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493281920:0@lo:400: 00000100:00100000:2.0:1787892971.272051:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892971.272090:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493281536 00000100:00100000:2.0:1787892971.272095:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493281536 00000100:00100000:2.0:1787892971.272133:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493282048 00000100:00100000:2.0:1787892971.272137:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493282048 00000100:00100000:2.0:1787892971.272151:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493281152 00000100:00100000:2.0:1787892971.272153:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493281152 00000100:00100000:2.0:1787892971.272162:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493281664 00000100:00100000:2.0:1787892971.272163:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493281664 00000100:00100000:2.0:1787892971.272173:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493282176 00000100:00100000:2.0:1787892971.272176:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493282176 00000100:00100000:2.0:1787892971.272187:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493281280 00000100:00100000:2.0:1787892971.272189:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493281280 00000100:00100000:2.0:1787892971.272203:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787892971.272222:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7201c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493281536:12345-0@lo:400: 00000100:00100000:2.0:1787892971.272263:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7201c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493281536:12345-0@lo:400: Request processed in 42us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892971.272270:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787892971.272285:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787892971.272290:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874741493282048:12345-0@lo:400: 00000100:00100000:2.0:1787892971.272315:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874741493282048:12345-0@lo:400: Request processed in 25us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892971.272322:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787892971.272333:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787892971.272338:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493281152:12345-0@lo:400: 00000100:00100000:2.0:1787892971.272363:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493281152:12345-0@lo:400: Request processed in 24us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892971.272368:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787892971.272377:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787892971.272382:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493281664:12345-0@lo:400: 00000100:00100000:2.0:1787892971.272417:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493281664:12345-0@lo:400: Request processed in 34us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892971.272422:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787892971.272432:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787892971.272438:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1874741493282176:12345-0@lo:400: 00000100:00100000:2.0:1787892971.272488:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1874741493282176:12345-0@lo:400: Request processed in 50us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892971.272517:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787892971.272531:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787892971.272537:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493281280:12345-0@lo:400: 00000100:00100000:2.0:1787892971.272570:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493281280:12345-0@lo:400: Request processed in 33us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892971.272576:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787892971.272604:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493281792 00000100:00100000:2.0:1787892971.272608:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493281792 00000100:00100000:2.0:1787892971.272632:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493281920 00000100:00100000:2.0:1787892971.272636:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493281920 00000100:00100000:2.0:1787892971.272650:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787892971.272656:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493281792:12345-0@lo:400: 00000100:00100000:2.0:1787892971.272686:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493281792:12345-0@lo:400: Request processed in 30us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892971.272691:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787892971.272702:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787892971.272708:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493281920:12345-0@lo:400: 00000100:00100000:2.0:1787892971.272732:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493281920:12345-0@lo:400: Request processed in 26us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892971.272747:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787892971.272768:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493281408 00000100:00100000:2.0:1787892971.272771:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493281408 00000100:00100000:2.0:1787892971.272812:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787892971.272818:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493281408:12345-0@lo:400: 00000100:00100000:2.0:1787892971.272852:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493281408:12345-0@lo:400: Request processed in 34us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892971.272858:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1787892971.272876:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787892971.272880:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787892971.272882:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787892971.272915:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493281408:0@lo:400: 00010000:00080000:2.0:1787892971.272927:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e7203b80 x1874741493281920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892971.272936:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7203b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493281920:0@lo:400: 00010000:00080000:2.0:1787892971.272945:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c67ab100 x1874741493281280/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892971.272951:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493281280:0@lo:400: 00010000:00080000:2.0:1787892971.272960:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e7200e00 x1874741493281792/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892971.272967:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7200e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493281792:0@lo:400: 00010000:00080000:2.0:1787892971.274523:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c67a9f80 x1874741493281152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892971.274542:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493281152:0@lo:400: 00010000:00080000:2.0:1787892971.274579:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e7202a00 x1874741493281664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892971.274588:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493281664:0@lo:400: 00010000:00080000:2.0:1787892971.274600:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e7203800 x1874741493282176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892971.274608:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7203800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1874741493282176:0@lo:400: 00010000:00080000:2.0:1787892971.274621:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e7203100 x1874741493281536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892971.274629:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7203100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493281536:0@lo:400: 00010000:00080000:2.0:1787892971.274640:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e7201f80 x1874741493282048/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892971.274648:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7201f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1874741493282048:0@lo:400: 00000020:01000000:0.0:1787892971.275724:0:6502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:0.0:1787892971.275758:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1787892971.275769:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728c00/0x9232577658cf0b50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0b57 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892971.275782:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728c00/0x9232577658cf0b50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0b57 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787892971.275807:0:6502:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787892971.275809:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc9d909c800 from 39 10000000:01000000:0.0:1787892971.275811:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787892971.275859:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30800/0x9232577658cf0b7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892971.275867:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30800/0x9232577658cf0b7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892971.275877:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30800/0x9232577658cf0b7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892971.275898:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493282304:0@lo:101: 00000100:00100000:0.0:1787892971.275967:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892971.276008:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d0c4b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787892971.276540:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3629:x1874741493280896:12345-0@lo:8: Request processed in 5780us (6906us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892971.276550:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787892971.276582:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493282304 00000100:00100000:1.0:1787892971.276589:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493282304 00000100:00100000:1.0:1787892971.276628:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787892971.276636:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+20:6502:x1874741493282304:12345-0@lo:101: 00010000:00010000:1.0:1787892971.276648:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787892971.276662:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9fe540600/0x9232577658cf0b81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0b7a expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892971.276686:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9fe540600/0x9232577658cf0b81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0b7a expref: 21 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892971.276696:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9fe540600/0x9232577658cf0b81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0b7a expref: 21 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892971.276704:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe540600, rc 0) 00000100:00100000:1.0:1787892971.276753:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+21:6502:x1874741493282304:12345-0@lo:101: Request processed in 118us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892971.276766:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787892971.277694:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493282304:0@lo:101: 00010000:00010000:2.0:1787892971.277716:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30800/0x9232577658cf0b7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0b81 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892971.277727:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30800/0x9232577658cf0b7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0b81 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892971.277803:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493282432:0@lo:501: 00000100:00100000:2.0:1787892971.277845:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892971.277885:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c5c9f480 going to sleep for 11 seconds 00000100:00100000:1.0:1787892971.277941:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493282432 00000100:00100000:1.0:1787892971.277948:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493282432 00000100:00100000:1.0:1787892971.277987:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787892971.277997:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+21:6502:x1874741493282432:12345-0@lo:501: 00000100:00100000:1.0:1787892971.278114:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+21:6502:x1874741493282432:12345-0@lo:501: Request processed in 119us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892971.278122:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787892971.278157:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493282432:0@lo:501: 00000100:00100000:1.0:1787892971.278186:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7789c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493282560:0@lo:503: 00000100:00100000:1.0:1787892971.278238:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892971.278252:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d29e3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787892971.278263:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493282560 00000100:00100000:1.0:1787892971.278266:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493282560 00000100:00100000:1.0:1787892971.278284:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787892971.278290:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+21:6502:x1874741493282560:12345-0@lo:503: 00000100:00100000:1.0:1787892971.278365:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+21:6502:x1874741493282560:12345-0@lo:503: Request processed in 74us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892971.278387:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787892971.278428:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7789c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493282560:0@lo:503: 00000100:00100000:0.0:1787892971.281136:0:10001:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10001:1874741493282688:0@lo:502: 00000100:00100000:0.0:1787892971.281239:0:10001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892971.281283:0:10001:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d0c4bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787892971.281394:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493282688 00000100:00100000:1.0:1787892971.281401:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493282688 00000100:00100000:1.0:1787892971.281448:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787892971.281455:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+21:10001:x1874741493282688:12345-0@lo:502: 00000100:00100000:1.0:1787892971.281609:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+21:10001:x1874741493282688:12345-0@lo:502: Request processed in 153us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892971.281623:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787892971.281792:0:10001:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10001:1874741493282688:0@lo:502: 00000100:00100000:0.0:1787892971.281841:0:10001:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10001:1874741493282816:0@lo:502: 00000100:00100000:0.0:1787892971.281873:0:10001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892971.281892:0:10001:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d0c4bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787892971.282321:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493282816 00000100:00100000:1.0:1787892971.282327:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493282816 00000100:00100000:1.0:1787892971.282366:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787892971.282373:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+21:10001:x1874741493282816:12345-0@lo:502: 00000100:00100000:1.0:1787892971.282475:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+21:10001:x1874741493282816:12345-0@lo:502: Request processed in 93us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892971.282482:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787892971.282596:0:10001:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10001:1874741493282816:0@lo:502: 00000040:00080000:2.0:1787892971.282627:0:10001:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1787892971.282793:0:6502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1787892971.282816:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787892971.282826:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30800/0x9232577658cf0b7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0b81 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892971.282837:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30800/0x9232577658cf0b7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0b81 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787892971.282847:0:6502:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787892971.282849:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc9d909c800 from 6 10000000:01000000:1.0:1787892971.282852:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787892971.282876:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540000/0x9232577658cf0b88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892971.282884:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540000/0x9232577658cf0b88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892971.282893:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540000/0x9232577658cf0b88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892971.282906:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7789c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493282944:0@lo:101: 00000100:00100000:1.0:1787892971.282939:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892971.282998:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c6863480 going to sleep for 11 seconds 00010000:00080000:3.0:1787892971.283196:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9c3e6d180 x1874741493280896/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787892981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892971.283216:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787892971.283224:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1787892971.283232:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787892971.283237:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787892971.283240:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9ffb13000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787892971.283260:0:3629:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787892971.283266:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493280896:0@lo:8: 00000100:00100000:1.0:1787892971.283347:0:10000:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c778b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10000:1874741493283072:0@lo:700: 00000100:00100000:1.0:1787892971.283378:0:10000:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892971.283403:0:10000:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d90b9540 going to sleep for 11 seconds 00000100:00100000:3.0:1787892971.283458:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493283072 00000100:00100000:3.0:1787892971.283474:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493283072 00000100:00100000:3.0:1787892971.283542:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787892971.283551:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7788e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:10000:x1874741493283072:12345-0@lo:700: 00000100:00100000:3.0:1787892971.283586:0:8428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7525c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8428:1874741493283200:0@lo:700: 00000100:00100000:3.0:1787892971.283620:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892971.283637:0:8428:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c77a53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787892971.283669:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493283200 00000100:00100000:3.0:1787892971.283673:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493283200 00000100:00100000:3.0:1787892971.283700:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787892971.283707:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8428:x1874741493283200:12345-0@lo:700: 00000100:00080000:1.0:1787892971.284000:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787892971.284164:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493282944 00000100:00100000:2.0:1787892971.284170:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493282944 00000100:00100000:2.0:1787892971.284212:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787892971.284220:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+21:6502:x1874741493282944:12345-0@lo:101: 00010000:00010000:2.0:1787892971.284229:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787892971.284243:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c771e000/0x9232577658cf0b8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0b88 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892971.284265:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c771e000/0x9232577658cf0b8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0b88 expref: 22 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892971.284276:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c771e000/0x9232577658cf0b8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0b88 expref: 22 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892971.284284:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c771e000, rc 0) 00000100:00100000:2.0:1787892971.284321:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+22:6502:x1874741493282944:12345-0@lo:101: Request processed in 102us (1381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892971.284327:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787892971.284366:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7789c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493282944:0@lo:101: 00010000:00010000:2.0:1787892971.284381:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540000/0x9232577658cf0b88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0b8f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892971.284390:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540000/0x9232577658cf0b88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0b8f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892971.284436:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493283328:0@lo:256: 00000100:00100000:2.0:1787892971.284476:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892971.284519:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c6863480 going to sleep for 11 seconds 00000100:00100000:2.0:1787892971.284532:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493283328 00000100:00100000:2.0:1787892971.284536:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493283328 00000100:00100000:2.0:1787892971.284554:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787892971.284560:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+22:6502:x1874741493283328:12345-0@lo:256: 20000000:01000000:2.0:1787892971.284572:0:6499:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787892971.284599:0:6499:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787892971.284602:0:6499:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1787892971.284677:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+22:6502:x1874741493283328:12345-0@lo:256: Request processed in 117us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892971.284684:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787892971.284712:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493283328:0@lo:256: 10000000:01000000:2.0:1787892971.284751:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787892971.284757:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540000/0x9232577658cf0b88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0b8f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892971.284764:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540000/0x9232577658cf0b88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0b8f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892971.284772:0:6502:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787892971.284774:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1787892971.285111:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787892971.285132:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c771e600/0x9232577658cf0b96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892971.285138:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc8c771e600/0x9232577658cf0b96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892971.285146:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc8c771e600/0x9232577658cf0b96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892971.285164:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493283456:0@lo:101: 00000100:00100000:2.0:1787892971.285187:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892971.285249:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c6863480 going to sleep for 11 seconds 00000004:00080000:2.0:1787892971.285266:0:9999:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787892971.285324:0:9999:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 215106831904ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787892971.285331:0:9999:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1787892971.285880:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493283456 00000100:00100000:0.0:1787892971.285886:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493283456 00000100:00100000:0.0:1787892971.285928:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787892971.285946:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+22:6502:x1874741493283456:12345-0@lo:101: 00010000:00010000:0.0:1787892971.285956:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787892971.285973:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9edb31400/0x9232577658cf0b9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0b96 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892971.285990:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9edb31400/0x9232577658cf0b9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0b96 expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892971.285999:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9edb31400/0x9232577658cf0b9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0b96 expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892971.286007:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb31400, rc 0) 00000100:00100000:0.0:1787892971.286048:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+23:6502:x1874741493283456:12345-0@lo:101: Request processed in 103us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892971.286054:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787892971.286088:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493283456:0@lo:101: 00010000:00010000:0.0:1787892971.286100:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc8c771e600/0x9232577658cf0b96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0b9d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892971.286108:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc8c771e600/0x9232577658cf0b96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0b9d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892971.286163:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493283584:0@lo:501: 00000100:00100000:0.0:1787892971.286196:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892971.286231:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d0c4bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787892971.286243:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493283584 00000100:00100000:0.0:1787892971.286246:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493283584 00000100:00100000:0.0:1787892971.286264:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787892971.286269:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+23:6502:x1874741493283584:12345-0@lo:501: 00000100:00100000:0.0:1787892971.286378:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+23:6502:x1874741493283584:12345-0@lo:501: Request processed in 108us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892971.286393:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787892971.286421:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493283584:0@lo:501: 00000100:00100000:0.0:1787892971.286445:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493283712:0@lo:503: 00000100:00100000:0.0:1787892971.286514:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892971.286527:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d0c4bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787892971.286538:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493283712 00000100:00100000:0.0:1787892971.286542:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493283712 00000100:00100000:0.0:1787892971.286558:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787892971.286563:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+23:6502:x1874741493283712:12345-0@lo:503: 00000100:00100000:0.0:1787892971.286634:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+23:6502:x1874741493283712:12345-0@lo:503: Request processed in 70us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892971.286641:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787892971.286681:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493283712:0@lo:503: 00000100:00100000:2.0:1787892971.290941:0:10002:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10002:1874741493283840:0@lo:502: 00000100:00100000:2.0:1787892971.291024:0:10002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892971.291062:0:10002:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fd02ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1787892971.291256:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493283840 00000100:00100000:0.0:1787892971.291264:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493283840 00000100:00100000:0.0:1787892971.291308:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787892971.291317:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+23:10002:x1874741493283840:12345-0@lo:502: 00000100:00100000:0.0:1787892971.291433:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+23:10002:x1874741493283840:12345-0@lo:502: Request processed in 116us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892971.291440:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787892971.292287:0:10002:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10002:1874741493283840:0@lo:502: 00000020:01000000:2.0:1787892971.292322:0:10002:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787892971.292330:0:10002:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787892971.292336:0:10002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787892971.292338:0:10002:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787892971.292342:0:10002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787892971.292346:0:10002:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.135@tcp to nid 0x20000c0a8ca87 (192.168.202.135@tcp) 00000020:01000000:2.0:1787892971.292367:0:10002:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787892971.292370:0:10002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787892971.292385:0:10002:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9fc8c7733370) 00000020:00000080:2.0:1787892971.292408:0:10002:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:2.0:1787892971.292415:0:10002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787892971.292539:0:10002:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787892971.292545:0:10002:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:2.0:1787892971.292551:0:10002:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9232577658cf0bab 00010000:00080000:2.0:1787892971.292581:0:10002:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc9e71fd000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.135@tcp at head 00010000:00010000:2.0:1787892971.292828:0:10002:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:2.0:1787892971.292961:0:10002:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1787892971.292980:0:10002:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787892971.293139:0:10002:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787892971.293249:0:10002:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787892971.293373:0:10002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1787892971.293522:0:10002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000004:00080000:0.0:1787892971.294254:0:7436:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000040:00080000:2.0:1787892971.298104:0:10003:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787892971.298111:0:10003:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787892971.302614:0:10002:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787892971.302633:0:10002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787892971.302684:0:10002:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787892971.302713:0:10002:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9232577658cf0bb2 00000100:00080000:2.0:1787892971.302724:0:10002:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787892971.302730:0:10002:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fc9e71fd000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:2.0:1787892971.302764:0:10002:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9e711c380 x1874741493283968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787892971.302797:0:10002:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787892971.302859:0:10002:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787892971.302863:0:10002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787892971.302865:0:10002:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787892971.302868:0:10002:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787892971.302872:0:10002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787892971.302873:0:10002:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787892971.302876:0:10002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787892971.302878:0:10002:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787892971.302906:0:10002:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10002:1874741493284096:0@lo:502: 00000100:00100000:3.0:1787892971.303721:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493283968:0@lo:8: 00000100:00100000:3.0:1787892971.303805:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892971.304221:0:10002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892971.304248:0:10002:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9eee58780 going to sleep for 11 seconds 00000100:00100000:2.0:1787892971.304268:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493283968 00000100:00100000:2.0:1787892971.304274:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493283968 00000100:00100000:2.0:1787892971.304306:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787892971.304313:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3629:x1874741493283968:12345-0@lo:8: 00010000:00080000:2.0:1787892971.304353:0:8419:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:2.0:1787892971.304379:0:8419:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9232577658cf0bb9 00002000:00100000:2.0:1787892971.304391:0:8419:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9fc9e71fa000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787892971.304395:0:8419:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1787892971.304398:0:8419:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787892971.304462:0:8419:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:3.0:1787892971.306212:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493284096 00000100:00100000:3.0:1787892971.306225:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493284096 00000100:00100000:3.0:1787892971.306287:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787892971.306296:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+23:10002:x1874741493284096:12345-0@lo:502: 00000100:00100000:3.0:1787892971.306459:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+23:10002:x1874741493284096:12345-0@lo:502: Request processed in 163us (2237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892971.306478:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:2.0:1787892971.306714:0:8419:0:(import.c:65:import_set_state_nolock()) ffff9fc9e71fb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787892971.306758:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3629:x1874741493283968:12345-0@lo:8: Request processed in 2444us (2953us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892971.306766:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787892971.306826:0:10002:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10002:1874741493284096:0@lo:502: 00000020:01000000:2.0:1787892971.306857:0:10002:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787892971.306864:0:10002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787892971.306866:0:10002:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787892971.306872:0:10002:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00010000:00080000:3.0:1787892971.307638:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e711c380 x1874741493283968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787892981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892971.307651:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787892971.307659:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787892971.307667:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787892971.307672:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787892971.307675:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9e71fd000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787892971.307687:0:3629:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787892971.307693:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493283968:0@lo:8: 00000004:00080000:2.0:1787892971.309910:0:10003:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787892971.309993:0:10003:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 215131500987ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787892971.310001:0:10003:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 40000000:02000000:2.0:1787892971.311268:0:6511:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000020:01000000:0.0:1787892971.319946:0:6502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:0.0:1787892971.319982:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787892971.319993:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c771e600/0x9232577658cf0b96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0b9d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892971.320025:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc8c771e600/0x9232577658cf0b96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0b9d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787892971.320071:0:6502:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787892971.320074:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fc9e2e3b370 from 1 10000000:01000000:0.0:1787892971.320077:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787892971.320116:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31c00/0x9232577658cf0bc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892971.320124:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31c00/0x9232577658cf0bc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892971.320134:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31c00/0x9232577658cf0bc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892971.320159:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493284224:0@lo:101: 00000100:00100000:0.0:1787892971.320237:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892971.320276:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d0c4b000 going to sleep for 11 seconds 00000100:00100000:0.0:1787892971.320298:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493284224 00000100:00100000:0.0:1787892971.320305:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493284224 00000100:00100000:0.0:1787892971.320353:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787892971.320363:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+23:6502:x1874741493284224:12345-0@lo:101: 00010000:00010000:0.0:1787892971.320375:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787892971.320388:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9edb30600/0x9232577658cf0bc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0bc0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892971.320409:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9edb30600/0x9232577658cf0bc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0bc0 expref: 24 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892971.320429:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9edb30600/0x9232577658cf0bc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0bc0 expref: 24 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892971.320438:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb30600, rc 0) 00000100:00100000:0.0:1787892971.320488:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+24:6502:x1874741493284224:12345-0@lo:101: Request processed in 126us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892971.320522:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787892971.320567:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493284224:0@lo:101: 00010000:00010000:0.0:1787892971.320582:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31c00/0x9232577658cf0bc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0bc7 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892971.320591:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31c00/0x9232577658cf0bc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0bc7 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892971.320643:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493284352:0@lo:501: 00000100:00100000:0.0:1787892971.320667:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892971.320689:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493284352 00000100:00100000:0.0:1787892971.320693:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493284352 00000100:00100000:0.0:1787892971.320714:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787892971.320721:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+24:6502:x1874741493284352:12345-0@lo:501: 00000100:00100000:0.0:1787892971.320783:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+24:6502:x1874741493284352:12345-0@lo:501: Request processed in 62us (114us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787892971.320789:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787892971.320809:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d0c4b000 going to sleep for 11 seconds 00000100:00100000:0.0:1787892971.320818:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493284352:0@lo:501: 10000000:01000000:0.0:1787892971.320836:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787892971.320846:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31c00/0x9232577658cf0bc0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0bc7 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892971.320854:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31c00/0x9232577658cf0bc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0bc7 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787892971.322254:0:6484:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1787892971.323554:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8428:x1874741493283200:12345-0@lo:700: Request processed in 39782us (39867us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892971.323573:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787892971.324084:0:8428:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7525c00 x1874741493283200/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787892987 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892971.324115:0:8428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7525c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8428:1874741493283200:0@lo:700: 40000000:02000000:3.0:1787892971.324129:0:8428:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:2.0:1787892971.337808:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7525c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493284480:0@lo:13: 00000100:00100000:2.0:1787892971.337881:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1787892971.338000:0:10004:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1787892971.338023:0:10004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7525f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10004:1874741493284608:0@lo:7: 00000100:00100000:3.0:1787892971.338053:0:10004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892971.338071:0:10004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c77a53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787892971.338142:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493284480 00000100:00100000:0.0:1787892971.338150:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493284480 00000100:00100000:0.0:1787892971.338206:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787892971.338215:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3632:x1874741493284480:12345-0@lo:13: 00002000:00000024:0.0:1787892971.338240:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00080000:1.0:1787892971.338652:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:1.0:1787892971.338698:0:9497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1787892971.338705:0:9497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1787892971.338814:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7788e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:10000:x1874741493283072:12345-0@lo:700: Request processed in 55262us (55433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892971.338823:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787892971.338923:0:10000:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c778b100 x1874741493283072/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787892987 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892971.338938:0:10000:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c778b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10000:1874741493283072:0@lo:700: 00000100:00100000:0.0:1787892971.339096:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493284480:12345-0@lo:13: Request processed in 882us (1215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892971.339103:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787892971.340560:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493284608 00000100:00100000:3.0:1787892971.340570:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493284608 00000100:00100000:3.0:1787892971.340622:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787892971.340630:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7525880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:10004:x1874741493284608:12345-0@lo:7: 00000004:00080000:1.0:1787892971.347192:0:10000:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1787892971.347225:0:10000:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7789f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10000:1874741493284864:0@lo:7: 00000100:00100000:1.0:1787892971.347292:0:10000:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892971.347346:0:10000:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d90b9540 going to sleep for 11 seconds 00000100:00100000:0.0:1787892971.347381:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493284864 00000100:00100000:0.0:1787892971.347395:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493284864 00000100:00100000:0.0:1787892971.347478:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787892971.347510:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7789880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:10000:x1874741493284864:12345-0@lo:7: 00010000:00080000:2.0:1787892971.348916:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7525c00 x1874741493284480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892987 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892971.348950:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7525c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493284480:0@lo:13: 00000100:00100000:2.0:1787892971.349003:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787892971.349013:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c778b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493284736:0@lo:13: 00000100:00100000:2.0:1787892971.349072:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1787892971.358682:0:8535:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1787892971.358691:0:8535:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1787892971.358788:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7525880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:10004:x1874741493284608:12345-0@lo:7: Request processed in 18154us (20728us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892971.358798:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1787892971.358888:0:10004:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7525f80 x1874741493284608/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787892987 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892971.358904:0:10004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7525f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10004:1874741493284608:0@lo:7: 00000004:00080000:3.0:1787892971.358917:0:10004:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1787892971.358956:0:10004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7525f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10004:1874741493284992:0@lo:5: 00000100:00100000:3.0:1787892971.358988:0:10004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892971.359021:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493284992 00000100:00100000:3.0:1787892971.359034:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493284992 00000100:00100000:3.0:1787892971.359076:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787892971.359086:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:10004:x1874741493284992:12345-0@lo:5: 00002000:00080000:3.0:1787892971.359111:0:8421:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787892971.359114:0:8421:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787892971.359349:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:10004:x1874741493284992:12345-0@lo:5: Request processed in 265us (360us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787892971.359356:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787892971.359377:0:10004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c77a53c0 going to sleep for 11 seconds 00010000:00080000:3.0:1787892971.359390:0:10004:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7525f80 x1874741493284992/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787892987 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892971.359402:0:10004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7525f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10004:1874741493284992:0@lo:5: 00000004:00080000:3.0:1787892971.359410:0:10004:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1787892971.359434:0:10004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7526680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10004:1874741493285120:0@lo:700: 00000100:00100000:3.0:1787892971.359459:0:10004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892971.359528:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493285120 00000100:00100000:3.0:1787892971.359533:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493285120 00000100:00100000:3.0:1787892971.359562:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787892971.359570:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:10004:x1874741493285120:12345-0@lo:700: 00000100:00100000:3.0:1787892971.360377:0:10004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c77a53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787892971.360987:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493284736 00000100:00100000:0.0:1787892971.360997:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493284736 00000100:00100000:0.0:1787892971.361048:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787892971.361058:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3632:x1874741493284736:12345-0@lo:13: 00002000:00000024:0.0:1787892971.361078:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1787892971.361154:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3632:x1874741493284736:12345-0@lo:13: Request processed in 98us (12082us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892971.361161:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1787892971.363351:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c778b100 x1874741493284736/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892987 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892971.363376:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c778b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493284736:0@lo:13: 00002000:00080000:1.0:1787892971.366862:0:8419:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1787892971.366876:0:8419:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1787892971.366973:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7789880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:10000:x1874741493284864:12345-0@lo:7: Request processed in 19481us (19676us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892971.366984:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1787892971.367042:0:10000:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7789f80 x1874741493284864/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787892987 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892971.367058:0:10000:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7789f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10000:1874741493284864:0@lo:7: 00000004:00080000:1.0:1787892971.367073:0:10000:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1787892971.367120:0:10000:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7789f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10000:1874741493285248:0@lo:5: 00000100:00100000:1.0:1787892971.367154:0:10000:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892971.367186:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493285248 00000100:00100000:1.0:1787892971.367192:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493285248 00000100:00100000:1.0:1787892971.367232:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787892971.367241:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c778a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:10000:x1874741493285248:12345-0@lo:5: 00002000:00080000:1.0:1787892971.367266:0:8535:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1787892971.367293:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c778a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:10000:x1874741493285248:12345-0@lo:5: Request processed in 53us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892971.367299:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787892971.367320:0:10000:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e72b3b40 going to sleep for 11 seconds 00010000:00080000:1.0:1787892971.367333:0:10000:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7789f80 x1874741493285248/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787892987 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892971.367343:0:10000:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7789f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10000:1874741493285248:0@lo:5: 00000004:00080000:1.0:1787892971.367350:0:10000:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1787892971.367372:0:10000:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7789f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10000:1874741493285376:0@lo:5: 00000100:00100000:1.0:1787892971.367393:0:10000:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892971.367414:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493285376 00000100:00100000:1.0:1787892971.367417:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493285376 00000100:00100000:1.0:1787892971.367440:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787892971.367446:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c778a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:10000:x1874741493285376:12345-0@lo:5: 00002000:00080000:1.0:1787892971.367482:0:8420:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:1.0:1787892971.368932:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c778a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:10000:x1874741493285376:12345-0@lo:5: Request processed in 1482us (1534us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787892971.368941:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787892971.369007:0:10000:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e72b3b40 going to sleep for 11 seconds 00010000:00080000:1.0:1787892971.369034:0:10000:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7789f80 x1874741493285376/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787892987 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892971.369047:0:10000:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7789f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10000:1874741493285376:0@lo:5: 00000004:00080000:1.0:1787892971.369057:0:10000:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1787892971.369085:0:10000:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c778b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10000:1874741493285504:0@lo:900: 00000100:00100000:1.0:1787892971.369109:0:10000:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892971.369139:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493285504 00000100:00100000:1.0:1787892971.369143:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493285504 00000100:00100000:1.0:1787892971.369172:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787892971.369178:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7789c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:10000:x1874741493285504:12345-0@lo:900: 00000100:00100000:1.0:1787892971.369209:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7789c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:10000:x1874741493285504:12345-0@lo:900: Request processed in 31us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892971.369215:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787892971.369229:0:10000:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e72b3b40 going to sleep for 11 seconds 00010000:00080000:1.0:1787892971.369238:0:10000:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c778b100 x1874741493285504/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787892987 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892971.369248:0:10000:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c778b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10000:1874741493285504:0@lo:900: 00000001:00080000:0.0:1787892971.371567:0:9497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:2.0:1787892971.381020:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:10004:x1874741493285120:12345-0@lo:700: Request processed in 21440us (21548us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892971.381036:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787892971.381227:0:10004:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7526680 x1874741493285120/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787892987 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892971.381240:0:10004:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787892971.381266:0:10004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7526680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10004:1874741493285120:0@lo:700: 00000004:02000040:2.0:1787892971.385617:0:10004:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:2.0:1787892971.395715:0:10004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10004:1874741493285632:0@lo:5: 00000100:00100000:2.0:1787892971.395792:0:10004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892971.395833:0:10004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9eee58780 going to sleep for 11 seconds 00000100:00100000:1.0:1787892971.395905:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493285632 00000100:00100000:1.0:1787892971.395913:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493285632 00000100:00100000:1.0:1787892971.395977:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787892971.395987:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:10004:x1874741493285632:12345-0@lo:5: 00002000:00080000:0.0:1787892971.411633:0:8535:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1787892971.411668:0:8535:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:0.0:1787892971.415660:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:10004:x1874741493285632:12345-0@lo:5: Request processed in 19668us (19874us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787892971.415673:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1787892971.416106:0:10004:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e711c700 x1874741493285632/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787892987 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892971.416124:0:10004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10004:1874741493285632:0@lo:5: 00000004:00080000:2.0:1787892971.416138:0:10004:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000020:00000004:1.0:1787892971.535125:0:10024:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787892971.535858:0:10024:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787892972.220857:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787892972.811940:0:10072:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787892972.811958:0:10072:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1787892973.234351:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787892973.511614:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787892973.511701:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481701504 00000100:00100000:3.0:1787892973.511712:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481701504 00000100:00100000:3.0:1787892973.511759:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 180 00000100:00100000:3.0:1787892973.511768:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2389:x1874741481701504:12345-192.168.202.35@tcp:250: 00010000:00080000:3.0:1787892973.511794:0:6497:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 3d9a2dc2-4f6b-4ee1-a460-1d8351124f58@192.168.202.35@tcp t0 exp 0000000000000000 cur 217 last 0 00000020:00000080:3.0:1787892973.511821:0:6497:0:(genops.c:1385:class_connect()) connect: client 3d9a2dc2-4f6b-4ee1-a460-1d8351124f58, cookie 0x9232577658cf0bce 00000100:00080000:3.0:1787892973.511966:0:6497:0:(import.c:65:import_set_state_nolock()) ffff9fc8c76ac800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787892973.512040:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+5:2389:x1874741481701504:12345-192.168.202.35@tcp:250: Request processed in 271us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892973.512048:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 180 00000100:00100000:0.0:1787892973.530648:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787892973.530751:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481701632 00000100:00100000:1.0:1787892973.530762:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481701632 00000100:00100000:1.0:1787892973.530812:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 181 00000100:00100000:1.0:1787892973.530831:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+5:6151:x1874741481701632:12345-192.168.202.35@tcp:101: 00010000:00010000:1.0:1787892973.530857:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787892973.530874:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9fe541200/0x9232577658cf0bd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa5ce expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892973.530913:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9fe541200/0x9232577658cf0bd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa5ce expref: 6 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892973.530925:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9fe541200/0x9232577658cf0bd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa5ce expref: 6 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892973.530934:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe541200, rc 0) 00000100:00100000:1.0:1787892973.530987:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+6:6151:x1874741481701632:12345-192.168.202.35@tcp:101: Request processed in 156us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892973.530994:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 181 00000100:00100000:1.0:1787892973.533869:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787892973.533972:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481701760 00000100:00100000:0.0:1787892973.533981:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481701760 00000100:00100000:0.0:1787892973.534024:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 182 00000100:00100000:0.0:1787892973.534030:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+6:6151:x1874741481701760:12345-192.168.202.35@tcp:501: 00000100:00100000:0.0:1787892973.534129:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+6:6151:x1874741481701760:12345-192.168.202.35@tcp:501: Request processed in 98us (267us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787892973.534136:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 182 00000100:00100000:0.0:1787892973.536594:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787892973.536681:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481701888 00000100:00100000:3.0:1787892973.536690:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481701888 00000100:00100000:3.0:1787892973.536746:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 183 00000100:00100000:3.0:1787892973.536755:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+6:6151:x1874741481701888:12345-192.168.202.35@tcp:101: 00010000:00010000:3.0:1787892973.536768:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787892973.536783:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9c147ce00/0x9232577658cf0bdc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa5d5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892973.536807:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9c147ce00/0x9232577658cf0bdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa5d5 expref: 7 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892973.536818:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9c147ce00/0x9232577658cf0bdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa5d5 expref: 7 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892973.536827:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9c147ce00, rc 0) 00000100:00100000:3.0:1787892973.536871:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+7:6151:x1874741481701888:12345-192.168.202.35@tcp:101: Request processed in 118us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892973.536889:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 183 00000100:00100000:2.0:1787892973.540917:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787892973.541644:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481702016 00000100:00100000:1.0:1787892973.541656:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481702016 00000100:00100000:1.0:1787892973.541709:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 184 00000100:00100000:1.0:1787892973.541720:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+7:6151:x1874741481702016:12345-192.168.202.35@tcp:501: 00000100:00100000:1.0:1787892973.541884:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+8:6151:x1874741481702016:12345-192.168.202.35@tcp:501: Request processed in 165us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892973.541900:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 184 00000100:00100000:1.0:1787892973.544908:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787892973.545039:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481702144 00000100:00100000:0.0:1787892973.545049:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481702144 00000100:00100000:0.0:1787892973.545104:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 185 00000100:00100000:0.0:1787892973.545115:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+8:6151:x1874741481702144:12345-192.168.202.35@tcp:503: 00000100:00100000:0.0:1787892973.545242:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+8:6151:x1874741481702144:12345-192.168.202.35@tcp:503: Request processed in 129us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892973.545252:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 185 00000100:00100000:2.0:1787892973.550233:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787892973.550545:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481702272 00000100:00100000:0.0:1787892973.550558:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481702272 00000100:00100000:0.0:1787892973.550628:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 186 00000100:00100000:0.0:1787892973.550639:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+8:6169:x1874741481702272:12345-192.168.202.35@tcp:502: 00000100:00100000:0.0:1787892973.550793:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+8:6169:x1874741481702272:12345-192.168.202.35@tcp:502: Request processed in 156us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892973.550811:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 186 00000100:00100000:2.0:1787892973.620152:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787892973.620532:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481702400 00000100:00100000:1.0:1787892973.620543:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481702400 00000100:00100000:1.0:1787892973.620593:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 187 00000100:00100000:1.0:1787892973.620603:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ec8ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+8:6169:x1874741481702400:12345-192.168.202.35@tcp:502: 00000100:00100000:1.0:1787892973.620766:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ec8ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+8:6169:x1874741481702400:12345-192.168.202.35@tcp:502: Request processed in 163us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892973.620774:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 187 00000100:00100000:1.0:1787892973.625124:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787892973.625230:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481702528 00000100:00100000:2.0:1787892973.625241:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481702528 00000100:00100000:2.0:1787892973.625299:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 188 00000100:00100000:2.0:1787892973.625310:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ec8bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+8:6151:x1874741481702528:12345-192.168.202.35@tcp:101: 00010000:00010000:2.0:1787892973.625325:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787892973.625343:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c771e200/0x9232577658cf0be3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa606 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892973.625384:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c771e200/0x9232577658cf0be3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa606 expref: 9 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892973.625395:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c771e200/0x9232577658cf0be3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa606 expref: 9 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892973.625405:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c771e200, rc 0) 00000100:00100000:2.0:1787892973.625472:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ec8bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+9:6151:x1874741481702528:12345-192.168.202.35@tcp:101: Request processed in 165us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892973.625480:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 188 00000100:00100000:2.0:1787892973.631241:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787892973.638525:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481702656 00000100:00100000:0.0:1787892973.638542:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481702656 00000100:00100000:0.0:1787892973.638615:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 189 00000100:00100000:0.0:1787892973.638625:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ec8b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+9:6151:x1874741481702656:12345-192.168.202.35@tcp:256: 20000000:01000000:0.0:1787892973.638651:0:6497:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787892973.638675:0:6497:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787892973.638679:0:6497:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787892973.638683:0:6497:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787892973.638685:0:6497:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787892973.638687:0:6497:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1787892973.641852:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ec8b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+9:6151:x1874741481702656:12345-192.168.202.35@tcp:256: Request processed in 3216us (10611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892973.641868:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 189 00000100:00100000:1.0:1787892973.652125:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787892973.652237:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481702784 00000100:00100000:0.0:1787892973.652250:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481702784 00000100:00100000:0.0:1787892973.652309:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 190 00000100:00100000:0.0:1787892973.652320:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ec8b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+9:6151:x1874741481702784:12345-192.168.202.35@tcp:101: 00010000:00010000:0.0:1787892973.652336:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787892973.652354:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0bea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa60d expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892973.652383:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0bea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa60d expref: 10 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892973.652394:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0bea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa60d expref: 10 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892973.652405:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb30c00, rc 0) 00000100:00100000:0.0:1787892973.652473:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ec8b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:6151:x1874741481702784:12345-192.168.202.35@tcp:101: Request processed in 154us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892973.652530:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 190 00000100:00100000:2.0:1787892973.659327:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787892973.659421:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481702912 00000100:00100000:3.0:1787892973.659433:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481702912 00000100:00100000:3.0:1787892973.659538:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 191 00000100:00100000:3.0:1787892973.659550:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ec8b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:6151:x1874741481702912:12345-192.168.202.35@tcp:501: 00000100:00100000:3.0:1787892973.659690:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ec8b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:6151:x1874741481702912:12345-192.168.202.35@tcp:501: Request processed in 142us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892973.659698:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 191 00000100:00100000:1.0:1787892973.672425:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787892973.672580:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481703040 00000100:00100000:2.0:1787892973.672590:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481703040 00000100:00100000:2.0:1787892973.672685:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 192 00000100:00100000:2.0:1787892973.672695:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:6151:x1874741481703040:12345-192.168.202.35@tcp:503: 00000100:00100000:2.0:1787892973.672829:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:6151:x1874741481703040:12345-192.168.202.35@tcp:503: Request processed in 135us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892973.672836:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 192 00000100:00100000:1.0:1787892973.684602:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787892973.684691:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481703168 00000100:00100000:0.0:1787892973.684701:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481703168 00000100:00100000:0.0:1787892973.684761:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 193 00000100:00100000:0.0:1787892973.684772:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:6174:x1874741481703168:12345-192.168.202.35@tcp:502: 00000100:00100000:0.0:1787892973.684942:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:6174:x1874741481703168:12345-192.168.202.35@tcp:502: Request processed in 171us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892973.684950:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 193 00000100:00100000:0.0:1787892973.693266:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787892973.693372:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481703296 00000100:00100000:1.0:1787892973.693382:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481703296 00000100:00100000:1.0:1787892973.693439:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 194 00000100:00100000:1.0:1787892973.693457:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:6174:x1874741481703296:12345-192.168.202.35@tcp:502: 00000100:00100000:1.0:1787892973.693649:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:6174:x1874741481703296:12345-192.168.202.35@tcp:502: Request processed in 193us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892973.693658:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 194 00000100:00100000:1.0:1787892973.705087:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787892973.705195:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481703424 00000100:00100000:2.0:1787892973.705205:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481703424 00000100:00100000:2.0:1787892973.705263:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 7 00000100:00100000:2.0:1787892973.705271:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c778b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2389:x1874741481703424:12345-192.168.202.35@tcp:38: 00010000:00080000:2.0:1787892973.705303:0:6505:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 58232959-285a-4954-a3ac-571a2b817017@192.168.202.35@tcp t0 exp 0000000000000000 cur 217 last 0 00000020:00000080:2.0:1787892973.705359:0:6505:0:(genops.c:1385:class_connect()) connect: client 58232959-285a-4954-a3ac-571a2b817017, cookie 0x9232577658cf0bf1 00000004:00100000:2.0:1787892973.705396:0:6505:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787892973.705673:0:6505:0:(import.c:65:import_set_state_nolock()) ffff9fc9e71f8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787892973.705735:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c778b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+6:2389:x1874741481703424:12345-192.168.202.35@tcp:38: Request processed in 462us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892973.705743:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 7 00000100:00100000:3.0:1787892973.706370:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787892973.706998:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481703680 00000100:00100000:2.0:1787892973.707007:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481703680 00000100:00100000:2.0:1787892973.707049:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 8 00000100:00100000:2.0:1787892973.707057:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2389:x1874741481703680:12345-192.168.202.35@tcp:38: 00010000:00080000:2.0:1787892973.707079:0:9515:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 58232959-285a-4954-a3ac-571a2b817017@192.168.202.35@tcp t0 exp 0000000000000000 cur 217 last 0 00000020:00000080:2.0:1787892973.707117:0:9515:0:(genops.c:1385:class_connect()) connect: client 58232959-285a-4954-a3ac-571a2b817017, cookie 0x9232577658cf0bf8 00000004:00100000:2.0:1787892973.707135:0:9515:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787892973.707331:0:9515:0:(import.c:65:import_set_state_nolock()) ffff9fc9e71f9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787892973.707391:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+6:2389:x1874741481703680:12345-192.168.202.35@tcp:38: Request processed in 333us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892973.707399:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 8 00000100:00100000:0.0:1787892973.745761:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787892973.745785:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493285760:0@lo:13: 00000100:00100000:0.0:1787892973.745852:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892973.746047:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493285760 00000100:00100000:3.0:1787892973.746055:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493285760 00000100:00100000:3.0:1787892973.746115:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787892973.746125:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493285760:12345-0@lo:13: 00002000:00000024:3.0:1787892973.746155:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787892973.746220:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493285760:12345-0@lo:13: Request processed in 89us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892973.746233:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1787892973.747057:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787892973.747105:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7525f80 x1874741493285760/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892989 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892973.747129:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493285760:0@lo:13: 00000100:00100000:3.0:1787892973.748591:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787892973.748613:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493285888:0@lo:13: 00000100:00100000:3.0:1787892973.748672:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892973.748760:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493285888 00000100:00100000:1.0:1787892973.748768:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493285888 00000100:00100000:1.0:1787892973.748828:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787892973.748837:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493285888:12345-0@lo:13: 00002000:00000024:1.0:1787892973.748855:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1787892973.749058:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787892973.749096:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e711d500 x1874741493285888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892989 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892973.749112:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493285888:0@lo:13: 00000100:00100000:1.0:1787892973.749162:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493285888:12345-0@lo:13: Request processed in 326us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892973.749169:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:2.0:1787892974.257731:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892974.718794:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787892974.718839:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787892974.719007:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787892974.727544:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481703936 00000100:00100000:0.0:1787892974.727563:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481703936 00000100:00100000:0.0:1787892974.727657:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481703552 00000100:00100000:0.0:1787892974.727660:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481703552 00000100:00100000:0.0:1787892974.727670:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481703808 00000100:00100000:0.0:1787892974.727672:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481703808 00000100:00100000:0.0:1787892974.727693:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 9 00000100:00100000:0.0:1787892974.727702:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c778b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+7:6151:x1874741481703936:12345-192.168.202.35@tcp:41: 00000004:00000024:0.0:1787892974.727738:0:6506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787892974.727808:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c778b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+7:6151:x1874741481703936:12345-192.168.202.35@tcp:41: Request processed in 106us (9025us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892974.727827:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 9 00000100:00100000:0.0:1787892974.727843:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 10 00000100:00100000:0.0:1787892974.727848:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7788000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+6:0:x1874741481703552:12345-192.168.202.35@tcp:41: 00000004:00000024:0.0:1787892974.727858:0:6506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787892974.727875:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7788000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+6:0:x1874741481703552:12345-192.168.202.35@tcp:41: Request processed in 27us (9036us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892974.727880:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 10 00000100:00100000:0.0:1787892974.730714:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 11 00000100:00100000:0.0:1787892974.730747:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c778b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+6:0:x1874741481703808:12345-192.168.202.35@tcp:41: 00000004:00000024:0.0:1787892974.730784:0:6506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787892974.730840:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c778b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+6:0:x1874741481703808:12345-192.168.202.35@tcp:41: Request processed in 110us (11833us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892974.730847:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 11 00000100:00080000:1.0:1787892974.731310:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787892974.731317:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787892974.735004:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787892974.735067:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481704064 00000100:00100000:0.0:1787892974.735075:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481704064 00000100:00100000:0.0:1787892974.735159:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 12 00000100:00100000:0.0:1787892974.735168:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7788a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+6:6151:x1874741481704064:12345-192.168.202.35@tcp:40: 00000100:00100000:0.0:1787892974.735247:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7788a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+6:6151:x1874741481704064:12345-192.168.202.35@tcp:40: Request processed in 79us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892974.735254:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 12 00000100:00100000:0.0:1787892974.737350:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787892974.737798:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481704448 00000100:00100000:3.0:1787892974.737808:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481704448 00000100:00100000:3.0:1787892974.737866:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 195 00000100:00100000:3.0:1787892974.737888:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:2390:x1874741481704448:12345-192.168.202.35@tcp:400: 00000100:00100000:3.0:1787892974.737958:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:2390:x1874741481704448:12345-192.168.202.35@tcp:400: Request processed in 71us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892974.737965:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 195 00000100:00100000:0.0:1787892974.738070:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787892974.738120:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787892974.738151:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481704192 00000100:00100000:0.0:1787892974.738153:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787892974.738156:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481704192 00000100:00100000:3.0:1787892974.738232:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481704320 00000100:00100000:3.0:1787892974.738236:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481704320 00000100:00100000:2.0:1787892974.738526:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 16 00000100:00100000:2.0:1787892974.738533:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2389:x1874741481704192:12345-192.168.202.35@tcp:8: 00010000:00080000:2.0:1787892974.738560:0:8421:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 58232959-285a-4954-a3ac-571a2b817017@192.168.202.35@tcp t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:2.0:1787892974.738602:0:8421:0:(genops.c:1385:class_connect()) connect: client 58232959-285a-4954-a3ac-571a2b817017, cookie 0x9232577658cf0bff 00002000:00100000:2.0:1787892974.738613:0:8421:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 58232959-285a-4954-a3ac-571a2b817017/ffff9fc8c64ba800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787892974.738626:0:8421:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787892974.738791:0:8421:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787892974.738818:0:8421:0:(import.c:65:import_set_state_nolock()) ffff9fc9ffb14800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787892974.738852:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58232959-285a-4954-a3ac-571a2b817017+6:2389:x1874741481704192:12345-192.168.202.35@tcp:8: Request processed in 317us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892974.739087:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 17 00000100:00100000:3.0:1787892974.739093:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2389:x1874741481704320:12345-192.168.202.35@tcp:8: 00010000:00080000:3.0:1787892974.739110:0:8420:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 58232959-285a-4954-a3ac-571a2b817017@192.168.202.35@tcp t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:3.0:1787892974.739128:0:8420:0:(genops.c:1385:class_connect()) connect: client 58232959-285a-4954-a3ac-571a2b817017, cookie 0x9232577658cf0c06 00002000:00100000:3.0:1787892974.739133:0:8420:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 58232959-285a-4954-a3ac-571a2b817017/ffff9fc8c76a8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787892974.739145:0:8420:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787892974.739349:0:8420:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787892974.739365:0:8420:0:(import.c:65:import_set_state_nolock()) ffff9fc8c76ae000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787892974.739404:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+6:2389:x1874741481704320:12345-192.168.202.35@tcp:8: Request processed in 310us (1284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892974.739510:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 16 00000100:00100000:2.0:1787892974.739539:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481704576 00000100:00100000:2.0:1787892974.739544:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481704576 00000100:00100000:2.0:1787892974.739578:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 4 00000100:00100000:2.0:1787892974.739585:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:58232959-285a-4954-a3ac-571a2b817017+6:6151:x1874741481704576:12345-192.168.202.35@tcp:900: 00000100:00100000:2.0:1787892974.739620:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:58232959-285a-4954-a3ac-571a2b817017+6:6151:x1874741481704576:12345-192.168.202.35@tcp:900: Request processed in 35us (1466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892974.739627:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 4 00000100:00100000:3.0:1787892974.739709:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 17 00000100:00100000:0.0:1787892974.750843:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787892974.751300:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481704704 00000100:00100000:2.0:1787892974.751311:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481704704 00000100:00100000:2.0:1787892974.751372:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 0 00000100:00100000:2.0:1787892974.751383:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+6:6151:x1874741481704704:12345-192.168.202.35@tcp:33: 00000004:00080000:2.0:1787892974.765970:0:6507:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 14484us 00000004:00200000:3.0:1787892974.775395:0:6507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787892974.775546:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+6:6151:x1874741481704704:12345-192.168.202.35@tcp:33: Request processed in 24159us (24706us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892974.775560:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 0 00000100:00100000:0.0:1787892975.004822:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787892975.005052:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481704832 00000100:00100000:2.0:1787892975.005062:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481704832 00000100:00100000:2.0:1787892975.005154:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 13 00000100:00100000:2.0:1787892975.005164:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+6:6192:x1874741481704832:12345-192.168.202.35@tcp:101: 00010000:00010000:2.0:1787892975.005184:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787892975.005269:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f200/0x9232577658cf0c0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa63e expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892975.005348:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf0c14 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892975.005361:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf0c14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892975.005375:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf0c14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787892975.005423:0:6505:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787892975.005426:0:6505:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787892975.005448:0:6505:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf0c14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892975.005472:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f200/0x9232577658cf0c0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa63e expref: 8 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892975.005526:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf0c14 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa63e expref: 7 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892975.005535:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc8c6616f00) 00010000:00010000:2.0:1787892975.005538:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787892975.005541:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c771f400, rc 0) 00000100:00100000:2.0:1787892975.005594:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+7:6192:x1874741481704832:12345-192.168.202.35@tcp:101: Request processed in 432us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892975.005601:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 13 00010000:00010000:1.0:1787892975.281739:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787892975.285651:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787892975.285677:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7788380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493286016:0@lo:41: 00000100:00100000:2.0:1787892975.285769:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892975.286010:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493286016 00000100:00100000:0.0:1787892975.286018:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493286016 00000100:00100000:0.0:1787892975.286076:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787892975.286086:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493286016:12345-0@lo:41: 00000004:00000024:0.0:1787892975.286121:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787892975.286181:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493286016:12345-0@lo:41: Request processed in 96us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892975.286188:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787892975.286285:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7788380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493286016:0@lo:41: 00010000:00010000:2.0:1787892976.307789:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787892976.308388:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787892976.308411:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493286144:0@lo:41: 00000100:00100000:3.0:1787892976.308488:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892976.308651:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493286144 00000100:00100000:0.0:1787892976.308659:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493286144 00000100:00100000:0.0:1787892976.308707:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787892976.308717:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493286144:12345-0@lo:41: 00000004:00000024:0.0:1787892976.308753:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787892976.308809:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493286144:12345-0@lo:41: Request processed in 93us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892976.308817:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787892976.308981:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493286144:0@lo:41: 00000100:00100000:3.0:1787892976.818474:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493286272:0@lo:13: 00000100:00100000:3.0:1787892976.818571:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892976.818692:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493286272 00000100:00100000:2.0:1787892976.818702:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493286272 00000100:00100000:2.0:1787892976.818767:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787892976.818778:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3630:x1874741493286272:12345-0@lo:13: 00002000:00000024:2.0:1787892976.818806:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787892976.818854:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3630:x1874741493286272:12345-0@lo:13: Request processed in 79us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892976.818862:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1787892976.818930:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787892976.818958:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e711fb80 x1874741493286272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892992 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892976.818977:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493286272:0@lo:13: 00000100:00100000:3.0:1787892976.819436:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787892976.819447:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7788380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493286400:0@lo:13: 00000100:00100000:3.0:1787892976.819478:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892976.819581:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493286400 00000100:00100000:1.0:1787892976.819587:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493286400 00000100:00100000:1.0:1787892976.819627:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787892976.819636:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3630:x1874741493286400:12345-0@lo:13: 00002000:00000024:1.0:1787892976.819648:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787892976.819680:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3630:x1874741493286400:12345-0@lo:13: Request processed in 46us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892976.819687:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1787892976.819738:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787892976.819759:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7788380 x1874741493286400/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892992 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892976.819772:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7788380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493286400:0@lo:13: 00000100:00100000:0.0:1787892976.820169:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493286912:0@lo:400: 00000100:00100000:0.0:1787892976.820201:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892976.820229:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493287424:0@lo:400: 00000100:00100000:0.0:1787892976.820253:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892976.820272:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787892976.820274:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7788380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493286528:0@lo:400: 00000100:00100000:0.0:1787892976.820277:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed563b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1874741493286784:0@lo:400: 00000100:00100000:0.0:1787892976.820300:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892976.820303:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892976.820314:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493287296:0@lo:400: 00000100:00100000:3.0:1787892976.820319:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493287040:0@lo:400: 00000100:00100000:0.0:1787892976.820331:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892976.820335:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892976.820350:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1874741493287552:0@lo:400: 00000100:00100000:0.0:1787892976.820361:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493287424 00000100:00100000:0.0:1787892976.820366:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493287424 00000100:00100000:3.0:1787892976.820370:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892976.820386:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787892976.820391:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493286656:0@lo:400: 00000100:00100000:3.0:1787892976.820410:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892976.820411:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493287296 00000100:00100000:0.0:1787892976.820421:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493287296 00000100:00100000:3.0:1787892976.820432:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493287168:0@lo:400: 00000100:00100000:0.0:1787892976.820440:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787892976.820446:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493287424:12345-0@lo:400: 00000100:00100000:3.0:1787892976.820450:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892976.820468:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493287680:0@lo:400: 00000100:00100000:0.0:1787892976.820478:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493287424:12345-0@lo:400: Request processed in 33us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892976.820485:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787892976.820486:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892976.820512:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1787892976.820519:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787892976.820519:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493287296:12345-0@lo:400: 00000100:00100000:3.0:1787892976.820528:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493286784 00000100:00100000:3.0:1787892976.820532:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493286784 00000100:00100000:0.0:1787892976.820544:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493287296:12345-0@lo:400: Request processed in 26us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892976.820549:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787892976.820551:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493287040 00000100:00100000:3.0:1787892976.820553:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493287040 00000100:00100000:3.0:1787892976.820569:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493287552 00000100:00100000:3.0:1787892976.820571:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493287552 00010000:00080000:0.0:1787892976.820572:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e5f70a80 x1874741493287296/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892976.820582:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493286656 00000100:00100000:0.0:1787892976.820582:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493287296:0@lo:400: 00000100:00100000:3.0:1787892976.820584:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493286656 00010000:00080000:0.0:1787892976.820591:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb6f480 x1874741493287424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892976.820593:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493287168 00000100:00100000:3.0:1787892976.820595:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493287168 00000100:00100000:0.0:1787892976.820599:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493287424:0@lo:400: 00000100:00100000:3.0:1787892976.820604:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493287680 00000100:00100000:3.0:1787892976.820606:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493287680 00000100:00100000:3.0:1787892976.820618:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787892976.820624:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1874741493286784:12345-0@lo:400: 00000100:00100000:0.0:1787892976.820646:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787892976.820654:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493287040:12345-0@lo:400: 00000100:00100000:3.0:1787892976.820658:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1874741493286784:12345-0@lo:400: Request processed in 35us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892976.820663:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787892976.820676:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787892976.820683:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1874741493287552:12345-0@lo:400: 00000100:00100000:0.0:1787892976.820683:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493287040:12345-0@lo:400: Request processed in 31us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892976.820689:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787892976.820707:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1874741493287552:12345-0@lo:400: Request processed in 25us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892976.820711:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787892976.820750:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493286912 00000100:00100000:1.0:1787892976.820753:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493286912 00000100:00100000:1.0:1787892976.820779:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787892976.820785:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493286912:12345-0@lo:400: 00000100:00100000:1.0:1787892976.820817:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493286912:12345-0@lo:400: Request processed in 32us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892976.820822:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787892976.820858:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493287040:0@lo:400: 00000100:00100000:1.0:1787892976.820868:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1874741493287552:0@lo:400: 00000100:00100000:0.0:1787892976.821083:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493286656:12345-0@lo:400: 00000100:00100000:0.0:1787892976.821120:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493286656:12345-0@lo:400: Request processed in 41us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892976.821225:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493286656:0@lo:400: 00000100:00080000:1.0:1787892976.821248:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787892976.821250:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787892976.824890:0:6504:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1787892976.824912:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1787892976.824945:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493286528 00000100:00100000:2.0:1787892976.824955:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493286528 00000100:00100000:2.0:1787892976.825010:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787892976.825021:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+24:3632:x1874741493286528:12345-0@lo:400: 00000100:00100000:2.0:1787892976.825107:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+24:3632:x1874741493286528:12345-0@lo:400: Request processed in 88us (4801us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892976.825114:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787892976.825144:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7788380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493286528:0@lo:400: 00000100:00100000:1.0:1787892976.825185:0:6505:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1787892976.826747:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787892976.826784:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787892976.826798:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c71b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493287168:12345-0@lo:400: 00000100:00100000:3.0:1787892976.826873:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c71b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493287168:12345-0@lo:400: Request processed in 80us (6420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892976.826892:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787892976.826906:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787892976.826912:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c71b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493287680:12345-0@lo:400: 00000100:00100000:3.0:1787892976.826944:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c71b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493287680:12345-0@lo:400: Request processed in 32us (6456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892976.826950:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1787892976.826987:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e5f71c00 x1874741493287168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892976.827001:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493287168:0@lo:400: 00010000:00080000:3.0:1787892976.827014:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb6c380 x1874741493287680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892976.827021:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493287680:0@lo:400: 00000100:00100000:3.0:1787892976.827057:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed563b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1874741493286784:0@lo:400: 00000100:00100000:3.0:1787892976.827070:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493286912:0@lo:400: 00000100:00100000:0.0:1787892976.830863:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:2.0:1787892977.329649:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787892977.334470:0:9497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 58232959-285a-4954-a3ac-571a2b817017 00000001:00080000:1.0:1787892977.334484:0:9497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:1.0:1787892977.334512:0:9497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:0.0:1787892977.463910:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787892977.464054:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481704960 00000100:00100000:3.0:1787892977.464074:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481704960 00000100:00100000:3.0:1787892977.464194:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 14 00000100:00100000:3.0:1787892977.464208:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+7:6245:x1874741481704960:12345-192.168.202.35@tcp:41: 00000004:00000024:3.0:1787892977.464247:0:9515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1787892977.464380:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+7:6245:x1874741481704960:12345-192.168.202.35@tcp:41: Request processed in 172us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892977.464413:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 14 00000100:00080000:1.0:1787892977.464469:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787892977.476985:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787892977.477104:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481705088 00000100:00100000:3.0:1787892977.477126:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481705088 00000100:00100000:3.0:1787892977.477197:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 15 00000100:00100000:3.0:1787892977.477208:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+6:6245:x1874741481705088:12345-192.168.202.35@tcp:41: 00000004:00000024:3.0:1787892977.477243:0:10086:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787892977.477320:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+6:6245:x1874741481705088:12345-192.168.202.35@tcp:41: Request processed in 114us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892977.477327:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 15 00000100:00080000:1.0:1787892977.477428:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787892977.483753:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787892977.489237:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481705216 00000100:00100000:1.0:1787892977.489252:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481705216 00000100:00100000:1.0:1787892977.489394:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 18 00000100:00100000:1.0:1787892977.489406:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:58232959-285a-4954-a3ac-571a2b817017+6:6245:x1874741481705216:12345-192.168.202.35@tcp:13: 00002000:00000024:1.0:1787892977.489444:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787892977.489519:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:58232959-285a-4954-a3ac-571a2b817017+6:6245:x1874741481705216:12345-192.168.202.35@tcp:13: Request processed in 115us (5831us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892977.489526:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 18 00000100:00080000:3.0:1787892977.490091:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787892977.497332:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787892977.498312:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481705344 00000100:00100000:0.0:1787892977.498323:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481705344 00000100:00100000:1.0:1787892977.501045:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 19 00000100:00100000:1.0:1787892977.501060:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c71b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:58232959-285a-4954-a3ac-571a2b817017+5:6245:x1874741481705344:12345-192.168.202.35@tcp:13: 00002000:00000024:1.0:1787892977.501087:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787892977.501154:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c71b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:58232959-285a-4954-a3ac-571a2b817017+5:6245:x1874741481705344:12345-192.168.202.35@tcp:13: Request processed in 96us (3831us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892977.501161:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 19 00000100:00080000:3.0:1787892977.501729:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787892978.354087:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892978.867936:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493287808:0@lo:13: 00000100:00100000:1.0:1787892978.868010:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892978.868082:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493287808 00000100:00100000:1.0:1787892978.868090:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493287808 00000100:00100000:1.0:1787892978.868138:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787892978.868154:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493287808:12345-0@lo:13: 00002000:00000024:1.0:1787892978.868175:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787892978.868214:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493287808:12345-0@lo:13: Request processed in 62us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892978.868221:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1787892978.868244:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787892978.868271:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb6ed80 x1874741493287808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892994 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892978.868292:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493287808:0@lo:13: 00000100:00100000:1.0:1787892978.876148:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493287936:0@lo:13: 00000100:00100000:1.0:1787892978.876230:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892978.876296:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493287936 00000100:00100000:1.0:1787892978.876304:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493287936 00000100:00100000:1.0:1787892978.876352:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787892978.876361:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493287936:12345-0@lo:13: 00002000:00000024:1.0:1787892978.876381:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787892978.876437:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493287936:12345-0@lo:13: Request processed in 77us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892978.876444:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1787892978.876465:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787892978.876520:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e711fb80 x1874741493287936/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892994 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892978.876540:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493287936:0@lo:13: 00010000:00010000:2.0:1787892979.379790:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787892979.385466:0:6484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 58232959-285a-4954-a3ac-571a2b817017 00000001:00100000:0.0:1787892979.388893:0:7436:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 58232959-285a-4954-a3ac-571a2b817017 00000001:00100000:1.0:1787892979.913019:0:8413:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 58232959-285a-4954-a3ac-571a2b817017 00000100:00100000:3.0:1787892980.259187:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787892980.259223:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787892980.259252:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787892980.259280:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787892980.259306:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787892980.259338:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481705600 00000100:00100000:3.0:1787892980.259348:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481705600 00000100:00100000:3.0:1787892980.259422:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481705728 00000100:00100000:3.0:1787892980.259425:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481705728 00000100:00100000:3.0:1787892980.259449:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 51 00000100:00100000:3.0:1787892980.259459:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c71b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+6:2392:x1874741481705600:12345-192.168.202.35@tcp:400: 00000100:00100000:3.0:1787892980.261242:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c71b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+6:2392:x1874741481705600:12345-192.168.202.35@tcp:400: Request processed in 1773us (2056us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892980.261257:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 51 00000100:00100000:3.0:1787892980.261304:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 52 00000100:00100000:3.0:1787892980.261317:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c71b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+5:2392:x1874741481705728:12345-192.168.202.35@tcp:400: 00000100:00100000:3.0:1787892980.261357:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c71b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+5:2392:x1874741481705728:12345-192.168.202.35@tcp:400: Request processed in 46us (2084us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892980.261375:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 52 00000100:00100000:3.0:1787892980.261413:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481705856 00000100:00100000:3.0:1787892980.261419:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481705856 00000100:00100000:3.0:1787892980.261457:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481705984 00000100:00100000:3.0:1787892980.261460:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481705984 00000100:00100000:3.0:1787892980.261481:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 9 00000100:00100000:3.0:1787892980.261507:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c71b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+5:2392:x1874741481705856:12345-192.168.202.35@tcp:400: 00000100:00100000:3.0:1787892980.261548:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c71b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+5:2392:x1874741481705856:12345-192.168.202.35@tcp:400: Request processed in 59us (2324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892980.261554:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 9 00000100:00100000:3.0:1787892980.261566:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 10 00000100:00100000:3.0:1787892980.264391:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c71b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+5:2392:x1874741481705984:12345-192.168.202.35@tcp:400: 00000100:00100000:3.0:1787892980.264477:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c71b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+5:2392:x1874741481705984:12345-192.168.202.35@tcp:400: Request processed in 113us (5168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892980.265110:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 10 00000100:00100000:3.0:1787892980.265155:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481705472 00000100:00100000:3.0:1787892980.265163:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481705472 00000100:00100000:3.0:1787892980.267611:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 197 00000100:00100000:3.0:1787892980.267630:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:2392:x1874741481705472:12345-192.168.202.35@tcp:400: 00000100:00100000:3.0:1787892980.267732:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:2392:x1874741481705472:12345-192.168.202.35@tcp:400: Request processed in 108us (8478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892980.267741:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 197 00000100:00080000:0.0:1787892980.272835:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787892980.272844:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787892980.272848:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787892980.272851:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787892980.401855:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493288064:0@lo:41: 00000100:00100000:3.0:1787892980.401931:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892980.402424:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493288064 00000100:00100000:1.0:1787892980.402446:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493288064 00000100:00100000:1.0:1787892980.402539:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787892980.402549:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c71b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493288064:12345-0@lo:41: 00000004:00000024:1.0:1787892980.402583:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787892980.402634:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c71b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493288064:12345-0@lo:41: Request processed in 87us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892980.402641:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787892980.402790:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493288064:0@lo:41: 00010000:00010000:2.0:1787892980.403023:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787892980.650412:0:10171:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787892981.425832:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787892981.426241:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787892981.426282:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493288192:0@lo:41: 00000100:00100000:3.0:1787892981.426354:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892981.426557:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493288192 00000100:00100000:1.0:1787892981.426565:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493288192 00000100:00100000:1.0:1787892981.426621:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787892981.426632:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c71b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493288192:12345-0@lo:41: 00000004:00000024:1.0:1787892981.426664:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1787892981.426719:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c71b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493288192:12345-0@lo:41: Request processed in 90us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892981.426725:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787892981.426950:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493288192:0@lo:41: 00000100:00100000:1.0:1787892981.938428:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787892981.938452:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493288320:0@lo:13: 00000100:00100000:1.0:1787892981.938539:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892981.938601:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493288320 00000100:00100000:1.0:1787892981.938610:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493288320 00000100:00100000:1.0:1787892981.938661:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787892981.938671:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493288320:12345-0@lo:13: 00002000:00000024:1.0:1787892981.938702:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787892981.938749:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493288320:12345-0@lo:13: Request processed in 79us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892981.938841:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1787892981.938967:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb6ea00 x1874741493288320/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892997 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892981.938987:0:3631:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787892981.939014:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493288320:0@lo:13: 00000100:00080000:0.0:1787892981.940275:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787892981.940411:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493288576:0@lo:400: 00000100:00100000:0.0:1787892981.940470:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892981.940523:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493289088:0@lo:400: 00000100:00100000:0.0:1787892981.940545:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892981.940563:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493289600:0@lo:400: 00000100:00100000:0.0:1787892981.940586:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892981.940605:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787892981.940611:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493288704:0@lo:400: 00000100:00100000:0.0:1787892981.940631:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892981.940646:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493289216:0@lo:400: 00000100:00100000:0.0:1787892981.940666:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892981.940692:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493289728:0@lo:400: 00000100:00100000:0.0:1787892981.940730:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892981.941278:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493288576 00000100:00100000:1.0:1787892981.941286:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493288576 00000100:00100000:1.0:1787892981.941321:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493289088 00000100:00100000:1.0:1787892981.941324:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493289088 00000100:00100000:1.0:1787892981.941340:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493289600 00000100:00100000:1.0:1787892981.941342:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493289600 00000100:00100000:1.0:1787892981.941353:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493288704 00000100:00100000:1.0:1787892981.941355:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493288704 00000100:00100000:1.0:1787892981.941383:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787892981.941392:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493288576:12345-0@lo:400: 00000100:00100000:1.0:1787892981.941444:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493288576:12345-0@lo:400: Request processed in 53us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892981.941451:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787892981.941468:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787892981.941474:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493289088:12345-0@lo:400: 00000100:00100000:1.0:1787892981.941519:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493289088:12345-0@lo:400: Request processed in 45us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892981.941525:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787892981.941536:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787892981.941542:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493289600:12345-0@lo:400: 00000100:00100000:1.0:1787892981.941566:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493289600:12345-0@lo:400: Request processed in 26us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892981.941572:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787892981.941582:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787892981.941595:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493288704:12345-0@lo:400: 00000100:00100000:1.0:1787892981.941622:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493288704:12345-0@lo:400: Request processed in 28us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892981.941627:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787892981.941654:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493288832:0@lo:400: 00000100:00100000:1.0:1787892981.941682:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892981.941712:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493289344:0@lo:400: 00000100:00100000:1.0:1787892981.941732:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892981.941751:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787892981.941983:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493289216 00000100:00100000:0.0:1787892981.941988:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493289216 00000100:00100000:0.0:1787892981.942017:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493289728 00000100:00100000:0.0:1787892981.942019:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493289728 00000100:00100000:0.0:1787892981.942034:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493289344 00000100:00100000:0.0:1787892981.942037:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493289344 00000100:00100000:0.0:1787892981.942049:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787892981.942054:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493289216:12345-0@lo:400: 00000100:00100000:0.0:1787892981.942168:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493289216:12345-0@lo:400: Request processed in 113us (1500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892981.942174:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787892981.942189:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787892981.942197:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493289728:12345-0@lo:400: 00000100:00100000:0.0:1787892981.942222:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493289728:12345-0@lo:400: Request processed in 26us (1491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892981.942227:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787892981.942237:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787892981.942242:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493289344:12345-0@lo:400: 00000100:00100000:0.0:1787892981.942266:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493289344:12345-0@lo:400: Request processed in 24us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892981.942272:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1787892981.942310:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787892981.942313:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787892981.942316:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787892981.942341:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493288704:0@lo:400: 00010000:00080000:0.0:1787892981.942354:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb6bb80 x1874741493289216/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892981.942385:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493289216:0@lo:400: 00010000:00080000:0.0:1787892981.942399:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb68e00 x1874741493289728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892981.942406:0:3632:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1787892981.942418:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493289728:0@lo:400: 00000100:00100000:0.0:1787892981.942428:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493288576:0@lo:400: 00010000:00080000:0.0:1787892981.942438:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb69500 x1874741493289088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892981.942445:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493289088:0@lo:400: 00010000:00080000:0.0:1787892981.942453:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb6b100 x1874741493289600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892981.942460:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493289600:0@lo:400: 00000100:00100000:0.0:1787892981.942603:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493288832 00000100:00100000:0.0:1787892981.942608:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493288832 00000100:00100000:0.0:1787892981.942635:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787892981.942642:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493288832:12345-0@lo:400: 00000100:00100000:0.0:1787892981.942676:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493288832:12345-0@lo:400: Request processed in 35us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892981.942682:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787892981.945138:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493289856:0@lo:13: 00000100:00100000:1.0:1787892981.945204:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892981.945284:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493288448:0@lo:400: 00000100:00100000:1.0:1787892981.945313:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892981.945343:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493288960:0@lo:400: 00000100:00100000:1.0:1787892981.945379:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892981.945398:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1874741493289472:0@lo:400: 00000100:00100000:1.0:1787892981.945421:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892981.945455:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493288832:0@lo:400: 00010000:00080000:1.0:1787892981.945472:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb6b800 x1874741493289344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892981.945481:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493289344:0@lo:400: 00000100:00100000:1.0:1787892981.945605:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493288448 00000100:00100000:1.0:1787892981.945611:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493288448 00000100:00100000:1.0:1787892981.945651:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787892981.945660:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+24:3630:x1874741493288448:12345-0@lo:400: 00000100:00100000:1.0:1787892981.945723:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+24:3630:x1874741493288448:12345-0@lo:400: Request processed in 64us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892981.945731:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787892981.945779:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493288960 00000100:00100000:1.0:1787892981.945783:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493288960 00000100:00100000:1.0:1787892981.945813:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493289472 00000100:00100000:1.0:1787892981.945816:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493289472 00000100:00100000:1.0:1787892981.945835:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787892981.945840:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493288960:12345-0@lo:400: 00000100:00100000:1.0:1787892981.945870:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493288960:12345-0@lo:400: Request processed in 31us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892981.945876:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787892981.945899:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787892981.945905:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874741493289472:12345-0@lo:400: 00000100:00100000:1.0:1787892981.945931:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874741493289472:12345-0@lo:400: Request processed in 25us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892981.945936:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1787892981.945964:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787892981.945996:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493288448:0@lo:400: 00000100:00100000:1.0:1787892981.946006:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493288960:0@lo:400: 00000100:00100000:1.0:1787892981.946015:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1874741493289472:0@lo:400: 00000100:00100000:2.0:1787892981.949607:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493289856 00000100:00100000:2.0:1787892981.949624:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493289856 00000100:00100000:2.0:1787892981.950151:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787892981.950163:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493289856:12345-0@lo:13: 00002000:00000024:2.0:1787892981.950191:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787892981.950346:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493289856:12345-0@lo:13: Request processed in 185us (5140us total) trans 0 rc 0/0 00010000:00080000:3.0:1787892981.950425:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e711c380 x1874741493289856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892997 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892981.950447:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493289856:0@lo:13: 00000100:00100000:2.0:1787892981.954281:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1787892982.449759:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892983.474656:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787892983.985958:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787892983.985987:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493290112:0@lo:13: 00000100:00100000:2.0:1787892983.986056:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892983.986171:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493290112 00000100:00100000:1.0:1787892983.986180:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493290112 00000100:00100000:1.0:1787892983.986248:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787892983.986259:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493290112:12345-0@lo:13: 00002000:00000024:1.0:1787892983.986289:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787892983.986367:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493290112:12345-0@lo:13: Request processed in 110us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892983.986374:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1787892983.986418:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e711ca80 x1874741493290112/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892999 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892983.986436:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493290112:0@lo:13: 00000100:00080000:2.0:1787892983.986505:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787892983.986594:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493289984:0@lo:13: 00000100:00100000:0.0:1787892983.986628:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892983.986710:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493289984 00000100:00100000:2.0:1787892983.986715:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493289984 00000100:00100000:2.0:1787892983.986759:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787892983.986766:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493289984:12345-0@lo:13: 00002000:00000024:2.0:1787892983.986777:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787892983.986810:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493289984:12345-0@lo:13: Request processed in 44us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892983.986816:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1787892983.986845:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb6ce00 x1874741493289984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892999 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892983.986857:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493289984:0@lo:13: 00000100:00080000:1.0:1787892983.986971:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787892984.509600:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787892984.950047:0:10319:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffc6179b20 20000000:00000080:0.0:1787892984.950067:0:10319:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fc9ffbc9400 uarg=0000000000000000 20000000:01000000:0.0:1787892984.950112:0:10319:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1787892984.950114:0:10319:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1787892984.950117:0:10319:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787892984.950122:0:10319:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787892984.950127:0:10319:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1787892984.950187:0:10319:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787892984.950189:0:10319:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787892984.950971:0:10320:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:0.0:1787892984.951217:0:10319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:0.0:1787892984.951322:0:10319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:0.0:1787892984.951355:0:10319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:0.0:1787892984.951369:0:10319:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787892984.951371:0:10319:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787892984.952009:0:10321:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:0.0:1787892984.952182:0:10319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:0.0:1787892984.952204:0:10319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:0.0:1787892984.952220:0:10319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:0.0:1787892984.952229:0:10319:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1787892984.952231:0:10319:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787892984.952911:0:10322:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:0.0:1787892984.953085:0:10319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:0.0:1787892984.953107:0:10319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:0.0:1787892984.953122:0:10319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:0.0:1787892984.953132:0:10319:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787892984.953134:0:10319:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787892984.954135:0:10323:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:0.0:1787892984.954432:0:10319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:0.0:1787892984.954702:0:10319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:0.0:1787892984.954738:0:10319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:0.0:1787892984.954750:0:10319:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787892984.954752:0:10319:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787892984.955130:0:10324:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:0.0:1787892984.956002:0:10319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:0.0:1787892984.956036:0:10319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:0.0:1787892984.956051:0:10319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 10000000:01000000:0.0:1787892984.956067:0:10319:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787892984.956087:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fc9edb31800/0x9232577658cf0c1b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892984.956109:0:10319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9c147d600/0x9232577658cf0ab6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0aaf expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892984.956117:0:10319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9edb30000/0x9232577658cf0ae0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0ad9 expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892984.956124:0:10319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9fe541e00/0x9232577658cf0b1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0b18 expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892984.956131:0:10319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9edb30a00/0x9232577658cf0b2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0b26 expref: 23 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892984.956138:0:10319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9fe541a00/0x9232577658cf0b3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0b34 expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892984.956145:0:10319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc8c771ec00/0x9232577658cf0b57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0b50 expref: 23 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892984.956152:0:10319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9fe540600/0x9232577658cf0b81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0b7a expref: 23 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892984.956159:0:10319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9edb31400/0x9232577658cf0b9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0b96 expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892984.956167:0:10319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9edb30600/0x9232577658cf0bc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0bc0 expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892984.956175:0:10319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9fe541200/0x9232577658cf0bd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa5ce expref: 9 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892984.956192:0:10319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9c147ce00/0x9232577658cf0bdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa5d5 expref: 9 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892984.956201:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fc9edb31800/0x9232577658cf0c1b lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892984.956317:0:10319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9c147ce00/0x9232577658cf0bdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa5d5 expref: 9 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892984.956333:0:10319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc9c147ce00/0x9232577658cf0bdc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa5d5 expref: 9 pid: 6497 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892984.956359:0:10319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10319:1874741493290240:192.168.202.35@tcp:104: 00010000:00010000:0.0:1787892984.956628:0:10319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9fe541200/0x9232577658cf0bd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa5ce expref: 9 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892984.956637:0:10319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc9fe541200/0x9232577658cf0bd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa5ce expref: 9 pid: 6499 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892984.956645:0:10319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10319:1874741493290368:192.168.202.35@tcp:104: 00010000:00010000:0.0:1787892984.956676:0:10319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9edb30600/0x9232577658cf0bc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf0bc0 expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892984.956685:0:10319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc9edb30600/0x9232577658cf0bc7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf0bc0 expref: 23 pid: 6500 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892984.956693:0:10319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10319:1874741493290496:0@lo:104: 00000100:00100000:0.0:1787892984.956731:0:10319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787892984.956784:0:10319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9edb31400/0x9232577658cf0b9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf0b96 expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892984.956793:0:10319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc9edb31400/0x9232577658cf0b9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf0b96 expref: 23 pid: 6500 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892984.956879:0:10319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10319:1874741493290624:0@lo:104: 00000100:00100000:0.0:1787892984.956905:0:10319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787892984.956975:0:10319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9fe540600/0x9232577658cf0b81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf0b7a expref: 23 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892984.956983:0:10319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc9fe540600/0x9232577658cf0b81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf0b7a expref: 23 pid: 6499 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892984.956992:0:10319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10319:1874741493290752:0@lo:104: 00000100:00100000:0.0:1787892984.957012:0:10319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787892984.958820:0:10319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc8c771ec00/0x9232577658cf0b57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf0b50 expref: 23 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892984.958838:0:10319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc8c771ec00/0x9232577658cf0b57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf0b50 expref: 23 pid: 6497 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892984.958851:0:10319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10319:1874741493290880:0@lo:104: 00000100:00100000:0.0:1787892984.958899:0:10319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892984.960155:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493290496 00000100:00100000:3.0:1787892984.960168:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493290496 00000100:00100000:3.0:1787892984.960213:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493290624 00000100:00100000:3.0:1787892984.960216:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493290624 00000100:00100000:3.0:1787892984.960227:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493290752 00000100:00100000:3.0:1787892984.960230:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493290752 00000100:00100000:3.0:1787892984.960380:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787892984.960392:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+5:10319:x1874741493290496:12345-0@lo:104: 00010000:00010000:3.0:1787892984.960412:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31c00/0x9232577658cf0bc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0bc7 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892984.960613:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787892984.960620:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+5:10319:x1874741493290496:12345-0@lo:104: Request processed in 231us (3889us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892984.960628:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787892984.960648:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787892984.960656:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+4:10319:x1874741493290624:12345-0@lo:104: 00010000:00010000:3.0:1787892984.960665:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc8c771e600/0x9232577658cf0b96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0b9d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892984.960721:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787892984.960726:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+4:10319:x1874741493290624:12345-0@lo:104: Request processed in 72us (3821us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892984.960732:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787892984.960745:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787892984.960752:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+3:10319:x1874741493290752:12345-0@lo:104: 00010000:00010000:3.0:1787892984.960760:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30800/0x9232577658cf0b7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0b81 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892984.960793:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:2.0:1787892984.960877:0:8435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787892984.960885:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31c00/0x9232577658cf0bc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0bc7 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892984.960894:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31c00 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:2.0:1787892984.960905:0:8435:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31c00/0x9232577658cf0bc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf0bc7 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892984.960915:0:8435:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31c00/0x9232577658cf0bc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf0bc7 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787892984.960922:0:8435:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31c00/0x9232577658cf0bc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf0bc7 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892984.960928:0:8435:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787892984.960970:0:8435:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31c00/0x9232577658cf0bc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0bc7 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892984.960978:0:8435:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787892984.960996:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31c00/0x9232577658cf0bc0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0bc7 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892984.961003:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31c00/0x9232577658cf0bc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0bc7 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892984.961017:0:8435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787892984.961021:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc8c771e600/0x9232577658cf0b96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0b9d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892984.961027:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c771e600 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:2.0:1787892984.961030:0:8435:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc8c771e600/0x9232577658cf0b96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf0b9d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892984.961037:0:8435:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc8c771e600/0x9232577658cf0b96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf0b9d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787892984.961053:0:8435:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc8c771e600/0x9232577658cf0b96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf0b9d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892984.961058:0:8435:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787892984.961073:0:8435:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc8c771e600/0x9232577658cf0b96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0b9d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892984.961079:0:8435:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787892984.961093:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc8c771e600/0x9232577658cf0b96 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0b9d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892984.961100:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc8c771e600/0x9232577658cf0b96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0b9d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892984.961109:0:8435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787892984.961112:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30800/0x9232577658cf0b7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0b81 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892984.961118:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30800 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:2.0:1787892984.961121:0:8435:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30800/0x9232577658cf0b7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf0b81 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892984.961127:0:8435:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30800/0x9232577658cf0b7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf0b81 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787892984.961134:0:8435:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30800/0x9232577658cf0b7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf0b81 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892984.961139:0:8435:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787892984.961160:0:8435:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30800/0x9232577658cf0b7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0b81 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892984.961166:0:8435:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787892984.961171:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30800/0x9232577658cf0b7a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0b81 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892984.961177:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30800/0x9232577658cf0b7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0b81 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892984.961186:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892984.961188:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892984.961190:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787892984.961204:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493291264:0@lo:103: 00000100:00100000:2.0:1787892984.961257:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892984.961295:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787892984.961301:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493291136:0@lo:103: 00000100:00100000:2.0:1787892984.961323:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892984.961362:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493291264 00000100:00100000:2.0:1787892984.961367:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493291264 00010000:00010000:2.0:1787892984.961392:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9fe540600/0x9232577658cf0b81 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0b7a expref: 24 pid: 6499 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892984.961412:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493291136 00000100:00100000:2.0:1787892984.961415:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493291136 00010000:00010000:2.0:1787892984.961427:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9edb31400/0x9232577658cf0b9d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0b96 expref: 25 pid: 6500 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892984.961440:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787892984.961446:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3eff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ad7764-cf95-4087-88aa-57e4229a8397+25:3631:x1874741493291264:12345-0@lo:103: 00010000:00010000:2.0:1787892984.961477:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787892984.961482:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9fe540600/0x9232577658cf0b81 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0b7a expref: 25 pid: 6499 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892984.961510:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9fe540600/0x9232577658cf0b81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf0b7a expref: 25 pid: 6499 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892984.961527:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787892984.961556:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3eff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ad7764-cf95-4087-88aa-57e4229a8397+25:3631:x1874741493291264:12345-0@lo:103: Request processed in 110us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892984.961562:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787892984.961602:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787892984.961610:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ad7764-cf95-4087-88aa-57e4229a8397+24:3631:x1874741493291136:12345-0@lo:103: 00010000:00010000:2.0:1787892984.961617:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787892984.961621:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9edb31400/0x9232577658cf0b9d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0b96 expref: 24 pid: 6500 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892984.961629:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9edb31400/0x9232577658cf0b9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf0b96 expref: 24 pid: 6500 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892984.961638:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787892984.961660:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ad7764-cf95-4087-88aa-57e4229a8397+24:3631:x1874741493291136:12345-0@lo:103: Request processed in 51us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892984.961666:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787892984.961701:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493291136:0@lo:103: 00000100:00100000:2.0:1787892984.961709:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493291264:0@lo:103: 00000100:00100000:3.0:1787892984.961886:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+3:10319:x1874741493290752:12345-0@lo:104: Request processed in 1135us (4873us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892984.961893:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787892984.961965:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787892984.962570:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00010000:00010000:3.0:1787892984.962595:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892984.962601:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787892984.962614:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481706240 00000100:00100000:3.0:1787892984.962619:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481706240 00010000:00010000:3.0:1787892984.962642:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9fe541200/0x9232577658cf0bd5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa5ce expref: 10 pid: 6499 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892984.962663:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481706112 00000100:00100000:3.0:1787892984.962666:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481706112 00010000:00010000:3.0:1787892984.962678:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9c147ce00/0x9232577658cf0bdc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa5d5 expref: 11 pid: 6497 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892984.962691:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 26 00000100:00100000:3.0:1787892984.962708:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c71b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+11:2391:x1874741481706240:12345-192.168.202.35@tcp:103: 00010000:00010000:3.0:1787892984.962719:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787892984.962724:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9fe541200/0x9232577658cf0bd5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa5ce expref: 11 pid: 6499 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892984.962732:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9fe541200/0x9232577658cf0bd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa5ce expref: 11 pid: 6499 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892984.962743:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787892984.962784:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c71b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+11:2391:x1874741481706240:12345-192.168.202.35@tcp:103: Request processed in 77us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892984.962791:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 26 00010000:00010000:0.0:1787892984.962957:0:10319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9fe541a00/0x9232577658cf0b3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf0b34 expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892984.962970:0:10319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc9fe541a00/0x9232577658cf0b3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf0b34 expref: 23 pid: 6500 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892984.962982:0:10319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10319:1874741493291392:0@lo:104: 00010000:00010000:0.0:1787892984.963037:0:10319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9edb30a00/0x9232577658cf0b2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf0b26 expref: 23 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892984.963046:0:10319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc9edb30a00/0x9232577658cf0b2d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf0b26 expref: 23 pid: 6499 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892984.963055:0:10319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10319:1874741493291520:0@lo:104: 00010000:00010000:0.0:1787892984.963079:0:10319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9fe541e00/0x9232577658cf0b1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf0b18 expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892984.963086:0:10319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc9fe541e00/0x9232577658cf0b1f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf0b18 expref: 23 pid: 6500 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892984.963094:0:10319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10319:1874741493291648:0@lo:104: 00010000:00010000:0.0:1787892984.963117:0:10319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9edb30000/0x9232577658cf0ae0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf0ad9 expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892984.963125:0:10319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc9edb30000/0x9232577658cf0ae0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf0ad9 expref: 23 pid: 6500 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892984.963133:0:10319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10319:1874741493291776:0@lo:104: 00010000:00010000:0.0:1787892984.963155:0:10319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9c147d600/0x9232577658cf0ab6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf0aaf expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892984.963162:0:10319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc9c147d600/0x9232577658cf0ab6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf0aaf expref: 23 pid: 6500 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892984.963169:0:10319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10319:1874741493291904:0@lo:104: 00000100:00100000:0.0:1787892984.963185:0:10319:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7699840 going to sleep for 11 seconds 00000100:00100000:0.0:1787892984.963209:0:10319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10319:1874741493290240:192.168.202.35@tcp:104: 00010000:00010000:0.0:1787892984.963219:0:10319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9fe541200/0x9232577658cf0bd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa5ce expref: 11 pid: 6499 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892984.963231:0:10319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10319:1874741493290368:192.168.202.35@tcp:104: 00000100:00100000:0.0:1787892984.963242:0:10319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10319:1874741493290496:0@lo:104: 00010000:00010000:0.0:1787892984.963250:0:10319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9edb31400/0x9232577658cf0b9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf0b96 expref: 23 pid: 6500 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892984.963259:0:10319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10319:1874741493290624:0@lo:104: 00010000:00010000:0.0:1787892984.963267:0:10319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9fe540600/0x9232577658cf0b81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf0b7a expref: 22 pid: 6499 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892984.963275:0:10319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10319:1874741493290752:0@lo:104: 00000100:00100000:3.0:1787892984.963328:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 27 00000100:00100000:3.0:1787892984.963336:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c71b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+9:2391:x1874741481706112:12345-192.168.202.35@tcp:103: 00010000:00010000:3.0:1787892984.963355:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787892984.963361:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9c147ce00/0x9232577658cf0bdc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa5d5 expref: 9 pid: 6497 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892984.963373:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9c147ce00/0x9232577658cf0bdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa5d5 expref: 9 pid: 6497 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892984.963384:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9c147ce00/0x9232577658cf0bdc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa5d5 expref: 9 pid: 6497 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892984.963393:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787892984.963414:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c71b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+8:2391:x1874741481706112:12345-192.168.202.35@tcp:103: Request processed in 79us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892984.963420:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 27 00000100:00100000:1.0:1787892984.964195:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493290880 00000100:00100000:1.0:1787892984.964202:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493290880 00000100:00100000:1.0:1787892984.964239:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787892984.964262:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892984.964278:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892984.964287:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892984.964295:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892984.964302:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892984.964308:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493291392 00000100:00100000:1.0:1787892984.964311:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493291392 00000100:00100000:1.0:1787892984.964324:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493291520 00000100:00100000:1.0:1787892984.964326:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493291520 00000100:00100000:1.0:1787892984.964334:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493291648 00000100:00100000:1.0:1787892984.964336:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493291648 00000100:00100000:1.0:1787892984.964356:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493291776 00000100:00100000:1.0:1787892984.964359:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493291776 00000100:00100000:1.0:1787892984.964366:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493291904 00000100:00100000:1.0:1787892984.964367:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493291904 00000100:00100000:1.0:1787892984.964378:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787892984.964384:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e70ab050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ad7764-cf95-4087-88aa-57e4229a8397+8:10319:x1874741493290880:12345-0@lo:104: 00010000:00010000:1.0:1787892984.964397:0:6488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728c00/0x9232577658cf0b50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0b57 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892984.964716:0:10319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10319:1874741493290880:0@lo:104: 00010000:00010000:2.0:1787892984.964775:0:8435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787892984.964782:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728c00/0x9232577658cf0b50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0b57 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892984.964858:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd728c00 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:2.0:1787892984.964863:0:8435:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728c00/0x9232577658cf0b50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf0b57 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892984.964871:0:8435:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728c00/0x9232577658cf0b50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf0b57 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787892984.964878:0:8435:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728c00/0x9232577658cf0b50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf0b57 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892984.964883:0:8435:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787892984.964920:0:8435:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728c00/0x9232577658cf0b50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0b57 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892984.964926:0:8435:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787892984.964936:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728c00/0x9232577658cf0b50 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0b57 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892984.964943:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728c00/0x9232577658cf0b50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0b57 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892984.964956:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892984.964958:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892984.964960:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892984.965073:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787892984.965087:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e70ab050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ad7764-cf95-4087-88aa-57e4229a8397+8:10319:x1874741493290880:12345-0@lo:104: Request processed in 702us (6187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892984.965094:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787892984.965160:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787892984.965168:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ad7764-cf95-4087-88aa-57e4229a8397+7:10319:x1874741493291392:12345-0@lo:104: 00010000:00010000:1.0:1787892984.965177:0:6488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729200/0x9232577658cf0b34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0b3b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.965269:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787892984.965275:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ad7764-cf95-4087-88aa-57e4229a8397+7:10319:x1874741493291392:12345-0@lo:104: Request processed in 109us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892984.965280:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787892984.965292:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787892984.965298:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ad7764-cf95-4087-88aa-57e4229a8397+6:10319:x1874741493291520:12345-0@lo:104: 00010000:00010000:1.0:1787892984.965305:0:6488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540400/0x9232577658cf0b26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0b2d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.965351:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787892984.965357:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ad7764-cf95-4087-88aa-57e4229a8397+6:10319:x1874741493291520:12345-0@lo:104: Request processed in 59us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892984.965363:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787892984.965377:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787892984.965383:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ad7764-cf95-4087-88aa-57e4229a8397+5:10319:x1874741493291648:12345-0@lo:104: 00010000:00010000:1.0:1787892984.965390:0:6488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729a00/0x9232577658cf0b18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0b1f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.965423:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787892984.965435:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ad7764-cf95-4087-88aa-57e4229a8397+5:10319:x1874741493291648:12345-0@lo:104: Request processed in 51us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892984.965441:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787892984.965466:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787892984.965472:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ad7764-cf95-4087-88aa-57e4229a8397+4:10319:x1874741493291776:12345-0@lo:104: 00010000:00010000:1.0:1787892984.965479:0:6488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c200/0x9232577658cf0ad9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0ae0 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.965528:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787892984.965533:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ad7764-cf95-4087-88aa-57e4229a8397+4:10319:x1874741493291776:12345-0@lo:104: Request processed in 62us (1237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892984.965538:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787892984.965549:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787892984.965555:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ad7764-cf95-4087-88aa-57e4229a8397+3:10319:x1874741493291904:12345-0@lo:104: 00010000:00010000:1.0:1787892984.965562:0:6488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31600/0x9232577658cf0aaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0ab6 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.965602:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1787892984.965609:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ad7764-cf95-4087-88aa-57e4229a8397+3:10319:x1874741493291904:12345-0@lo:104: Request processed in 54us (1305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892984.965614:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787892984.965636:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493291008:0@lo:103: 00000100:00100000:1.0:1787892984.965668:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892984.965700:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787892984.965706:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493292032:0@lo:103: 00000100:00100000:1.0:1787892984.965726:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892984.965755:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493291008 00000100:00100000:1.0:1787892984.965766:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493291008 00010000:00010000:1.0:1787892984.965786:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9edb30600/0x9232577658cf0bc7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0bc0 expref: 22 pid: 6500 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892984.965817:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493292032 00000100:00100000:1.0:1787892984.965821:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493292032 00010000:00010000:1.0:1787892984.965831:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc8c771ec00/0x9232577658cf0b57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0b50 expref: 23 pid: 6497 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892984.965843:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787892984.965848:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ad7764-cf95-4087-88aa-57e4229a8397+23:3633:x1874741493291008:12345-0@lo:103: 00010000:00010000:1.0:1787892984.965858:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787892984.965862:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9edb30600/0x9232577658cf0bc7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0bc0 expref: 23 pid: 6500 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.965873:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9edb30600/0x9232577658cf0bc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf0bc0 expref: 23 pid: 6500 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.965888:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9edb30600/0x9232577658cf0bc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf0bc0 expref: 23 pid: 6500 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.965898:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787892984.965927:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ad7764-cf95-4087-88aa-57e4229a8397+22:3633:x1874741493291008:12345-0@lo:103: Request processed in 79us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892984.965934:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787892984.965946:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787892984.965952:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ad7764-cf95-4087-88aa-57e4229a8397+21:3633:x1874741493292032:12345-0@lo:103: 00010000:00010000:1.0:1787892984.965958:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787892984.965963:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc8c771ec00/0x9232577658cf0b57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0b50 expref: 21 pid: 6497 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.965981:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc8c771ec00/0x9232577658cf0b57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf0b50 expref: 21 pid: 6497 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.965991:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c771ec00/0x9232577658cf0b57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf0b50 expref: 21 pid: 6497 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.965999:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787892984.966022:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ad7764-cf95-4087-88aa-57e4229a8397+20:3633:x1874741493292032:12345-0@lo:103: Request processed in 71us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892984.966027:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787892984.966055:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493292032:0@lo:103: 00000100:00100000:1.0:1787892984.966064:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493291008:0@lo:103: 00010000:00010000:1.0:1787892984.966083:0:8435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787892984.966087:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729200/0x9232577658cf0b34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0b3b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.966094:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd729200 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:1.0:1787892984.966097:0:8435:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729200/0x9232577658cf0b34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf0b3b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.966105:0:8435:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729200/0x9232577658cf0b34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf0b3b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787892984.966112:0:8435:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729200/0x9232577658cf0b34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf0b3b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787892984.966118:0:8435:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787892984.966148:0:8435:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729200/0x9232577658cf0b34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0b3b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.966160:0:8435:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787892984.966173:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729200/0x9232577658cf0b34 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0b3b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.966178:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729200/0x9232577658cf0b34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0b3b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.966188:0:8435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787892984.966191:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540400/0x9232577658cf0b26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0b2d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.966197:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540400 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:1.0:1787892984.966200:0:8435:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540400/0x9232577658cf0b26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf0b2d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.966207:0:8435:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540400/0x9232577658cf0b26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf0b2d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787892984.966213:0:8435:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540400/0x9232577658cf0b26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf0b2d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787892984.966219:0:8435:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787892984.966232:0:8435:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540400/0x9232577658cf0b26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0b2d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.966238:0:8435:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787892984.966251:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540400/0x9232577658cf0b26 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0b2d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.966258:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540400/0x9232577658cf0b26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0b2d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.966274:0:8435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787892984.966277:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729a00/0x9232577658cf0b18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0b1f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.966282:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd729a00 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:1.0:1787892984.966285:0:8435:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729a00/0x9232577658cf0b18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf0b1f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.966293:0:8435:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729a00/0x9232577658cf0b18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf0b1f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787892984.966299:0:8435:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729a00/0x9232577658cf0b18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf0b1f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787892984.966304:0:8435:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787892984.966318:0:8435:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729a00/0x9232577658cf0b18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0b1f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.966324:0:8435:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787892984.966329:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729a00/0x9232577658cf0b18 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0b1f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.966335:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729a00/0x9232577658cf0b18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0b1f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.966359:0:8435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787892984.966362:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c200/0x9232577658cf0ad9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0ae0 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.966378:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c147c200 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:1.0:1787892984.966381:0:8435:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c200/0x9232577658cf0ad9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf0ae0 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.966389:0:8435:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c200/0x9232577658cf0ad9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf0ae0 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787892984.966395:0:8435:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c200/0x9232577658cf0ad9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf0ae0 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787892984.966400:0:8435:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787892984.966413:0:8435:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c200/0x9232577658cf0ad9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0ae0 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.966419:0:8435:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787892984.966424:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c200/0x9232577658cf0ad9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0ae0 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.966431:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c200/0x9232577658cf0ad9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0ae0 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.966440:0:8435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787892984.966444:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31600/0x9232577658cf0aaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0ab6 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.966449:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31600 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:1.0:1787892984.966452:0:8435:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31600/0x9232577658cf0aaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf0ab6 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.966469:0:8435:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31600/0x9232577658cf0aaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf0ab6 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787892984.966475:0:8435:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31600/0x9232577658cf0aaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf0ab6 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787892984.966481:0:8435:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787892984.966518:0:8435:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31600/0x9232577658cf0aaf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0ab6 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.966524:0:8435:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787892984.966528:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31600/0x9232577658cf0aaf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0ab6 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.966535:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31600/0x9232577658cf0aaf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0ab6 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.966547:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892984.966548:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892984.966550:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892984.966561:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7788380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493292544:0@lo:103: 00000100:00100000:1.0:1787892984.966588:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892984.966609:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787892984.966615:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493292160:0@lo:103: 00000100:00100000:1.0:1787892984.966637:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892984.966646:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493292672:0@lo:103: 00000100:00100000:1.0:1787892984.966664:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892984.966685:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7789f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493292416:0@lo:103: 00000100:00100000:1.0:1787892984.966728:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892984.966742:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787892984.966746:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493292288:0@lo:103: 00000100:00100000:1.0:1787892984.966766:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892984.966784:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493292544 00000100:00100000:1.0:1787892984.966788:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493292544 00010000:00010000:1.0:1787892984.966803:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9edb30000/0x9232577658cf0ae0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0ad9 expref: 20 pid: 6500 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892984.966815:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493292160 00000100:00100000:1.0:1787892984.966817:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493292160 00010000:00010000:1.0:1787892984.966825:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9fe541a00/0x9232577658cf0b3b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0b34 expref: 21 pid: 6500 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892984.966832:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493292672 00000100:00100000:1.0:1787892984.966834:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493292672 00010000:00010000:1.0:1787892984.966842:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9c147d600/0x9232577658cf0ab6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0aaf expref: 22 pid: 6500 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892984.966849:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493292416 00000100:00100000:1.0:1787892984.966850:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493292416 00010000:00010000:1.0:1787892984.966857:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9fe541e00/0x9232577658cf0b1f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0b18 expref: 23 pid: 6500 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892984.966865:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493292288 00000100:00100000:1.0:1787892984.966866:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493292288 00010000:00010000:1.0:1787892984.966875:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9edb30a00/0x9232577658cf0b2d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0b26 expref: 24 pid: 6499 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892984.966884:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787892984.966888:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ed563b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ad7764-cf95-4087-88aa-57e4229a8397+24:3632:x1874741493292544:12345-0@lo:103: 00010000:00010000:1.0:1787892984.966904:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787892984.966909:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9edb30000/0x9232577658cf0ae0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0ad9 expref: 24 pid: 6500 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.966916:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9edb30000/0x9232577658cf0ae0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf0ad9 expref: 24 pid: 6500 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.966926:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787892984.966954:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ed563b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ad7764-cf95-4087-88aa-57e4229a8397+24:3632:x1874741493292544:12345-0@lo:103: Request processed in 64us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892984.966962:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787892984.966976:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787892984.966982:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3efe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ad7764-cf95-4087-88aa-57e4229a8397+23:3632:x1874741493292160:12345-0@lo:103: 00010000:00010000:1.0:1787892984.966989:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787892984.966994:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9fe541a00/0x9232577658cf0b3b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0b34 expref: 23 pid: 6500 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.967003:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9fe541a00/0x9232577658cf0b3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf0b34 expref: 23 pid: 6500 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.967012:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787892984.967030:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3efe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ad7764-cf95-4087-88aa-57e4229a8397+23:3632:x1874741493292160:12345-0@lo:103: Request processed in 49us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892984.967035:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787892984.967071:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787892984.967077:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ed560700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ad7764-cf95-4087-88aa-57e4229a8397+22:3632:x1874741493292672:12345-0@lo:103: 00010000:00010000:1.0:1787892984.967084:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787892984.967088:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9c147d600/0x9232577658cf0ab6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0aaf expref: 22 pid: 6500 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.967103:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9c147d600/0x9232577658cf0ab6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf0aaf expref: 22 pid: 6500 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.967113:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787892984.967135:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ed560700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ad7764-cf95-4087-88aa-57e4229a8397+22:3632:x1874741493292672:12345-0@lo:103: Request processed in 57us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892984.967140:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787892984.967152:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787892984.967158:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c772fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ad7764-cf95-4087-88aa-57e4229a8397+21:3631:x1874741493292416:12345-0@lo:103: 00010000:00010000:1.0:1787892984.967164:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787892984.967168:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9fe541e00/0x9232577658cf0b1f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0b18 expref: 21 pid: 6500 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.967176:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9fe541e00/0x9232577658cf0b1f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf0b18 expref: 21 pid: 6500 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.967185:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787892984.967208:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c772fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ad7764-cf95-4087-88aa-57e4229a8397+21:3631:x1874741493292416:12345-0@lo:103: Request processed in 51us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892984.967214:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787892984.967225:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787892984.967231:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c772f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ad7764-cf95-4087-88aa-57e4229a8397+20:3631:x1874741493292288:12345-0@lo:103: 00010000:00010000:1.0:1787892984.967238:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787892984.967242:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9edb30a00/0x9232577658cf0b2d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0b26 expref: 20 pid: 6499 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.967251:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9edb30a00/0x9232577658cf0b2d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf0b26 expref: 20 pid: 6499 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.967269:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fc9edb31800/0x9232577658cf0c1b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.967277:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9edb31800/0x9232577658cf0c1b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.967291:0:6491:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc9edb31800/0x9232577658cf0c1b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.967298:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc9edb31800/0x9232577658cf0c1b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.967305:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fc9edb31800/0x9232577658cf0c1b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.967311:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fc9edb31800/0x9232577658cf0c1b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.967316:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31800 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:1.0:1787892984.967321:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fc9edb31800/0x9232577658cf0c1b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.967327:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fc9edb31800/0x9232577658cf0c1b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.967335:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fc9edb31800/0x9232577658cf0c1b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892984.967357:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787892984.967380:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c772f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ad7764-cf95-4087-88aa-57e4229a8397+20:3631:x1874741493292288:12345-0@lo:103: Request processed in 149us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892984.967394:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787892984.967426:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493292160:0@lo:103: 00000100:00100000:1.0:1787892984.967434:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493292672:0@lo:103: 00000100:00100000:1.0:1787892984.967441:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7788380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493292544:0@lo:103: 00000100:00100000:1.0:1787892984.967462:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493292288:0@lo:103: 00000100:00100000:1.0:1787892984.967469:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7789f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493292416:0@lo:103: 00010000:00010000:2.0:1787892984.967769:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892984.967877:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787892984.968103:0:10319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9fe541a00/0x9232577658cf0b3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf0b34 expref: 19 pid: 6500 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892984.968115:0:10319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10319:1874741493291392:0@lo:104: 00010000:00010000:0.0:1787892984.968151:0:10319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9edb30a00/0x9232577658cf0b2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf0b26 expref: 18 pid: 6499 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892984.968160:0:10319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10319:1874741493291520:0@lo:104: 00010000:00010000:0.0:1787892984.968169:0:10319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9fe541e00/0x9232577658cf0b1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf0b18 expref: 17 pid: 6500 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892984.968176:0:10319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10319:1874741493291648:0@lo:104: 00010000:00010000:0.0:1787892984.968198:0:10319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9edb30000/0x9232577658cf0ae0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf0ad9 expref: 16 pid: 6500 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892984.968206:0:10319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10319:1874741493291776:0@lo:104: 00010000:00010000:0.0:1787892984.968216:0:10319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9c147d600/0x9232577658cf0ab6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf0aaf expref: 15 pid: 6500 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892984.968223:0:10319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10319:1874741493291904:0@lo:104: 00010000:00010000:0.0:1787892984.968299:0:10319:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fc9edb31800/0x9232577658cf0c1b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892984.968310:0:10319:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fc9edb31800/0x9232577658cf0c1b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892984.968316:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fc9edb31800/0x9232577658cf0c1b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892984.968321:0:10319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9edb31800/0x9232577658cf0c1b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892985.373379:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787892985.373423:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787892985.373540:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481706496 00000100:00100000:0.0:1787892985.373552:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481706496 00000100:00100000:0.0:1787892985.373637:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 59 00000100:00100000:0.0:1787892985.373648:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+6:2392:x1874741481706496:12345-192.168.202.35@tcp:400: 00000100:00100000:0.0:1787892985.373730:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+6:2392:x1874741481706496:12345-192.168.202.35@tcp:400: Request processed in 84us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892985.373738:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 59 00000100:00100000:3.0:1787892985.373964:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481706368 00000100:00100000:3.0:1787892985.373969:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481706368 00000100:00080000:1.0:1787892985.373980:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787892985.374008:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 199 00000100:00100000:3.0:1787892985.374015:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+8:2392:x1874741481706368:12345-192.168.202.35@tcp:400: 00000100:00100000:3.0:1787892985.374056:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+8:2392:x1874741481706368:12345-192.168.202.35@tcp:400: Request processed in 41us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892985.374063:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 199 00000100:00100000:3.0:1787892985.376991:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787892985.377034:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787892985.377092:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787892985.377098:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481706624 00000100:00100000:1.0:1787892985.377107:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481706624 00000100:00100000:0.0:1787892985.377190:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481706752 00000100:00100000:0.0:1787892985.377194:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481706752 00000100:00100000:1.0:1787892985.377212:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 60 00000100:00100000:1.0:1787892985.377222:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c71b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+5:2393:x1874741481706624:12345-192.168.202.35@tcp:400: 00000100:00100000:0.0:1787892985.377229:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481706880 00000100:00100000:0.0:1787892985.377232:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481706880 00000100:00100000:0.0:1787892985.377252:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 14 00000100:00100000:0.0:1787892985.377259:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c71b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+5:2393:x1874741481706752:12345-192.168.202.35@tcp:400: 00000100:00100000:0.0:1787892985.377344:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c71b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+5:2393:x1874741481706752:12345-192.168.202.35@tcp:400: Request processed in 76us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892985.377352:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 14 00000100:00100000:0.0:1787892985.377368:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 15 00000100:00100000:0.0:1787892985.377375:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+5:2393:x1874741481706880:12345-192.168.202.35@tcp:400: 00000100:00100000:0.0:1787892985.377399:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+5:2393:x1874741481706880:12345-192.168.202.35@tcp:400: Request processed in 26us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892985.377406:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 15 00000100:00100000:1.0:1787892985.377436:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c71b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+5:2393:x1874741481706624:12345-192.168.202.35@tcp:400: Request processed in 215us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892985.377442:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 60 00000100:00080000:3.0:1787892985.377526:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787892985.377530:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787892985.377532:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787892985.524145:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c772dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493292800:0@lo:41: 00000100:00100000:3.0:1787892985.524221:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787892985.524531:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787892985.524959:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493292800 00000100:00100000:0.0:1787892985.524970:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493292800 00000100:00100000:0.0:1787892985.525028:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787892985.525038:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493292800:12345-0@lo:41: 00000004:00000024:0.0:1787892985.525076:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787892985.525143:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493292800:12345-0@lo:41: Request processed in 106us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892985.525150:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787892985.525290:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c772dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493292800:0@lo:41: 10000000:01000000:1.0:1787892986.161621:0:6502:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787892986.161628:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc9e70bc000 from 48 10000000:01000000:1.0:1787892986.161634:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787892986.161693:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540800/0x9232577658cf0c22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892986.161705:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540800/0x9232577658cf0c22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892986.161751:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540800/0x9232577658cf0c22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892986.161787:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c772dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493292928:0@lo:101: 00000100:00100000:1.0:1787892986.161864:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892986.161958:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fe47f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787892986.162190:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493292928 00000100:00100000:0.0:1787892986.162199:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493292928 00000100:00100000:0.0:1787892986.162267:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787892986.162278:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+15:6502:x1874741493292928:12345-0@lo:101: 00010000:00010000:0.0:1787892986.162292:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787892986.162305:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9edb30a00/0x9232577658cf0c29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0c22 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892986.162352:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9edb30a00/0x9232577658cf0c29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0c22 expref: 16 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892986.162363:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9edb30a00/0x9232577658cf0c29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0c22 expref: 16 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892986.162374:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb30a00, rc 0) 00000100:00100000:0.0:1787892986.162426:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+16:6502:x1874741493292928:12345-0@lo:101: Request processed in 150us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892986.162433:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1787892986.162583:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c772dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493292928:0@lo:101: 00010000:00010000:1.0:1787892986.162597:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540800/0x9232577658cf0c22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0c29 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892986.162606:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540800/0x9232577658cf0c22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0c29 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892986.162665:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c772dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493293056:0@lo:501: 00000100:00100000:1.0:1787892986.162692:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892986.162717:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fe47f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787892986.163144:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493293056 00000100:00100000:0.0:1787892986.163150:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493293056 00000100:00100000:0.0:1787892986.163185:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1787892986.163193:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+16:6502:x1874741493293056:12345-0@lo:501: 00000100:00100000:0.0:1787892986.163468:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+16:6502:x1874741493293056:12345-0@lo:501: Request processed in 275us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892986.163475:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787892986.165737:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c772dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493293056:0@lo:501: 00000100:00100000:1.0:1787892986.165833:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c772dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493293184:0@lo:503: 00000100:00100000:1.0:1787892986.165922:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892986.165968:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fe47f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787892986.166015:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493293184 00000100:00100000:3.0:1787892986.166022:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493293184 00000100:00100000:3.0:1787892986.166074:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787892986.166085:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+16:6502:x1874741493293184:12345-0@lo:503: 00000100:00100000:3.0:1787892986.166201:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+16:6502:x1874741493293184:12345-0@lo:503: Request processed in 118us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892986.166209:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787892986.166537:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c772dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493293184:0@lo:503: 00000100:00100000:3.0:1787892986.169139:0:10336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10336:1874741493293312:0@lo:502: 00000100:00100000:3.0:1787892986.169295:0:10336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892986.169398:0:10336:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e72b3240 going to sleep for 11 seconds 00000100:00100000:0.0:1787892986.174422:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493293312 00000100:00100000:0.0:1787892986.174441:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493293312 00000100:00100000:0.0:1787892986.174533:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1787892986.174545:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+16:10336:x1874741493293312:12345-0@lo:502: 00000100:00100000:0.0:1787892986.175083:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+16:10336:x1874741493293312:12345-0@lo:502: Request processed in 538us (5853us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892986.175093:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787892986.178430:0:10336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10336:1874741493293312:0@lo:502: 00000100:00100000:3.0:1787892986.178549:0:10336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10336:1874741493293440:0@lo:502: 00000100:00100000:3.0:1787892986.178631:0:10336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892986.178690:0:10336:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e72b3240 going to sleep for 11 seconds 00000100:00100000:0.0:1787892986.179208:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493293440 00000100:00100000:0.0:1787892986.179225:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493293440 00000100:00100000:0.0:1787892986.179296:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1787892986.179306:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+16:10336:x1874741493293440:12345-0@lo:502: 00000100:00100000:0.0:1787892986.179451:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+16:10336:x1874741493293440:12345-0@lo:502: Request processed in 146us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892986.179458:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787892986.179661:0:10336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10336:1874741493293440:0@lo:502: 00000040:00080000:3.0:1787892986.179688:0:10336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1787892986.180241:0:6502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1787892986.180267:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787892986.180277:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540800/0x9232577658cf0c22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0c29 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892986.180288:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540800/0x9232577658cf0c22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0c29 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787892986.180298:0:6502:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1787892986.180301:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1787892986.180304:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787892986.180343:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31400/0x9232577658cf0c30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892986.180352:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31400/0x9232577658cf0c30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892986.180362:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31400/0x9232577658cf0c30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892986.180380:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493293568:0@lo:101: 00000100:00100000:0.0:1787892986.180421:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892986.180461:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c76993c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787892986.180703:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493293568 00000100:00100000:1.0:1787892986.180710:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493293568 00000100:00100000:1.0:1787892986.180754:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1787892986.180773:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+16:6502:x1874741493293568:12345-0@lo:101: 00010000:00010000:1.0:1787892986.180783:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787892986.180805:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9fe541000/0x9232577658cf0c37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0c30 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892986.180827:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9fe541000/0x9232577658cf0c37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0c30 expref: 17 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892986.180838:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9fe541000/0x9232577658cf0c37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0c30 expref: 17 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892986.180847:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe541000, rc 0) 00000100:00100000:1.0:1787892986.180951:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+17:6502:x1874741493293568:12345-0@lo:101: Request processed in 189us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892986.180958:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1787892986.185352:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493293568:0@lo:101: 00010000:00010000:2.0:1787892986.185382:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31400/0x9232577658cf0c30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0c37 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892986.185412:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31400/0x9232577658cf0c30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0c37 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892986.185750:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493293696:0@lo:501: 00000100:00100000:2.0:1787892986.186363:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892986.186450:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d0e1fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787892986.195440:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493293696 00000100:00100000:1.0:1787892986.195458:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493293696 00000100:00100000:1.0:1787892986.195673:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787892986.195685:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+17:6502:x1874741493293696:12345-0@lo:501: 00000100:00100000:1.0:1787892986.196132:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+17:6502:x1874741493293696:12345-0@lo:501: Request processed in 449us (9769us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892986.196140:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1787892986.196253:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493293696:0@lo:501: 00000100:00100000:2.0:1787892986.196302:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493293824:0@lo:503: 00000100:00100000:2.0:1787892986.196367:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892986.196406:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d0e1fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787892986.196674:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493293824 00000100:00100000:0.0:1787892986.196687:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493293824 00000100:00100000:0.0:1787892986.196718:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1787892986.196724:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+17:6502:x1874741493293824:12345-0@lo:503: 00000100:00100000:0.0:1787892986.196845:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+17:6502:x1874741493293824:12345-0@lo:503: Request processed in 120us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892986.196851:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1787892986.197057:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493293824:0@lo:503: 00000100:00100000:1.0:1787892986.198167:0:10337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c772f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10337:1874741493293952:0@lo:502: 00000100:00100000:1.0:1787892986.198251:0:10337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892986.198361:0:10337:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fe47f180 going to sleep for 11 seconds 00000100:00100000:0.0:1787892986.201274:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493293952 00000100:00100000:0.0:1787892986.201291:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493293952 00000100:00100000:0.0:1787892986.201408:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1787892986.201420:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+17:10337:x1874741493293952:12345-0@lo:502: 00000100:00100000:0.0:1787892986.201626:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+17:10337:x1874741493293952:12345-0@lo:502: Request processed in 208us (3374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892986.201634:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787892986.201749:0:10337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c772f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10337:1874741493293952:0@lo:502: 00000020:01000000:1.0:1787892986.201798:0:10337:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787892986.201808:0:10337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787892986.201810:0:10337:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787892986.201816:0:10337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787892986.201854:0:10337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c772f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10337:1874741493294080:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787892986.201932:0:10337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892986.209668:0:10337:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fe47f180 going to sleep for 11 seconds 00000100:00100000:3.0:1787892986.211010:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493294080 00000100:00100000:3.0:1787892986.211024:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493294080 00000100:00100000:3.0:1787892986.211080:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1787892986.211090:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+17:10337:x1874741493294080:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787892986.211433:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+17:10337:x1874741493294080:12345-0@lo:502:llog_process_th.0 Request processed in 335us (9492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892986.211442:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1787892986.211749:0:10337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c772f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10337:1874741493294080:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787892986.211793:0:10337:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787892986.211802:0:10337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787892986.211804:0:10337:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787892986.211808:0:10337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:0.0:1787892986.212708:0:6502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1787892986.212737:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787892986.212748:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31400/0x9232577658cf0c30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0c37 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892986.212760:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31400/0x9232577658cf0c30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0c37 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787892986.212778:0:6502:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787892986.212781:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc9fe136000 from 48 10000000:01000000:0.0:1787892986.212784:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787892986.212829:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30200/0x9232577658cf0c3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892986.212837:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30200/0x9232577658cf0c3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892986.212863:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30200/0x9232577658cf0c3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892986.212897:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493294208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787892986.213078:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892986.213119:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c76999c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787892986.213339:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493294208 00000100:00100000:3.0:1787892986.213346:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493294208 00000100:00100000:3.0:1787892986.213389:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1787892986.213399:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+17:6502:x1874741493294208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787892986.213411:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787892986.213422:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9c147c800/0x9232577658cf0c45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0c3e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892986.213452:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9c147c800/0x9232577658cf0c45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0c3e expref: 18 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892986.213463:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9c147c800/0x9232577658cf0c45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0c3e expref: 18 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892986.213470:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9c147c800, rc 0) 00000100:00100000:3.0:1787892986.213556:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+18:6502:x1874741493294208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892986.213563:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1787892986.214122:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493294208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787892986.214138:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30200/0x9232577658cf0c3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0c45 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892986.214147:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30200/0x9232577658cf0c3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0c45 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892986.214211:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493294336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787892986.214322:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892986.214368:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d0e1fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787892986.214561:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493294336 00000100:00100000:0.0:1787892986.214567:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493294336 00000100:00100000:0.0:1787892986.214605:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1787892986.214613:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+18:6502:x1874741493294336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787892986.214725:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+18:6502:x1874741493294336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892986.214732:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1787892986.215027:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493294336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787892986.215059:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493294464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787892986.215109:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892986.215128:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d0e1fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787892986.215199:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493294464 00000100:00100000:0.0:1787892986.215204:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493294464 00000100:00100000:3.0:1787892986.215310:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1787892986.215322:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+18:6502:x1874741493294464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787892986.215421:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+18:6502:x1874741493294464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 102us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892986.215436:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1787892986.215582:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493294464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787892986.216654:0:10338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10338:1874741493294592:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787892986.216711:0:10338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892986.216746:0:10338:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d0e1f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787892986.216793:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493294592 00000100:00100000:3.0:1787892986.216800:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493294592 00000100:00100000:3.0:1787892986.216840:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1787892986.216848:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+18:10338:x1874741493294592:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787892986.219654:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+18:10338:x1874741493294592:12345-0@lo:502:llog_process_th.0 Request processed in 2796us (2933us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892986.219669:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1787892986.219960:0:10338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10338:1874741493294592:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787892986.220037:0:10338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10338:1874741493294720:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787892986.220086:0:10338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892986.220129:0:10338:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7699000 going to sleep for 11 seconds 00000100:00100000:2.0:1787892986.220308:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493294720 00000100:00100000:2.0:1787892986.220315:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493294720 00000100:00100000:2.0:1787892986.220368:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1787892986.220377:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+18:10338:x1874741493294720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787892986.220980:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+18:10338:x1874741493294720:12345-0@lo:502:llog_process_th.0 Request processed in 602us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892986.220989:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1787892986.223073:0:10338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10338:1874741493294720:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787892986.223121:0:10338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1787892986.242402:0:6502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1787892986.242444:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787892986.242456:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30200/0x9232577658cf0c3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0c45 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892986.242469:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30200/0x9232577658cf0c3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0c45 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892986.242480:0:6502:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787892986.242482:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1787892986.242485:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787892986.243097:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c771e600/0x9232577658cf0c4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892986.243107:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc8c771e600/0x9232577658cf0c4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892986.243134:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc8c771e600/0x9232577658cf0c4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892986.243158:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493294848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787892986.243308:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892986.243413:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d0e1f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787892986.244657:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493294848 00000100:00100000:3.0:1787892986.244670:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493294848 00000100:00100000:3.0:1787892986.245007:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1787892986.245020:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+18:6502:x1874741493294848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787892986.245037:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787892986.245054:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9c147d200/0x9232577658cf0c53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0c4c expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892986.245080:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9c147d200/0x9232577658cf0c53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0c4c expref: 19 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892986.245091:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9c147d200/0x9232577658cf0c53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0c4c expref: 19 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892986.245112:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9c147d200, rc 0) 00000100:00100000:3.0:1787892986.245182:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+19:6502:x1874741493294848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (1953us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892986.245188:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1787892986.245273:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493294848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787892986.245290:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc8c771e600/0x9232577658cf0c4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0c53 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892986.245310:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc8c771e600/0x9232577658cf0c4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0c53 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892986.245393:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493294976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787892986.245425:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892986.245596:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7699000 going to sleep for 11 seconds 00000100:00100000:2.0:1787892986.245702:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493294976 00000100:00100000:2.0:1787892986.245708:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493294976 00000100:00100000:2.0:1787892986.245732:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1787892986.245739:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+19:6502:x1874741493294976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787892986.246192:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+19:6502:x1874741493294976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 452us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892986.246200:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1787892986.246340:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493294976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787892986.246370:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493295104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787892986.246412:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892986.246434:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7699000 going to sleep for 11 seconds 00000100:00100000:2.0:1787892986.246482:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493295104 00000100:00100000:2.0:1787892986.246487:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493295104 00000100:00100000:2.0:1787892986.246534:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1787892986.246540:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+19:6502:x1874741493295104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787892986.246617:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+19:6502:x1874741493295104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892986.246625:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1787892986.246745:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493295104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787892986.248075:0:10339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10339:1874741493295232:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787892986.248134:0:10339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892986.248202:0:10339:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c623fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1787892986.248313:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493295232 00000100:00100000:2.0:1787892986.248320:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493295232 00000100:00100000:3.0:1787892986.248464:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1787892986.248473:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+19:10339:x1874741493295232:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787892986.248736:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+19:10339:x1874741493295232:12345-0@lo:502:llog_process_th.0 Request processed in 263us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892986.248744:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1787892986.249170:0:10339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10339:1874741493295232:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787892986.249208:0:10339:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787892986.249217:0:10339:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787892986.249220:0:10339:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787892986.249225:0:10339:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787892986.249321:0:10339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10339:1874741493295360:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787892986.249371:0:10339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892986.249435:0:10339:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c76999c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787892986.249475:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493295360 00000100:00100000:3.0:1787892986.249480:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493295360 00000100:00100000:3.0:1787892986.249638:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1787892986.249647:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+19:10339:x1874741493295360:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787892986.249737:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+19:10339:x1874741493295360:12345-0@lo:502:llog_process_th.0 Request processed in 91us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892986.249745:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1787892986.249818:0:10339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10339:1874741493295360:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787892986.249838:0:10339:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787892986.249843:0:10339:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787892986.249845:0:10339:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787892986.249848:0:10339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:3.0:1787892986.250419:0:6502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1787892986.250442:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787892986.250452:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c771e600/0x9232577658cf0c4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0c53 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892986.250463:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc8c771e600/0x9232577658cf0c4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0c53 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787892986.250481:0:6502:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787892986.250484:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc9ed573800 from 48 10000000:01000000:3.0:1787892986.250487:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787892986.250558:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf0c5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892986.250567:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf0c5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892986.250576:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf0c5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892986.250592:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493295488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787892986.250627:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892986.250648:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c623ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787892986.250715:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493295488 00000100:00100000:2.0:1787892986.250721:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493295488 00000100:00100000:2.0:1787892986.250756:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1787892986.250816:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+19:6502:x1874741493295488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787892986.250834:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787892986.250846:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c771f800/0x9232577658cf0c61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0c5a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892986.251029:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c771f800/0x9232577658cf0c61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0c5a expref: 20 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892986.251042:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c771f800/0x9232577658cf0c61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0c5a expref: 20 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892986.251051:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c771f800, rc 0) 00000100:00100000:2.0:1787892986.251096:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+20:6502:x1874741493295488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 332us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892986.251103:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1787892986.251177:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493295488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787892986.251190:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf0c5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0c61 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892986.251199:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf0c5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0c61 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892986.251617:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493295616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787892986.251648:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892986.251709:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c623ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787892986.251746:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493295616 00000100:00100000:0.0:1787892986.251751:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493295616 00000100:00100000:0.0:1787892986.251851:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1787892986.251860:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+20:6502:x1874741493295616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787892986.252181:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+20:6502:x1874741493295616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 322us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892986.252188:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787892986.252308:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493295616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787892986.252348:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493295744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787892986.252396:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892986.252417:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c623ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1787892986.252464:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493295744 00000100:00100000:1.0:1787892986.252469:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493295744 00000100:00100000:1.0:1787892986.254153:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1787892986.254183:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+20:6502:x1874741493295744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787892986.254525:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+20:6502:x1874741493295744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 356us (2128us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892986.254533:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1787892986.254650:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493295744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787892986.255423:0:10340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10340:1874741493295872:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787892986.255480:0:10340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892986.255684:0:10340:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c5c9f000 going to sleep for 11 seconds 00000100:00100000:0.0:1787892986.255723:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493295872 00000100:00100000:0.0:1787892986.255730:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493295872 00000100:00100000:0.0:1787892986.255808:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787892986.255818:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+20:10340:x1874741493295872:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787892986.255941:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+20:10340:x1874741493295872:12345-0@lo:502:llog_process_th.0 Request processed in 123us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892986.255948:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787892986.256019:0:10340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10340:1874741493295872:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787892986.256058:0:10340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10340:1874741493296000:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787892986.256085:0:10340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892986.258370:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493296000 00000100:00100000:2.0:1787892986.258384:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493296000 00000100:00100000:3.0:1787892986.258435:0:10340:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c623ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787892986.265950:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787892986.265974:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+20:10340:x1874741493296000:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787892986.266154:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+20:10340:x1874741493296000:12345-0@lo:502:llog_process_th.0 Request processed in 191us (10066us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892986.266161:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787892986.266666:0:10340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10340:1874741493296000:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787892986.266708:0:10340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1787892986.268842:0:6502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1787892986.268893:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787892986.268914:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf0c5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0c61 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892986.268928:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf0c5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0c61 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787892986.268961:0:6502:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1787892986.268964:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:0.0:1787892986.268967:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1787892986.269005:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf0c68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892986.269012:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf0c68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892986.269023:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf0c68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892986.269048:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493296128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787892986.269118:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892986.269168:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9edf37240 going to sleep for 11 seconds 00000100:00100000:1.0:1787892986.270068:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493296128 00000100:00100000:1.0:1787892986.270078:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493296128 00000100:00100000:1.0:1787892986.270134:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1787892986.270144:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+20:6502:x1874741493296128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787892986.270159:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787892986.270187:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9fe540200/0x9232577658cf0c6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0c68 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892986.270211:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9fe540200/0x9232577658cf0c6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0c68 expref: 21 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892986.270222:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9fe540200/0x9232577658cf0c6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0c68 expref: 21 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892986.270571:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe540200, rc 0) 00000100:00100000:1.0:1787892986.270643:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+21:6502:x1874741493296128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 499us (1525us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892986.270650:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787892986.270756:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493296128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787892986.270784:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf0c68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0c6f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892986.270794:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf0c68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0c6f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892986.270883:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493296256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787892986.270925:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892986.270958:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c3aa9480 going to sleep for 11 seconds 00000100:00100000:3.0:1787892986.272048:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493296256 00000100:00100000:3.0:1787892986.272060:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493296256 00000100:00100000:3.0:1787892986.272106:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1787892986.272116:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+21:6502:x1874741493296256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787892986.272336:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+21:6502:x1874741493296256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 211us (1399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892986.272344:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1787892986.272701:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493296256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787892986.272746:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493296384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787892986.272805:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892986.272828:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c3aa9480 going to sleep for 11 seconds 00000100:00100000:2.0:1787892986.272842:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493296384 00000100:00100000:2.0:1787892986.272846:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493296384 00000100:00100000:2.0:1787892986.272885:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787892986.272891:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+21:6502:x1874741493296384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787892986.272985:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+21:6502:x1874741493296384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892986.272992:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787892986.273033:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493296384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787892986.273953:0:10341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10341:1874741493296512:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787892986.274000:0:10341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892986.274022:0:10341:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d1c35f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787892986.274076:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493296512 00000100:00100000:1.0:1787892986.274082:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493296512 00000100:00100000:1.0:1787892986.274118:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787892986.274126:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+21:10341:x1874741493296512:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787892986.274214:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+21:10341:x1874741493296512:12345-0@lo:502:llog_process_th.0 Request processed in 88us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892986.274222:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787892986.274390:0:10341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10341:1874741493296512:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787892986.274421:0:10341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787892986.274433:0:10341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787892986.274435:0:10341:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787892986.274444:0:10341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787892986.274467:0:10341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10341:1874741493296640:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787892986.274519:0:10341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892986.274541:0:10341:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d24f2540 going to sleep for 11 seconds 00000100:00100000:3.0:1787892986.274665:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493296640 00000100:00100000:3.0:1787892986.274669:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493296640 00000100:00100000:3.0:1787892986.274702:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787892986.274710:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+21:10341:x1874741493296640:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787892986.274806:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+21:10341:x1874741493296640:12345-0@lo:502:llog_process_th.0 Request processed in 96us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892986.274820:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1787892986.274983:0:10341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10341:1874741493296640:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787892986.275005:0:10341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787892986.275010:0:10341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787892986.275012:0:10341:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787892986.275015:0:10341:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:3.0:1787892986.275461:0:6502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:3.0:1787892986.275484:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1787892986.275526:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf0c68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0c6f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892986.275535:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf0c68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0c6f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787892986.275544:0:6502:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787892986.275547:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc9d909c800 from 48 10000000:01000000:3.0:1787892986.275549:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787892986.275573:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf0c76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892986.275580:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf0c76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892986.275589:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf0c76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892986.275604:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493296768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787892986.275636:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892986.275659:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9f3517540 going to sleep for 11 seconds 00000100:00100000:2.0:1787892986.275715:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493296768 00000100:00100000:2.0:1787892986.275720:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493296768 00000100:00100000:2.0:1787892986.275756:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787892986.275971:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+21:6502:x1874741493296768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787892986.275982:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787892986.275994:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c771e800/0x9232577658cf0c7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0c76 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892986.276016:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c771e800/0x9232577658cf0c7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0c76 expref: 22 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892986.276026:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c771e800/0x9232577658cf0c7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0c76 expref: 22 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892986.276034:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c771e800, rc 0) 00000100:00100000:2.0:1787892986.276107:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+22:6502:x1874741493296768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 344us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892986.276114:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1787892986.278111:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493296768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787892986.278138:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf0c76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0c7d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892986.278170:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf0c76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0c7d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892986.278336:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493296896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787892986.278394:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892986.278436:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9f3517540 going to sleep for 11 seconds 00000100:00100000:1.0:1787892986.278522:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493296896 00000100:00100000:1.0:1787892986.278529:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493296896 00000100:00100000:1.0:1787892986.278572:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1787892986.278581:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+22:6502:x1874741493296896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787892986.278887:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+22:6502:x1874741493296896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 305us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892986.278896:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787892986.279315:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493296896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787892986.283614:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493297024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787892986.283709:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892986.283889:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9f3517240 going to sleep for 11 seconds 00000100:00100000:2.0:1787892986.284025:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493297024 00000100:00100000:2.0:1787892986.284034:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493297024 00000100:00100000:2.0:1787892986.284127:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787892986.284138:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+22:6502:x1874741493297024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787892986.284262:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+22:6502:x1874741493297024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892986.284270:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787892986.284353:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493297024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787892986.284776:0:10342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10342:1874741493297152:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787892986.284810:0:10342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892986.285255:0:10342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9f35173c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787892986.285359:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493297152 00000100:00100000:1.0:1787892986.285366:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493297152 00000100:00100000:1.0:1787892986.285397:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1787892986.285405:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+22:10342:x1874741493297152:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787892986.285540:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+22:10342:x1874741493297152:12345-0@lo:502:llog_process_th.0 Request processed in 135us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892986.285547:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787892986.286563:0:10342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10342:1874741493297152:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787892986.286633:0:10342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10342:1874741493297280:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787892986.286681:0:10342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892986.286710:0:10342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9f35173c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787892986.286993:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493297280 00000100:00100000:1.0:1787892986.287000:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493297280 00000100:00100000:1.0:1787892986.287030:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787892986.287038:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+22:10342:x1874741493297280:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787892986.287136:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+22:10342:x1874741493297280:12345-0@lo:502:llog_process_th.0 Request processed in 98us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892986.287143:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787892986.288538:0:10342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10342:1874741493297280:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787892986.288580:0:10342:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1787892986.288750:0:6502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1787892986.288781:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787892986.288792:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf0c76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0c7d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892986.288802:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf0c76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0c7d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787892986.288812:0:6502:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787892986.288815:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:1.0:1787892986.288818:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787892986.288855:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541800/0x9232577658cf0c84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892986.288873:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541800/0x9232577658cf0c84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892986.288883:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541800/0x9232577658cf0c84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892986.288906:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c772f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493297408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787892986.288954:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892986.289000:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e70e6480 going to sleep for 11 seconds 00000100:00100000:2.0:1787892986.289182:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493297408 00000100:00100000:2.0:1787892986.289189:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493297408 00000100:00100000:2.0:1787892986.289314:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787892986.289324:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+22:6502:x1874741493297408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787892986.289347:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787892986.289360:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c771f000/0x9232577658cf0c8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0c84 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892986.289381:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c771f000/0x9232577658cf0c8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0c84 expref: 23 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892986.289391:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c771f000/0x9232577658cf0c8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0c84 expref: 23 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892986.289399:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c771f000, rc 0) 00000100:00100000:2.0:1787892986.289433:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+23:6502:x1874741493297408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892986.289440:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1787892986.289993:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c772f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493297408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787892986.290008:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541800/0x9232577658cf0c84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0c8b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892986.290018:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541800/0x9232577658cf0c84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0c8b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892986.290074:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c772f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493297536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787892986.290104:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892986.290136:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e70e6480 going to sleep for 11 seconds 00000100:00100000:2.0:1787892986.290223:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493297536 00000100:00100000:2.0:1787892986.290294:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493297536 00000100:00100000:2.0:1787892986.290337:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787892986.290345:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+23:6502:x1874741493297536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787892986.290458:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+23:6502:x1874741493297536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892986.290465:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787892986.290593:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c772f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493297536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787892986.290618:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c772f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493297664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787892986.290661:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892986.290686:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e70e6480 going to sleep for 11 seconds 00000100:00100000:2.0:1787892986.290734:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493297664 00000100:00100000:2.0:1787892986.290739:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493297664 00000100:00100000:2.0:1787892986.290836:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1787892986.290845:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+23:6502:x1874741493297664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787892986.290953:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+23:6502:x1874741493297664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892986.290967:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787892986.291038:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c772f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493297664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787892986.291788:0:10343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c772f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10343:1874741493297792:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787892986.291837:0:10343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892986.292259:0:10343:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e70e6600 going to sleep for 11 seconds 00000100:00100000:3.0:1787892986.292373:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493297792 00000100:00100000:3.0:1787892986.292380:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493297792 00000100:00100000:3.0:1787892986.292416:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787892986.292425:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+23:10343:x1874741493297792:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787892986.292565:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+23:10343:x1874741493297792:12345-0@lo:502:llog_process_th.0 Request processed in 140us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892986.292573:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1787892986.292657:0:10343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c772f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10343:1874741493297792:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787892986.292686:0:10343:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787892986.292695:0:10343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787892986.292698:0:10343:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787892986.292702:0:10343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787892986.292725:0:10343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c772f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10343:1874741493297920:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787892986.292824:0:10343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892986.292847:0:10343:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e70e6600 going to sleep for 11 seconds 00000100:00100000:3.0:1787892986.293002:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493297920 00000100:00100000:3.0:1787892986.293008:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493297920 00000100:00100000:3.0:1787892986.293026:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787892986.293031:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+23:10343:x1874741493297920:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787892986.293105:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+23:10343:x1874741493297920:12345-0@lo:502:llog_process_th.0 Request processed in 72us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892986.293111:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787892986.293219:0:10343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c772f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10343:1874741493297920:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787892986.293302:0:10343:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787892986.293307:0:10343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787892986.293308:0:10343:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787892986.293312:0:10343:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1787892986.293669:0:6502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:2.0:1787892986.293687:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787892986.293697:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541800/0x9232577658cf0c84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0c8b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892986.293707:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541800/0x9232577658cf0c84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0c8b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787892986.293817:0:6502:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787892986.293820:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fc9e2e3b370 from 1 10000000:01000000:3.0:1787892986.293823:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787892986.293849:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c000/0x9232577658cf0c92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892986.293857:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c000/0x9232577658cf0c92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892986.293990:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c000/0x9232577658cf0c92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892986.294008:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493298048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787892986.294040:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892986.294098:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9f3517600 going to sleep for 11 seconds 00000100:00100000:2.0:1787892986.294131:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493298048 00000100:00100000:2.0:1787892986.294136:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493298048 00000100:00100000:2.0:1787892986.294198:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1787892986.294205:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+23:6502:x1874741493298048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787892986.294215:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787892986.294225:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c771ea00/0x9232577658cf0c99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0c92 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892986.294309:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c771ea00/0x9232577658cf0c99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0c92 expref: 24 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892986.294319:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c771ea00/0x9232577658cf0c99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0c92 expref: 24 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892986.294337:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c771ea00, rc 0) 00000100:00100000:2.0:1787892986.294407:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+24:6502:x1874741493298048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 203us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892986.294414:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787892986.294477:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493298048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787892986.294652:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c000/0x9232577658cf0c92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0c99 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892986.294673:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c000/0x9232577658cf0c92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0c99 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892986.294724:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493298176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787892986.294755:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892986.294872:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9f3517600 going to sleep for 11 seconds 00000100:00100000:2.0:1787892986.295039:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493298176 00000100:00100000:2.0:1787892986.295050:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493298176 00000100:00100000:2.0:1787892986.295084:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1787892986.295091:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+24:6502:x1874741493298176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787892986.295157:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+24:6502:x1874741493298176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 65us (401us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787892986.295164:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787892986.295315:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493298176:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1787892986.295349:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787892986.295354:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c000/0x9232577658cf0c92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0c99 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892986.295362:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c000/0x9232577658cf0c92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0c99 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892986.545774:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787892986.547203:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787892986.547227:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493298304:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787892986.547298:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892986.547514:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493298304 00000100:00100000:0.0:1787892986.547523:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493298304 00000100:00100000:0.0:1787892986.547671:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787892986.547681:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493298304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787892986.547727:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787892986.547788:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493298304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892986.547795:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787892986.547875:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493298304:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787892987.058050:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787892987.058074:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493298432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787892987.058145:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892987.058293:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493298432 00000100:00100000:2.0:1787892987.058301:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493298432 00000100:00080000:3.0:1787892987.058415:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787892987.058751:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787892987.058770:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493298432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787892987.058800:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787892987.058851:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493298432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892987.058857:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1787892987.058936:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e711c700 x1874741493298432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893003 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892987.058954:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493298432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787892987.061191:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c772d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493298944:0@lo:400:kworker.0 00000100:00100000:1.0:1787892987.061257:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892987.061291:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c772f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1874741493299456:0@lo:400:kworker.0 00000100:00100000:1.0:1787892987.061312:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892987.061359:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787892987.061366:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c772f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493298560:0@lo:400:kworker.0 00000100:00100000:1.0:1787892987.061388:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892987.061407:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c772e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493299072:0@lo:400:kworker.0 00000100:00100000:1.0:1787892987.061426:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892987.061442:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c772ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493299584:0@lo:400:kworker.0 00000100:00100000:1.0:1787892987.061460:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892987.061506:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493298944 00000100:00100000:1.0:1787892987.061513:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493298944 00000100:00100000:1.0:1787892987.061561:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493299456 00000100:00100000:1.0:1787892987.061564:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493299456 00000100:00100000:1.0:1787892987.061576:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493298560 00000100:00100000:1.0:1787892987.061578:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493298560 00000100:00100000:1.0:1787892987.061586:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493299072 00000100:00100000:1.0:1787892987.061588:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493299072 00000100:00100000:1.0:1787892987.061599:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493299584 00000100:00100000:1.0:1787892987.061614:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493299584 00000100:00100000:1.0:1787892987.061635:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787892987.061644:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c772ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493298944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787892987.061691:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c772ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493298944:12345-0@lo:400:kworker.0 Request processed in 48us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892987.061698:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787892987.061714:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787892987.061720:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c772d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1874741493299456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787892987.061744:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c772d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1874741493299456:12345-0@lo:400:kworker.0 Request processed in 26us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892987.061750:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787892987.061759:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787892987.061765:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c772c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493298560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787892987.061790:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c772c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493298560:12345-0@lo:400:kworker.0 Request processed in 26us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892987.061795:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787892987.061805:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787892987.061811:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c772ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493299072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787892987.061837:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c772ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493299072:12345-0@lo:400:kworker.0 Request processed in 27us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892987.061842:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787892987.061853:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787892987.061859:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c772d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493299584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787892987.061971:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c772d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493299584:12345-0@lo:400:kworker.0 Request processed in 111us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892987.061987:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787892987.062016:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c772df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493298816:0@lo:400:kworker.0 00000100:00100000:1.0:1787892987.062046:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892987.062064:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c772c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493299328:0@lo:400:kworker.0 00000100:00100000:1.0:1787892987.062087:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892987.062107:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787892987.062113:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c772ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1874741493298688:0@lo:400:kworker.0 00000100:00100000:1.0:1787892987.062134:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892987.062149:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c772e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493299200:0@lo:400:kworker.0 00000100:00100000:1.0:1787892987.062173:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892987.062190:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c772c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493299712:0@lo:400:kworker.0 00000100:00100000:1.0:1787892987.062208:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892987.062237:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493299328 00000100:00100000:1.0:1787892987.062241:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493299328 00000100:00100000:1.0:1787892987.062275:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493299200 00000100:00100000:1.0:1787892987.062278:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493299200 00000100:00100000:1.0:1787892987.062291:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493299712 00000100:00100000:1.0:1787892987.062293:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493299712 00000100:00100000:1.0:1787892987.062306:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787892987.062312:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7789f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493299328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787892987.062357:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7789f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493299328:12345-0@lo:400:kworker.0 Request processed in 46us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892987.062364:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787892987.062374:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787892987.062380:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493299200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787892987.062404:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493299200:12345-0@lo:400:kworker.0 Request processed in 26us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892987.062417:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787892987.062427:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787892987.062432:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493299712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787892987.062461:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493299712:12345-0@lo:400:kworker.0 Request processed in 29us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892987.062466:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1787892987.062485:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787892987.062508:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787892987.062512:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787892987.062514:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787892987.062539:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c772e680 x1874741493299200/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892987.062553:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c772e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493299200:0@lo:400:kworker.0 00010000:00080000:1.0:1787892987.062563:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c772c380 x1874741493299712/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892987.062571:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c772c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493299712:0@lo:400:kworker.0 00010000:00080000:1.0:1787892987.062579:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c772c000 x1874741493299328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892987.062586:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c772c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493299328:0@lo:400:kworker.0 00000100:00100000:1.0:1787892987.062617:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c772f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493298560:0@lo:400:kworker.0 00010000:00080000:1.0:1787892987.062626:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c772e300 x1874741493299072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892987.062634:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c772e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493299072:0@lo:400:kworker.0 00010000:00080000:1.0:1787892987.062652:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c772ca80 x1874741493299584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892987.062660:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c772ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493299584:0@lo:400:kworker.0 00000100:00100000:1.0:1787892987.062670:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c772d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493298944:0@lo:400:kworker.0 00000100:00100000:1.0:1787892987.062678:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c772f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1874741493299456:0@lo:400:kworker.0 00000100:00100000:1.0:1787892987.062700:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493298688 00000100:00100000:1.0:1787892987.062704:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493298688 00000100:00100000:1.0:1787892987.062727:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787892987.062734:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7788380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1874741493298688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787892987.062769:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7788380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1874741493298688:12345-0@lo:400:kworker.0 Request processed in 35us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892987.062775:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787892987.062801:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c772ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1874741493298688:0@lo:400:kworker.0 00000100:00100000:3.0:1787892987.063100:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493298816 00000100:00100000:3.0:1787892987.063104:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493298816 00000100:00100000:3.0:1787892987.063136:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787892987.063150:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c772dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493298816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787892987.063188:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c772dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493298816:12345-0@lo:400:kworker.0 Request processed in 40us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892987.063194:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787892987.063216:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787892987.063225:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493299840:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787892987.063253:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892987.063411:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c772df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493298816:0@lo:400:kworker.0 00000100:00100000:0.0:1787892987.065247:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493299840 00000100:00100000:0.0:1787892987.065273:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493299840 00000100:00100000:0.0:1787892987.065314:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787892987.065332:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493299840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787892987.065355:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787892987.065420:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493299840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (2167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892987.065428:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1787892987.065523:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffbddc00 x1874741493299840/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893003 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892987.065542:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493299840:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787892987.549479:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787892987.549622:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481707008 00000100:00100000:2.0:1787892987.549632:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481707008 00000100:00100000:2.0:1787892987.549694:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 242 00000100:00100000:2.0:1787892987.549716:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+8:6165:x1874741481707008:12345-192.168.202.35@tcp:101: 00010000:00010000:2.0:1787892987.549741:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787892987.549761:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c771f200/0x9232577658cf0ca0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa645 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892987.549798:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c771f200/0x9232577658cf0ca0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa645 expref: 9 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892987.549810:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c771f200/0x9232577658cf0ca0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa645 expref: 9 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892987.549839:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c771f200, rc 0) 00000100:00100000:2.0:1787892987.549919:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+9:6165:x1874741481707008:12345-192.168.202.35@tcp:101: Request processed in 215us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892987.549926:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 242 00000100:00100000:0.0:1787892987.558440:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787892987.558521:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481707136 00000100:00100000:3.0:1787892987.558531:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481707136 00000100:00100000:3.0:1787892987.558592:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 243 00000100:00100000:3.0:1787892987.558602:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+9:6165:x1874741481707136:12345-192.168.202.35@tcp:501: 00000100:00100000:3.0:1787892987.558771:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+9:6165:x1874741481707136:12345-192.168.202.35@tcp:501: Request processed in 169us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892987.558787:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 243 00000100:00100000:0.0:1787892987.563820:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787892987.564008:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481707264 00000100:00100000:3.0:1787892987.564020:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481707264 00000100:00100000:3.0:1787892987.564080:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 244 00000100:00100000:3.0:1787892987.564091:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+9:6165:x1874741481707264:12345-192.168.202.35@tcp:503: 00000100:00100000:3.0:1787892987.564257:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+9:6165:x1874741481707264:12345-192.168.202.35@tcp:503: Request processed in 167us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892987.564265:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 244 00010000:00010000:3.0:1787892987.570065:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892987.588101:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787892987.588865:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481707392 00000100:00100000:2.0:1787892987.588877:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481707392 00000100:00100000:2.0:1787892987.588942:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 245 00000100:00100000:2.0:1787892987.588953:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+9:6651:x1874741481707392:12345-192.168.202.35@tcp:502: 00000100:00100000:2.0:1787892987.589167:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+9:6651:x1874741481707392:12345-192.168.202.35@tcp:502: Request processed in 216us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892987.589174:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 245 00000100:00100000:2.0:1787892987.594312:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787892987.594408:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481707520 00000100:00100000:0.0:1787892987.594418:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481707520 00000100:00100000:0.0:1787892987.594687:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 246 00000100:00100000:0.0:1787892987.594698:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+9:6651:x1874741481707520:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787892987.595120:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+9:6651:x1874741481707520:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 423us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892987.595129:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 246 00000100:00100000:0.0:1787892987.624557:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787892987.624673:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481707648 00000100:00100000:3.0:1787892987.624683:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481707648 00000100:00100000:3.0:1787892987.624754:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 247 00000100:00100000:3.0:1787892987.624764:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+9:6165:x1874741481707648:12345-192.168.202.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787892987.624791:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787892987.624809:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9c147d800/0x9232577658cf0ca7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa64c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892987.624837:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9c147d800/0x9232577658cf0ca7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa64c expref: 10 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892987.624847:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9c147d800/0x9232577658cf0ca7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa64c expref: 10 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892987.624857:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9c147d800, rc 0) 00000100:00100000:3.0:1787892987.625258:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:6165:x1874741481707648:12345-192.168.202.35@tcp:101:ll_cfg_requeue.0 Request processed in 494us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892987.625265:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 247 00000100:00100000:1.0:1787892987.631051:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787892987.631149:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481707776 00000100:00100000:2.0:1787892987.631160:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481707776 00000100:00100000:2.0:1787892987.631218:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 248 00000100:00100000:2.0:1787892987.631228:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:6165:x1874741481707776:12345-192.168.202.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787892987.631365:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:6165:x1874741481707776:12345-192.168.202.35@tcp:501:ll_cfg_requeue.0 Request processed in 138us (324us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787892987.631373:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 248 00010000:00010000:1.0:1787892988.594057:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892989.106479:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493299968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787892989.106602:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892989.106695:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787892989.106703:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493300096:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787892989.106729:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892989.107477:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493299968 00000100:00100000:0.0:1787892989.107511:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493299968 00000100:00100000:0.0:1787892989.107585:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493300096 00000100:00100000:0.0:1787892989.107589:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493300096 00000100:00100000:0.0:1787892989.107613:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787892989.107624:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c772df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493299968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787892989.107662:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787892989.107735:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c772df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493299968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (1132us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892989.107742:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787892989.107791:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787892989.107799:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c772ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493300096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787892989.107809:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787892989.107836:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c772ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493300096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (1106us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892989.107842:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1787892989.107891:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb6c700 x1874741493300096/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893005 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892989.107916:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493300096:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1787892989.107929:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb6ce00 x1874741493299968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893005 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892989.107941:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493299968:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787892989.108003:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787892989.617629:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787892989.676553:0:10381:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffee0e34430 20000000:00000080:0.0:1787892989.676577:0:10381:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fc9ffbc8c00 uarg=0000000000000000 20000000:01000000:0.0:1787892989.676636:0:10381:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787892989.676645:0:10381:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787892989.676651:0:10381:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787892989.677710:0:10382:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1787892989.677894:0:10381:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1787892989.683173:0:10381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1787892989.683311:0:10381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1787892989.683409:0:10381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1787892989.683431:0:10381:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787892989.683458:0:10381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fc9edb30600/0x9232577658cf0cae lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892989.683481:0:10381:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9dd69da00/0x9232577658cf094a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0943 expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892989.683645:0:10381:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9c147d400/0x9232577658cf0958 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0951 expref: 23 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892989.683653:0:10381:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9edb31e00/0x9232577658cf09ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf09a5 expref: 23 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892989.683660:0:10381:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9edb30e00/0x9232577658cf0ad2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0acb expref: 23 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892989.683670:0:10381:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0bea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa60d expref: 9 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892989.683677:0:10381:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fc9edb30600/0x9232577658cf0cae lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892989.683730:0:10381:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0bea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa60d expref: 9 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892989.683749:0:10381:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0bea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa60d expref: 9 pid: 6499 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892989.683781:0:10381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10381:1874741493300224:192.168.202.35@tcp:104: 00010000:00010000:0.0:1787892989.683925:0:10381:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9edb30e00/0x9232577658cf0ad2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf0acb expref: 23 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892989.683935:0:10381:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc9edb30e00/0x9232577658cf0ad2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf0acb expref: 23 pid: 6499 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892989.683946:0:10381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10381:1874741493300352:0@lo:104: 00000100:00100000:0.0:1787892989.684015:0:10381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787892989.684069:0:10381:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9edb31e00/0x9232577658cf09ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf09a5 expref: 23 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892989.684079:0:10381:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc9edb31e00/0x9232577658cf09ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf09a5 expref: 23 pid: 6497 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892989.684089:0:10381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10381:1874741493300480:0@lo:104: 00000100:00100000:0.0:1787892989.684115:0:10381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787892989.684139:0:10381:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9c147d400/0x9232577658cf0958 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf0951 expref: 23 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892989.684147:0:10381:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc9c147d400/0x9232577658cf0958 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf0951 expref: 23 pid: 6499 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892989.684155:0:10381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10381:1874741493300608:0@lo:104: 00010000:00010000:0.0:1787892989.684179:0:10381:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9dd69da00/0x9232577658cf094a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf0943 expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892989.684188:0:10381:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc9dd69da00/0x9232577658cf094a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf0943 expref: 23 pid: 6500 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892989.684209:0:10381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10381:1874741493300736:0@lo:104: 00000100:00100000:0.0:1787892989.684230:0:10381:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9edf37180 going to sleep for 11 seconds 00000100:00100000:1.0:1787892989.684593:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787892989.684617:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892989.684633:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892989.684643:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493300352 00000100:00100000:1.0:1787892989.684651:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493300352 00000100:00100000:1.0:1787892989.684702:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493300480 00000100:00100000:1.0:1787892989.684705:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493300480 00000100:00100000:1.0:1787892989.684717:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493300608 00000100:00100000:1.0:1787892989.684719:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493300608 00000100:00100000:1.0:1787892989.684727:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493300736 00000100:00100000:1.0:1787892989.684729:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493300736 00000100:00100000:1.0:1787892989.684742:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787892989.684763:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+6:10381:x1874741493300352:12345-0@lo:104: 00010000:00010000:1.0:1787892989.684781:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540c00/0x9232577658cf0acb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0ad2 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892989.684856:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787892989.684863:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+6:10381:x1874741493300352:12345-0@lo:104: Request processed in 113us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892989.684871:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787892989.684893:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787892989.684899:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbcc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+5:10381:x1874741493300480:12345-0@lo:104: 00010000:00010000:1.0:1787892989.684908:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31a00/0x9232577658cf09a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf09ac expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892989.684944:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787892989.684949:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbcc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+5:10381:x1874741493300480:12345-0@lo:104: Request processed in 51us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892989.684955:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787892989.685120:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787892989.685139:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c772f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+4:10381:x1874741493300608:12345-0@lo:104: 00010000:00010000:1.0:1787892989.685149:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31000/0x9232577658cf0951 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0958 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892989.685188:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787892989.685193:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c772f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+4:10381:x1874741493300608:12345-0@lo:104: Request processed in 56us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892989.687651:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787892989.687713:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787892989.687733:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c772d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+3:10381:x1874741493300736:12345-0@lo:104: 00010000:00010000:1.0:1787892989.687764:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69c600/0x9232577658cf0943 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf094a expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892989.687864:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787892989.687870:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c772d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+3:10381:x1874741493300736:12345-0@lo:104: Request processed in 149us (3237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892989.687877:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1787892989.687920:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787892989.687928:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540c00/0x9232577658cf0acb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0ad2 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892989.687936:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540c00 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:1.0:1787892989.687942:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540c00/0x9232577658cf0acb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf0ad2 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892989.687952:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540c00/0x9232577658cf0acb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf0ad2 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787892989.687960:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540c00/0x9232577658cf0acb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf0ad2 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892989.688180:0:10381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10381:1874741493300352:0@lo:104: 00000100:00100000:0.0:1787892989.688206:0:10381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10381:1874741493300480:0@lo:104: 00000100:00100000:0.0:1787892989.688218:0:10381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10381:1874741493300608:0@lo:104: 00000100:00100000:0.0:1787892989.688227:0:10381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10381:1874741493300736:0@lo:104: 00010000:00010000:0.0:1787892989.688645:0:8435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787892989.688653:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31a00/0x9232577658cf09a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf09ac expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892989.688662:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31a00 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:0.0:1787892989.688666:0:8435:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31a00/0x9232577658cf09a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf09ac expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892989.688676:0:8435:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31a00/0x9232577658cf09a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf09ac expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787892989.688684:0:8435:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31a00/0x9232577658cf09a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf09ac expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787892989.688691:0:8435:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787892989.688880:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787892989.688902:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540c00/0x9232577658cf0acb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0ad2 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892989.688911:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787892989.688946:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540c00/0x9232577658cf0acb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0ad2 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892989.688954:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540c00/0x9232577658cf0acb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0ad2 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892989.688969:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787892989.688972:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31000/0x9232577658cf0951 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0958 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892989.688978:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31000 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:1.0:1787892989.688981:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31000/0x9232577658cf0951 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf0958 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892989.689060:0:8435:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31a00/0x9232577658cf09a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf09ac expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892989.689066:0:8435:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787892989.689267:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31a00/0x9232577658cf09a5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf09ac expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892989.689275:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31a00/0x9232577658cf09a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf09ac expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892989.689285:0:8435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787892989.689289:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69c600/0x9232577658cf0943 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf094a expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892989.689306:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd69c600 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:0.0:1787892989.689309:0:8435:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69c600/0x9232577658cf0943 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf094a expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892989.689432:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c772ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493300992:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787892989.689532:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892989.689594:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787892989.689601:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493300864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787892989.689638:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892989.689677:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493300992 00000100:00100000:2.0:1787892989.689687:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493300992 00010000:00010000:2.0:1787892989.689730:0:6490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9edb30e00/0x9232577658cf0ad2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0acb expref: 24 pid: 6499 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892989.689867:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31000/0x9232577658cf0951 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf0958 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787892989.689875:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31000/0x9232577658cf0951 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf0958 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787892989.689881:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787892989.689908:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31000/0x9232577658cf0951 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0958 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892989.689915:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787892989.689943:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31000/0x9232577658cf0951 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0958 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892989.689951:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31000/0x9232577658cf0951 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0958 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892989.689963:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892989.689965:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892989.689967:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892989.689976:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787892989.690101:0:8435:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69c600/0x9232577658cf0943 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf094a expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787892989.690108:0:8435:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69c600/0x9232577658cf0943 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf094a expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787892989.690114:0:8435:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787892989.690130:0:8435:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69c600/0x9232577658cf0943 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf094a expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892989.690135:0:8435:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787892989.690142:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69c600/0x9232577658cf0943 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf094a expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892989.690148:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69c600/0x9232577658cf0943 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf094a expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892989.690168:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787892989.690170:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787892989.690171:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787892989.690389:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493300864 00000100:00100000:2.0:1787892989.690396:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493300864 00010000:00010000:2.0:1787892989.690417:0:6490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9edb31e00/0x9232577658cf09ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf09a5 expref: 25 pid: 6497 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892989.690435:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787892989.690444:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ad7764-cf95-4087-88aa-57e4229a8397+25:3630:x1874741493300992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787892989.690459:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787892989.690465:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9edb30e00/0x9232577658cf0ad2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0acb expref: 25 pid: 6499 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892989.690475:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9edb30e00/0x9232577658cf0ad2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf0acb expref: 25 pid: 6499 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892989.690527:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9edb30e00/0x9232577658cf0ad2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf0acb expref: 25 pid: 6499 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892989.690543:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787892989.690598:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ad7764-cf95-4087-88aa-57e4229a8397+24:3630:x1874741493300992:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892989.690605:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787892989.690623:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787892989.690629:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ad7764-cf95-4087-88aa-57e4229a8397+23:3630:x1874741493300864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787892989.690646:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787892989.690650:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9edb31e00/0x9232577658cf09ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf09a5 expref: 23 pid: 6497 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892989.690659:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9edb31e00/0x9232577658cf09ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf09a5 expref: 23 pid: 6497 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892989.690668:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9edb31e00/0x9232577658cf09ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf09a5 expref: 23 pid: 6497 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892989.690676:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787892989.690696:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ad7764-cf95-4087-88aa-57e4229a8397+22:3630:x1874741493300864:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892989.690702:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787892989.690859:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c772e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493301120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787892989.690899:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892989.690939:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787892989.690945:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493301248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787892989.690969:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892989.691974:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493300864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787892989.692104:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493301120 00000100:00100000:1.0:1787892989.692113:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493301120 00010000:00010000:1.0:1787892989.692165:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9c147d400/0x9232577658cf0958 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0951 expref: 22 pid: 6499 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892989.692394:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c772ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493300992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787892989.692852:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493301248 00000100:00100000:1.0:1787892989.692858:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493301248 00010000:00010000:1.0:1787892989.692882:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9dd69da00/0x9232577658cf094a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0943 expref: 23 pid: 6500 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892989.692902:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787892989.692911:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c772f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ad7764-cf95-4087-88aa-57e4229a8397+23:3632:x1874741493301120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787892989.692930:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787892989.692937:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9c147d400/0x9232577658cf0958 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0951 expref: 23 pid: 6499 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892989.692963:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9c147d400/0x9232577658cf0958 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf0951 expref: 23 pid: 6499 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892989.693108:0:6490:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787892989.693122:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1787892989.694084:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9c147d400/0x9232577658cf0958 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf0951 expref: 23 pid: 6499 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892989.694116:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787892989.694709:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787892989.694876:0:10381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10381:1874741493300224:192.168.202.35@tcp:104: 00010000:00010000:0.0:1787892989.694951:0:10381:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fc9edb30600/0x9232577658cf0cae lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892989.695129:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c772f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ad7764-cf95-4087-88aa-57e4229a8397+22:3632:x1874741493301120:12345-0@lo:103:ldlm_bl.0 Request processed in 1283us (3293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892989.695143:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787892989.695183:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481707904 00000100:00100000:1.0:1787892989.695190:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481707904 00010000:00010000:1.0:1787892989.695310:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0bea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa60d expref: 10 pid: 6499 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892989.695458:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787892989.695469:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3efec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ad7764-cf95-4087-88aa-57e4229a8397+21:3632:x1874741493301248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787892989.695486:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787892989.695517:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9dd69da00/0x9232577658cf094a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0943 expref: 21 pid: 6500 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892989.695527:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9dd69da00/0x9232577658cf094a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf0943 expref: 21 pid: 6500 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892989.695545:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9dd69da00/0x9232577658cf094a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf0943 expref: 21 pid: 6500 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892989.695560:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787892989.695613:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3efec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ad7764-cf95-4087-88aa-57e4229a8397+20:3632:x1874741493301248:12345-0@lo:103:ldlm_bl.0 Request processed in 147us (4642us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892989.695635:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787892989.695682:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 39 00000100:00100000:1.0:1787892989.695689:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:2390:x1874741481707904:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787892989.695698:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787892989.695703:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0bea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa60d expref: 10 pid: 6499 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892989.695713:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0bea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa60d expref: 10 pid: 6499 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892989.695724:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0bea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa60d expref: 10 pid: 6499 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892989.695737:0:6492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fc9edb30600/0x9232577658cf0cae lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892989.695746:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9edb30600/0x9232577658cf0cae lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892989.696264:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493301248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787892989.696290:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c772e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493301120:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787892989.696751:0:6492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc9edb30600/0x9232577658cf0cae lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892989.696834:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc9edb30600/0x9232577658cf0cae lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892989.696843:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fc9edb30600/0x9232577658cf0cae lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892989.696851:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fc9edb30600/0x9232577658cf0cae lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892989.696858:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30600 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787892989.696863:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fc9edb30600/0x9232577658cf0cae lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892989.696888:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fc9edb30600/0x9232577658cf0cae lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892989.697055:0:10381:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fc9edb30600/0x9232577658cf0cae lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892989.697065:0:10381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fc9edb30600/0x9232577658cf0cae lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892989.697267:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fc9edb30600/0x9232577658cf0cae lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892989.697278:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9edb30600/0x9232577658cf0cae lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892989.697311:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787892989.697868:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+9:2390:x1874741481707904:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 2169us (3546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892989.697883:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 39 00000100:00100000:2.0:1787892990.496670:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787892990.497349:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481708032 00000100:00100000:1.0:1787892990.497364:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481708032 00000100:00100000:1.0:1787892990.497430:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 249 00000100:00100000:1.0:1787892990.497441:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+9:2391:x1874741481708032:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787892990.497564:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+9:2391:x1874741481708032:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 124us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892990.497572:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 249 00000100:00100000:1.0:1787892990.508817:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787892990.508916:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787892990.508957:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787892990.509013:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481708416 00000100:00100000:2.0:1787892990.509027:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481708416 00000100:00100000:2.0:1787892990.509110:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 19 00000100:00100000:2.0:1787892990.509122:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c772f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481708416:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787892990.509231:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c772f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481708416:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 111us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892990.509240:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 19 00000100:00080000:2.0:1787892990.509270:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787892990.518818:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481708160 00000100:00100000:3.0:1787892990.518837:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481708160 00000100:00100000:0.0:1787892990.519099:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787892990.519303:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481708544 00000100:00100000:3.0:1787892990.519308:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481708544 00000100:00100000:3.0:1787892990.519434:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 20 00000100:00100000:3.0:1787892990.519446:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481708544:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787892990.519553:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481708544:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 110us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892990.519561:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 20 00000100:00100000:1.0:1787892990.519759:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481708288 00000100:00100000:1.0:1787892990.519765:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481708288 00000100:00080000:2.0:1787892990.519945:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787892990.519951:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787892990.519954:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787892990.520252:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 67 00000100:00100000:0.0:1787892990.520262:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c772fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+6:2390:x1874741481708160:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787892990.520324:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c772fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+6:2390:x1874741481708160:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 63us (11521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892990.520331:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 67 00000100:00100000:3.0:1787892990.521058:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 68 00000100:00100000:3.0:1787892990.521073:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c772f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481708288:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787892990.521162:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c772f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481708288:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 94us (12204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892990.521171:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 68 00010000:00010000:3.0:1787892990.642025:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787892990.650613:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787892990.650649:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493301376:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787892990.650763:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892990.650881:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493301376 00000100:00100000:2.0:1787892990.650892:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493301376 00000100:00100000:2.0:1787892990.650962:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787892990.650972:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493301376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787892990.651018:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787892990.651071:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493301376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892990.651079:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787892990.651138:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493301376:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787892990.938165:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787892990.939607:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481708672 00000100:00100000:1.0:1787892990.939623:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481708672 00000100:00100000:1.0:1787892990.939759:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 250 00000100:00100000:1.0:1787892990.939787:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+9:6165:x1874741481708672:12345-192.168.202.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787892990.939838:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787892990.939897:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9fe541400/0x9232577658cf0cb5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa653 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892990.939951:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9fe541400/0x9232577658cf0cb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa653 expref: 10 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892990.939977:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9fe541400/0x9232577658cf0cb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa653 expref: 10 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892990.939995:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe541400, rc 0) 00000100:00100000:1.0:1787892990.940110:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:6165:x1874741481708672:12345-192.168.202.35@tcp:101:ll_cfg_requeue.0 Request processed in 341us (1961us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892990.940117:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 250 00000100:00100000:2.0:1787892990.951788:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787892990.957097:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481708800 00000100:00100000:0.0:1787892990.957117:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481708800 00000100:00100000:2.0:1787892990.957272:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 251 00000100:00100000:2.0:1787892990.957299:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ec8ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:6165:x1874741481708800:12345-192.168.202.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787892990.957652:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ec8ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:6165:x1874741481708800:12345-192.168.202.35@tcp:501:ll_cfg_requeue.0 Request processed in 368us (5878us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892990.965440:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787892990.965505:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481708928 00000100:00100000:0.0:1787892990.965518:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481708928 00000100:00100000:2.0:1787892990.965535:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 251 00000100:00100000:0.0:1787892990.965573:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 252 00000100:00100000:0.0:1787892990.965584:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ec8bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:6165:x1874741481708928:12345-192.168.202.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787892990.965745:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ec8bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:6165:x1874741481708928:12345-192.168.202.35@tcp:503:ll_cfg_requeue.0 Request processed in 161us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892990.965753:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 252 00000100:00100000:1.0:1787892990.970128:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787892990.970795:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481709056 00000100:00100000:2.0:1787892990.970809:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481709056 00000100:00100000:2.0:1787892990.970875:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 253 00000100:00100000:2.0:1787892990.970886:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ec8b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:6709:x1874741481709056:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787892990.971129:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ec8b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:6709:x1874741481709056:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 241us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892990.971138:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 253 00000100:00100000:0.0:1787892990.985159:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787892990.985344:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481709184 00000100:00100000:1.0:1787892990.985358:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481709184 00000100:00100000:1.0:1787892990.985432:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 254 00000100:00100000:1.0:1787892990.985443:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ec8b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:6709:x1874741481709184:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787892990.985686:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ec8b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:6709:x1874741481709184:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 243us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892990.985703:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 254 10000000:01000000:0.0:1787892991.163020:0:6502:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787892991.163031:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc9e70bc000 from 4 10000000:01000000:0.0:1787892991.163047:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787892991.163110:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31000/0x9232577658cf0cbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892991.163125:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31000/0x9232577658cf0cbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892991.163139:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31000/0x9232577658cf0cbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892991.163171:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493301504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787892991.163267:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892991.163345:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fe374540 going to sleep for 11 seconds 00000100:00100000:2.0:1787892991.163483:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493301504 00000100:00100000:2.0:1787892991.163514:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493301504 00000100:00100000:2.0:1787892991.163589:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1787892991.163601:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ec8b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+20:6502:x1874741493301504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787892991.163628:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787892991.163644:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c771fe00/0x9232577658cf0cc3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0cbc expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892991.163677:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c771fe00/0x9232577658cf0cc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0cbc expref: 21 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892991.163689:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c771fe00/0x9232577658cf0cc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0cbc expref: 21 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892991.163700:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c771fe00, rc 0) 00000100:00100000:2.0:1787892991.163916:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ec8b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+21:6502:x1874741493301504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 316us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892991.163924:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787892991.166033:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493301504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787892991.166071:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31000/0x9232577658cf0cbc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0cc3 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892991.166088:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31000/0x9232577658cf0cbc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0cc3 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892991.166230:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493301632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787892991.166318:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892991.166429:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fe374540 going to sleep for 11 seconds 00000100:00100000:3.0:1787892991.170677:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493301632 00000100:00100000:3.0:1787892991.170700:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493301632 00000100:00100000:3.0:1787892991.171530:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1787892991.171550:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+21:6502:x1874741493301632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787892991.171876:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+21:6502:x1874741493301632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 333us (5557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892991.171885:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1787892991.172928:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493301632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787892991.173028:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493301760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787892991.173108:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892991.173360:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e7016c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787892991.173403:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493301760 00000100:00100000:1.0:1787892991.173411:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493301760 00000100:00100000:1.0:1787892991.173462:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787892991.173472:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+21:6502:x1874741493301760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787892991.173620:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+21:6502:x1874741493301760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892991.173628:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787892991.173696:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493301760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787892991.173965:0:10422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c772c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10422:1874741493301888:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787892991.174007:0:10422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892991.174027:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493301888 00000100:00100000:1.0:1787892991.174031:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493301888 00000100:00100000:1.0:1787892991.174052:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1787892991.174058:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+21:10422:x1874741493301888:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787892991.174133:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+21:10422:x1874741493301888:12345-0@lo:502:llog_process_th.0 Request processed in 74us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892991.174141:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1787892991.174170:0:10422:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e70e6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787892991.174181:0:10422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c772c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10422:1874741493301888:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787892991.174205:0:10422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787892991.174218:0:10422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787892991.174221:0:10422:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787892991.174229:0:10422:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc9e70bc000 00000020:00000080:1.0:1787892991.174232:0:10422:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787892991.174341:0:10422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c772c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10422:1874741493302016:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787892991.174377:0:10422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892991.174397:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493302016 00000100:00100000:1.0:1787892991.174401:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493302016 00000100:00100000:1.0:1787892991.174419:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1787892991.174424:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+21:10422:x1874741493302016:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787892991.174482:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+21:10422:x1874741493302016:12345-0@lo:502:llog_process_th.0 Request processed in 57us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892991.174512:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1787892991.174540:0:10422:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e70e6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787892991.174552:0:10422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c772c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10422:1874741493302016:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787892991.174571:0:10422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787892991.174576:0:10422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787892991.174577:0:10422:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787892991.174581:0:10422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787892991.174636:0:6502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787892991.174661:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787892991.174674:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31000/0x9232577658cf0cbc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0cc3 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892991.174686:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31000/0x9232577658cf0cbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0cc3 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787892991.174696:0:6502:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787892991.174699:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc9fe136000 from 4 10000000:01000000:1.0:1787892991.174702:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787892991.174728:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541c00/0x9232577658cf0cca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892991.174746:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541c00/0x9232577658cf0cca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892991.174758:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541c00/0x9232577658cf0cca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892991.174770:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c772c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493302144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787892991.174799:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892991.174811:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e70e6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787892991.174822:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493302144 00000100:00100000:1.0:1787892991.174826:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493302144 00000100:00100000:1.0:1787892991.174841:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1787892991.174847:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+21:6502:x1874741493302144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787892991.174855:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787892991.174868:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9fe540e00/0x9232577658cf0cd1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0cca expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892991.174892:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9fe540e00/0x9232577658cf0cd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0cca expref: 22 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892991.174902:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9fe540e00/0x9232577658cf0cd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0cca expref: 22 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892991.174912:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe540e00, rc 0) 00000100:00100000:1.0:1787892991.174935:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+22:6502:x1874741493302144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892991.174941:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1787892991.174977:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c772c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493302144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787892991.174989:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541c00/0x9232577658cf0cca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0cd1 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892991.174997:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541c00/0x9232577658cf0cca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0cd1 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892991.175033:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c772c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493302272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787892991.175056:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892991.175068:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e70e6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787892991.175077:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493302272 00000100:00100000:1.0:1787892991.175080:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493302272 00000100:00100000:1.0:1787892991.175095:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1787892991.175099:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+22:6502:x1874741493302272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787892991.175198:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+22:6502:x1874741493302272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 98us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892991.175205:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1787892991.175232:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c772c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493302272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787892991.175256:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c772c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493302400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787892991.175307:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892991.175321:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e70e6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787892991.175331:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493302400 00000100:00100000:1.0:1787892991.175334:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493302400 00000100:00100000:1.0:1787892991.175349:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1787892991.175353:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+22:6502:x1874741493302400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787892991.175415:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+22:6502:x1874741493302400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 61us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892991.175427:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1787892991.175457:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c772c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493302400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787892991.178172:0:10423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10423:1874741493302528:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787892991.178280:0:10423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892991.178364:0:10423:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d29e30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787892991.179351:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493302528 00000100:00100000:2.0:1787892991.179364:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493302528 00000100:00100000:0.0:1787892991.183600:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787892991.183630:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+22:10423:x1874741493302528:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787892991.183937:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+22:10423:x1874741493302528:12345-0@lo:502:llog_process_th.0 Request processed in 320us (5657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892991.183946:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1787892991.186037:0:10423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10423:1874741493302528:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787892991.186118:0:10423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787892991.186138:0:10423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787892991.186142:0:10423:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787892991.186152:0:10423:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc9fe136000 00000020:00000080:3.0:1787892991.186156:0:10423:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787892991.190327:0:10423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10423:1874741493302656:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787892991.190585:0:10423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892991.190697:0:10423:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d29e30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787892991.196111:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493302656 00000100:00100000:2.0:1787892991.196132:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493302656 00000100:00100000:2.0:1787892991.196211:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787892991.196223:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+22:10423:x1874741493302656:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787892991.196564:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+22:10423:x1874741493302656:12345-0@lo:502:llog_process_th.0 Request processed in 343us (5979us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892991.196573:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787892991.197656:0:10423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10423:1874741493302656:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787892991.197714:0:10423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787892991.197723:0:10423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787892991.197726:0:10423:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787892991.197732:0:10423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787892991.197985:0:6502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787892991.198010:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787892991.198025:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541c00/0x9232577658cf0cca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0cd1 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892991.198038:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541c00/0x9232577658cf0cca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0cd1 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787892991.198052:0:6502:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787892991.198055:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc9ed573800 from 4 10000000:01000000:0.0:1787892991.198059:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787892991.198101:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31e00/0x9232577658cf0cd8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892991.198109:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31e00/0x9232577658cf0cd8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892991.198119:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31e00/0x9232577658cf0cd8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892991.198144:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493302784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787892991.198210:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892991.198263:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e5e5b900 going to sleep for 11 seconds 00000100:00100000:1.0:1787892991.198321:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493302784 00000100:00100000:1.0:1787892991.198328:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493302784 00000100:00100000:1.0:1787892991.198380:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787892991.198390:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+22:6502:x1874741493302784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787892991.199522:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787892991.199546:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9fe541200/0x9232577658cf0cdf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0cd8 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892991.199586:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9fe541200/0x9232577658cf0cdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0cd8 expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892991.199598:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9fe541200/0x9232577658cf0cdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0cd8 expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892991.199608:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe541200, rc 0) 00000100:00100000:1.0:1787892991.199685:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+23:6502:x1874741493302784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1295us (1475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892991.199694:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787892991.200664:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493302784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787892991.200691:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31e00/0x9232577658cf0cd8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0cdf expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892991.200703:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31e00/0x9232577658cf0cd8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0cdf expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892991.200916:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493302912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787892991.200972:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892991.201023:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e5e5b900 going to sleep for 11 seconds 00000100:00100000:1.0:1787892991.201080:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493302912 00000100:00100000:1.0:1787892991.201090:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493302912 00000100:00100000:1.0:1787892991.201157:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787892991.201168:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+23:6502:x1874741493302912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787892991.201320:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+23:6502:x1874741493302912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 153us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892991.201329:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787892991.201884:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493302912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787892991.201934:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493303040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787892991.201985:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892991.202015:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e5e5b900 going to sleep for 11 seconds 00000100:00100000:0.0:1787892991.202034:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493303040 00000100:00100000:0.0:1787892991.202038:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493303040 00000100:00100000:0.0:1787892991.202074:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787892991.202083:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+23:6502:x1874741493303040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787892991.202180:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+23:6502:x1874741493303040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892991.202188:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787892991.202233:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493303040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787892991.203970:0:10427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10427:1874741493303168:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787892991.204055:0:10427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892991.204107:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493303168 00000100:00100000:0.0:1787892991.204115:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493303168 00000100:00100000:0.0:1787892991.204163:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787892991.204173:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+23:10427:x1874741493303168:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787892991.204310:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+23:10427:x1874741493303168:12345-0@lo:502:llog_process_th.0 Request processed in 138us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892991.204330:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787892991.204390:0:10427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7699480 going to sleep for 11 seconds 00000100:00100000:0.0:1787892991.205874:0:10427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10427:1874741493303168:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787892991.205953:0:10427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787892991.205967:0:10427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787892991.205970:0:10427:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787892991.205978:0:10427:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc9ed573800 00000020:00000080:0.0:1787892991.205981:0:10427:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787892991.206104:0:10427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10427:1874741493303296:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787892991.206177:0:10427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892991.206229:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493303296 00000100:00100000:0.0:1787892991.206236:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493303296 00000100:00100000:0.0:1787892991.206298:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1787892991.206309:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+23:10427:x1874741493303296:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787892991.208617:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+23:10427:x1874741493303296:12345-0@lo:502:llog_process_th.0 Request processed in 2296us (2427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892991.208634:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1787892991.208730:0:10427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7699480 going to sleep for 11 seconds 00000100:00100000:0.0:1787892991.209938:0:10427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10427:1874741493303296:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787892991.210023:0:10427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787892991.210034:0:10427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787892991.210037:0:10427:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787892991.210043:0:10427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787892991.210145:0:6502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787892991.210170:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787892991.210184:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31e00/0x9232577658cf0cd8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0cdf expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892991.210206:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31e00/0x9232577658cf0cd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0cdf expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787892991.210220:0:6502:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787892991.210223:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc9d909c800 from 4 10000000:01000000:0.0:1787892991.210226:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787892991.210273:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30e00/0x9232577658cf0ce6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892991.210294:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30e00/0x9232577658cf0ce6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892991.210307:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30e00/0x9232577658cf0ce6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892991.210332:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493303424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787892991.212531:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892991.212616:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7699480 going to sleep for 11 seconds 00000100:00100000:1.0:1787892991.213303:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493303424 00000100:00100000:1.0:1787892991.213316:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493303424 00000100:00100000:1.0:1787892991.213387:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1787892991.213828:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+23:6502:x1874741493303424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787892991.213851:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787892991.213876:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9fe540600/0x9232577658cf0ced lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0ce6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892991.213912:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9fe540600/0x9232577658cf0ced lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0ce6 expref: 24 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892991.213925:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9fe540600/0x9232577658cf0ced lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0ce6 expref: 24 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892991.213936:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe540600, rc 0) 00000100:00100000:1.0:1787892991.214023:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+24:6502:x1874741493303424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 625us (1502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892991.214031:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1787892991.214188:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493303424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787892991.214211:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30e00/0x9232577658cf0ce6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0ced expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892991.214222:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30e00/0x9232577658cf0ce6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0ced expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892991.214349:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493303552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787892991.214387:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892991.215203:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7699480 going to sleep for 11 seconds 00000100:00100000:1.0:1787892991.217854:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493303552 00000100:00100000:1.0:1787892991.217874:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493303552 00000100:00100000:1.0:1787892991.217966:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1787892991.217979:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+24:6502:x1874741493303552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787892991.218211:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+24:6502:x1874741493303552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 234us (3822us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892991.218231:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1787892991.218935:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493303552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787892991.219024:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493303680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787892991.219541:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892991.219590:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7699480 going to sleep for 11 seconds 00000100:00100000:0.0:1787892991.219615:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493303680 00000100:00100000:0.0:1787892991.219623:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493303680 00000100:00100000:0.0:1787892991.219671:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1787892991.219679:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+24:6502:x1874741493303680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787892991.222031:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+24:6502:x1874741493303680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2337us (2478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892991.222051:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1787892991.222145:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493303680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787892991.224074:0:10431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10431:1874741493303808:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787892991.224175:0:10431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892991.224227:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493303808 00000100:00100000:0.0:1787892991.224235:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493303808 00000100:00100000:0.0:1787892991.224299:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1787892991.224310:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+24:10431:x1874741493303808:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787892991.226657:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+24:10431:x1874741493303808:12345-0@lo:502:llog_process_th.0 Request processed in 2334us (2468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892991.226674:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1787892991.236576:0:10431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7699780 going to sleep for 11 seconds 00000100:00100000:0.0:1787892991.236639:0:10431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10431:1874741493303808:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787892991.236720:0:10431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787892991.236757:0:10431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787892991.236760:0:10431:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787892991.236768:0:10431:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc9d909c800 00000020:00000080:0.0:1787892991.236772:0:10431:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787892991.237086:0:10431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10431:1874741493303936:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787892991.237177:0:10431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892991.237223:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493303936 00000100:00100000:0.0:1787892991.237232:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493303936 00000100:00100000:0.0:1787892991.237300:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1787892991.237311:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+24:10431:x1874741493303936:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787892991.237451:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+24:10431:x1874741493303936:12345-0@lo:502:llog_process_th.0 Request processed in 140us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892991.237460:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1787892991.237534:0:10431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7699780 going to sleep for 11 seconds 00000100:00100000:0.0:1787892991.237550:0:10431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:10431:1874741493303936:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787892991.237580:0:10431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787892991.237586:0:10431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787892991.237589:0:10431:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787892991.237593:0:10431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787892991.237677:0:6502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787892991.237699:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787892991.237712:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30e00/0x9232577658cf0ce6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0ced expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892991.237725:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30e00/0x9232577658cf0ce6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0ced expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892991.665862:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892991.666483:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787892991.666535:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c772c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493304064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787892991.666631:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892991.666727:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493304064 00000100:00100000:1.0:1787892991.667027:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493304064 00000100:00100000:1.0:1787892991.667103:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787892991.667113:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c772c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493304064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787892991.667159:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787892991.667219:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c772c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493304064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892991.667227:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787892991.667294:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c772c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493304064:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787892992.177716:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c772e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493304448:0@lo:400:kworker.0 00000100:00100000:1.0:1787892992.177772:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c772ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1874741493304576:0@lo:400:kworker.0 00000100:00100000:1.0:1787892992.177867:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892992.177946:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1874741493305088:0@lo:400:kworker.0 00000100:00100000:1.0:1787892992.177971:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892992.178020:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787892992.178022:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892992.178026:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed563b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493304960:0@lo:400:kworker.0 00000100:00100000:1.0:1787892992.178054:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892992.178056:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c772e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874741493304320:0@lo:400:kworker.0 00000100:00100000:1.0:1787892992.178072:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493305472:0@lo:400:kworker.0 00000100:00100000:2.0:1787892992.178122:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493304576 00000100:00100000:2.0:1787892992.178133:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493304576 00000100:00100000:2.0:1787892992.178207:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493305088 00000100:00100000:2.0:1787892992.178210:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493305088 00000100:00100000:2.0:1787892992.178239:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787892992.178249:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3631:x1874741493304576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787892992.178467:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892992.178525:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787892992.178536:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1874741493305088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787892992.178599:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1874741493305088:12345-0@lo:400:kworker.0 Request processed in 66us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892992.178608:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787892992.178643:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493304960 00000100:00100000:1.0:1787892992.178648:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493304960 00000100:00100000:1.0:1787892992.178676:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493305472 00000100:00100000:1.0:1787892992.178678:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493305472 00000100:00100000:1.0:1787892992.178704:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787892992.178712:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493304960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787892992.178745:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493304960:12345-0@lo:400:kworker.0 Request processed in 35us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892992.178751:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787892992.178766:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787892992.178773:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493305472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787892992.178800:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493305472:12345-0@lo:400:kworker.0 Request processed in 28us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892992.178806:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1787892992.178855:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ed563b80 x1874741493304960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892992.178871:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed563b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493304960:0@lo:400:kworker.0 00010000:00080000:1.0:1787892992.178884:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb98000 x1874741493305472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892992.178893:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493305472:0@lo:400:kworker.0 00000100:00100000:1.0:1787892992.178904:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1874741493305088:0@lo:400:kworker.0 00000100:00100000:3.0:1787892992.180667:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493304448 00000100:00100000:3.0:1787892992.180685:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493304448 00000100:00100000:3.0:1787892992.181037:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787892992.181049:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493304448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787892992.181173:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493304448:12345-0@lo:400:kworker.0 Request processed in 126us (3150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892992.181180:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787892992.181320:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c772e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493304448:0@lo:400:kworker.0 00000100:00100000:3.0:1787892992.181343:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787892992.181355:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493305600:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787892992.181548:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892992.181709:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892992.181735:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3631:x1874741493304576:12345-0@lo:400:kworker.0 Request processed in 3487us (3867us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892992.181745:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787892992.181768:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493304320 00000100:00100000:2.0:1787892992.181772:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493304320 00000100:00100000:2.0:1787892992.181816:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787892992.181824:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1874741493304320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892992.181859:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1874741493304320:12345-0@lo:400:kworker.0 Request processed in 36us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892992.181865:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787892992.181868:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c772e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874741493304320:0@lo:400:kworker.0 00000100:00100000:0.0:1787892992.181877:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493304832:0@lo:400:kworker.0 00000100:00100000:0.0:1787892992.181903:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892992.181932:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493305344:0@lo:400:kworker.0 00000100:00100000:0.0:1787892992.181959:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892992.181991:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1787892992.181999:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c772c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874741493304192:0@lo:400:kworker.0 00000100:00100000:2.0:1787892992.182002:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493304832 00000100:00100000:2.0:1787892992.182005:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493304832 00000100:00100000:0.0:1787892992.182024:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892992.182034:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493305344 00000100:00100000:2.0:1787892992.182037:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493305344 00000100:00100000:0.0:1787892992.182042:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1874741493304704:0@lo:400:kworker.0 00000100:00100000:2.0:1787892992.182058:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787892992.182061:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892992.182064:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493304832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892992.182095:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493304832:12345-0@lo:400:kworker.0 Request processed in 32us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892992.182102:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787892992.182114:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787892992.182120:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493305344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787892992.182141:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493305600 00000100:00100000:3.0:1787892992.182145:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493305600 00000100:00100000:2.0:1787892992.182147:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493305344:12345-0@lo:400:kworker.0 Request processed in 28us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892992.182165:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787892992.182175:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787892992.182181:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493305600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787892992.182206:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787892992.182242:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493305600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892992.182248:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787892992.182287:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c772ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1874741493304576:0@lo:400:kworker.0 00000100:00100000:2.0:1787892992.182302:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493304192 00000100:00100000:2.0:1787892992.182305:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493304192 00000100:00100000:0.0:1787892992.182315:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1874741493305216:0@lo:400:kworker.0 00000100:00100000:2.0:1787892992.182327:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493304704 00000100:00100000:2.0:1787892992.182330:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493304704 00000100:00100000:0.0:1787892992.182337:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892992.182344:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493305216 00000100:00100000:2.0:1787892992.182346:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493305216 00000100:00100000:0.0:1787892992.182348:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493305728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787892992.182359:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787892992.182364:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1874741493304192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787892992.182368:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892992.182393:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1874741493304192:12345-0@lo:400:kworker.0 Request processed in 29us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892992.182400:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787892992.182411:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787892992.182417:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1874741493304704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892992.182443:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1874741493304704:12345-0@lo:400:kworker.0 Request processed in 27us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892992.182449:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787892992.182460:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787892992.182466:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1874741493305216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892992.182511:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1874741493305216:12345-0@lo:400:kworker.0 Request processed in 46us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892992.182517:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787892992.182597:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493305728 00000100:00100000:3.0:1787892992.182602:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493305728 00000100:00100000:3.0:1787892992.182702:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787892992.182709:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493305728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787892992.182720:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1787892992.182801:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787892992.182814:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787892992.182816:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787892992.182818:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787892992.182878:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ed561180 x1874741493304832/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892992.182891:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493304832:0@lo:400:kworker.0 00000100:00100000:3.0:1787892992.183198:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493305728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 490us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892992.183211:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1787892992.183246:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffbddf80 x1874741493305600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893008 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892992.183262:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493305600:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1787892992.183671:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb9a680 x1874741493305344/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892992.183681:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493305344:0@lo:400:kworker.0 00000100:00100000:1.0:1787892992.183706:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c772c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874741493304192:0@lo:400:kworker.0 00010000:00080000:1.0:1787892992.183718:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ed560700 x1874741493304704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892992.183726:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1874741493304704:0@lo:400:kworker.0 00010000:00080000:1.0:1787892992.183737:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb9a300 x1874741493305216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892992.183745:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1874741493305216:0@lo:400:kworker.0 00010000:00080000:1.0:1787892992.183754:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffbdd880 x1874741493305728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893008 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892992.183767:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493305728:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787892992.690259:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892993.713996:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787892994.233606:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493305856:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787892994.233709:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892994.235213:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493305856 00000100:00100000:2.0:1787892994.235229:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493305856 00000100:00100000:2.0:1787892994.235334:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787892994.235348:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493305856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787892994.235409:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787892994.235527:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493305856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 184us (1818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892994.235535:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1787892994.235596:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e711ca80 x1874741493305856/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893010 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892994.235623:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493305856:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787892994.237010:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787892994.242618:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493305984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787892994.242731:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892994.242876:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493305984 00000100:00100000:1.0:1787892994.242887:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493305984 00000100:00100000:1.0:1787892994.242971:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787892994.242983:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493305984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787892994.243014:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787892994.243073:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493305984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892994.243106:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1787892994.243339:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787892994.243387:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb9a300 x1874741493305984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893010 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892994.243412:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493305984:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787892994.746403:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892995.611924:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787892995.611964:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787892995.611983:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787892995.612003:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787892995.612446:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481709568 00000100:00100000:2.0:1787892995.612455:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481709568 00000100:00100000:2.0:1787892995.612525:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481709440 00000100:00100000:2.0:1787892995.612529:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481709440 00000100:00100000:2.0:1787892995.612553:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 75 00000100:00100000:2.0:1787892995.612561:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481709568:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787892995.612628:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481709568:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 68us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892995.612635:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 75 00000100:00100000:2.0:1787892995.612650:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 76 00000100:00100000:2.0:1787892995.612656:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+6:2390:x1874741481709440:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787892995.612688:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+6:2390:x1874741481709440:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 32us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892995.612694:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 76 00000100:00100000:2.0:1787892995.612711:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481709824 00000100:00100000:2.0:1787892995.612715:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481709824 00000100:00080000:3.0:1787892995.612735:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787892995.612739:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787892995.612739:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 25 00000100:00080000:3.0:1787892995.612741:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787892995.612745:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481709824:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787892995.612770:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481709824:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 26us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892995.612775:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 25 00000100:00100000:2.0:1787892995.615410:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481709312 00000100:00100000:2.0:1787892995.615426:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481709312 00000100:00100000:2.0:1787892995.615507:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 275 00000100:00100000:2.0:1787892995.615518:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:2390:x1874741481709312:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787892995.615592:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:2390:x1874741481709312:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 77us (3677us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892995.615600:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 275 00000100:00100000:3.0:1787892995.617114:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787892995.617144:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481709696 00000100:00100000:3.0:1787892995.617151:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481709696 00000100:00100000:3.0:1787892995.617261:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 26 00000100:00100000:3.0:1787892995.617272:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481709696:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787892995.617329:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481709696:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 60us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892995.617337:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 26 00000100:00080000:2.0:1787892995.620055:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787892995.761696:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493306112:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787892995.761786:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787892995.761853:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787892995.761868:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493306112 00000100:00100000:2.0:1787892995.761875:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493306112 00000100:00100000:2.0:1787892995.761920:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787892995.761930:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493306112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787892995.761967:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787892995.762007:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493306112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892995.762027:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787892995.762071:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493306112:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787892996.797697:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787892996.797770:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787892996.797794:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493306240:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787892996.797867:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892996.797984:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493306240 00000100:00100000:1.0:1787892996.797992:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493306240 00000100:00100000:1.0:1787892996.798044:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787892996.798053:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493306240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787892996.798086:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787892996.798193:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493306240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 140us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892996.798200:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787892996.798312:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493306240:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1787892997.208929:0:10682:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg235-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:0.0:1787892997.298746:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493306752:0@lo:400:kworker.0 00000100:00100000:0.0:1787892997.298819:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892997.298878:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493307264:0@lo:400:kworker.0 00000100:00100000:0.0:1787892997.298901:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892997.298924:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493307776:0@lo:400:kworker.0 00000100:00100000:0.0:1787892997.298943:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892997.298969:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1787892997.298974:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493306368:0@lo:400:kworker.0 00000100:00100000:0.0:1787892997.298997:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892997.299014:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493306880:0@lo:400:kworker.0 00000100:00100000:0.0:1787892997.299033:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892997.299047:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493307392:0@lo:400:kworker.0 00000100:00100000:0.0:1787892997.299065:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892997.299077:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493307904:0@lo:400:kworker.0 00000100:00100000:0.0:1787892997.299093:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892997.299112:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493306496:0@lo:400:kworker.0 00000100:00100000:0.0:1787892997.299131:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892997.299145:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493307008:0@lo:400:kworker.0 00000100:00100000:0.0:1787892997.299162:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892997.299175:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1874741493307520:0@lo:400:kworker.0 00000100:00100000:0.0:1787892997.299194:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892997.299209:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787892997.299214:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493306624:0@lo:400:kworker.0 00000100:00100000:0.0:1787892997.299242:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892997.299257:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493307136:0@lo:400:kworker.0 00000100:00100000:0.0:1787892997.299294:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892997.299310:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1874741493307648:0@lo:400:kworker.0 00000100:00100000:0.0:1787892997.299327:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892997.299351:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493306752 00000100:00100000:0.0:1787892997.299357:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493306752 00000100:00100000:0.0:1787892997.299389:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493306496 00000100:00100000:0.0:1787892997.299391:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493306496 00000100:00100000:0.0:1787892997.299400:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493307008 00000100:00100000:0.0:1787892997.299402:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493307008 00000100:00100000:0.0:1787892997.299420:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493307520 00000100:00100000:0.0:1787892997.299423:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493307520 00000100:00100000:0.0:1787892997.299433:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493307136 00000100:00100000:0.0:1787892997.299436:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493307136 00000100:00100000:0.0:1787892997.299446:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493307648 00000100:00100000:0.0:1787892997.299448:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493307648 00000100:00100000:0.0:1787892997.299461:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787892997.299469:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493306752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787892997.299545:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493306752:12345-0@lo:400:kworker.0 Request processed in 76us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892997.299552:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787892997.299569:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787892997.299574:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493306496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787892997.299600:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493306496:12345-0@lo:400:kworker.0 Request processed in 26us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892997.299606:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787892997.299615:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787892997.299621:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493307008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787892997.299642:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493307008:12345-0@lo:400:kworker.0 Request processed in 22us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892997.299653:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787892997.299663:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787892997.299668:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874741493307520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787892997.299689:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874741493307520:12345-0@lo:400:kworker.0 Request processed in 22us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892997.299694:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787892997.299703:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787892997.299708:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7db2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493307136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787892997.299727:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7db2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493307136:12345-0@lo:400:kworker.0 Request processed in 20us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892997.299733:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787892997.299742:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787892997.299747:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7db1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1874741493307648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787892997.299767:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7db1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1874741493307648:12345-0@lo:400:kworker.0 Request processed in 20us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892997.299772:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787892997.299786:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493307264 00000100:00100000:0.0:1787892997.299789:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493307264 00000100:00100000:0.0:1787892997.299804:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493307776 00000100:00100000:0.0:1787892997.299807:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493307776 00000100:00100000:0.0:1787892997.299816:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493307392 00000100:00100000:0.0:1787892997.299818:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493307392 00000100:00100000:0.0:1787892997.299826:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493307904 00000100:00100000:0.0:1787892997.299828:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493307904 00000100:00100000:0.0:1787892997.299838:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787892997.299843:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493307264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787892997.299878:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493307264:12345-0@lo:400:kworker.0 Request processed in 35us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892997.299884:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787892997.299895:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787892997.299901:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493307776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787892997.299936:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493307776:12345-0@lo:400:kworker.0 Request processed in 35us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892997.299942:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787892997.299952:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787892997.299957:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493307392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787892997.299977:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493307392:12345-0@lo:400:kworker.0 Request processed in 20us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892997.299982:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787892997.299990:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787892997.299995:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493307904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787892997.300014:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493307904:12345-0@lo:400:kworker.0 Request processed in 19us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892997.300019:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787892997.300037:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493306368 00000100:00100000:0.0:1787892997.300040:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493306368 00000100:00100000:0.0:1787892997.300062:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1787892997.300067:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+24:3632:x1874741493306368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787892997.300090:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+24:3632:x1874741493306368:12345-0@lo:400:kworker.0 Request processed in 23us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892997.300096:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1787892997.300125:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493306880 00000100:00100000:0.0:1787892997.300129:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493306880 00000100:00100000:0.0:1787892997.300146:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493306624 00000100:00100000:0.0:1787892997.300148:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493306624 00000100:00100000:0.0:1787892997.300159:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787892997.300164:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493306880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787892997.300190:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493306880:12345-0@lo:400:kworker.0 Request processed in 26us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892997.300196:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787892997.300205:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787892997.300209:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493306624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787892997.300244:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493306624:12345-0@lo:400:kworker.0 Request processed in 34us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892997.300249:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1787892997.300289:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787892997.300294:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787892997.300297:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787892997.300299:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787892997.300328:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493306624:0@lo:400:kworker.0 00010000:00080000:0.0:1787892997.300341:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb6d880 x1874741493307136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892997.300352:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493307136:0@lo:400:kworker.0 00010000:00080000:0.0:1787892997.300361:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb6ce00 x1874741493307648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892997.300370:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1874741493307648:0@lo:400:kworker.0 00000100:00100000:0.0:1787892997.300381:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493306496:0@lo:400:kworker.0 00000100:00100000:0.0:1787892997.300400:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493307008:0@lo:400:kworker.0 00000100:00100000:0.0:1787892997.300408:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1874741493307520:0@lo:400:kworker.0 00000100:00100000:0.0:1787892997.300456:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493306368:0@lo:400:kworker.0 00000100:00100000:0.0:1787892997.300465:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493306880:0@lo:400:kworker.0 00010000:00080000:0.0:1787892997.300474:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb6e680 x1874741493307392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892997.300481:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493307392:0@lo:400:kworker.0 00010000:00080000:0.0:1787892997.300515:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb69c00 x1874741493307904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892997.300524:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493307904:0@lo:400:kworker.0 00000100:00100000:0.0:1787892997.300536:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493306752:0@lo:400:kworker.0 00010000:00080000:0.0:1787892997.300546:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb6e300 x1874741493307264/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892997.300554:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493307264:0@lo:400:kworker.0 00010000:00080000:0.0:1787892997.300563:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb6c700 x1874741493307776/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892997.300574:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493307776:0@lo:400:kworker.0 00000100:00100000:2.0:1787892997.301111:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787892997.301122:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493308032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787892997.301160:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892997.301194:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493308032 00000100:00100000:2.0:1787892997.301198:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493308032 00000100:00100000:2.0:1787892997.301242:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787892997.301249:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493308032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787892997.301271:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787892997.301305:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493308032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892997.301311:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1787892997.301336:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e5f71180 x1874741493308032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893013 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892997.301350:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493308032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787892997.301697:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493308160:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787892997.301724:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892997.301846:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493308160 00000100:00100000:1.0:1787892997.301851:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493308160 00000100:00100000:1.0:1787892997.301882:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787892997.301889:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493308160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787892997.301899:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787892997.301931:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493308160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892997.301937:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1787892997.301993:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb98700 x1874741493308160/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893013 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892997.302005:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493308160:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787892997.824327:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787892998.835963:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787892999.345760:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493308288:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787892999.345838:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892999.345930:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493308288 00000100:00100000:0.0:1787892999.345938:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493308288 00000100:00100000:0.0:1787892999.345991:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787892999.346001:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7db3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493308288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787892999.346046:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787892999.346092:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7db3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493308288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892999.346098:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1787892999.346119:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787892999.346151:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e5f71180 x1874741493308288/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893015 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892999.346169:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493308288:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787892999.346614:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493308416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787892999.346653:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892999.346776:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493308416 00000100:00100000:2.0:1787892999.346782:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493308416 00000100:00100000:2.0:1787892999.346832:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787892999.346840:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493308416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787892999.346855:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787892999.346894:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493308416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892999.346910:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1787892999.346937:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb9aa00 x1874741493308416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893015 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892999.346951:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493308416:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787892999.347002:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787892999.857765:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893000.742693:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893000.742733:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893000.742756:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893000.742787:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893000.742813:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893000.742949:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481709952 00000100:00100000:3.0:1787893000.742959:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481709952 00000100:00100000:3.0:1787893000.743001:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 277 00000100:00100000:3.0:1787893000.743011:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:2391:x1874741481709952:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893000.743079:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:2391:x1874741481709952:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 69us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893000.743086:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 277 00000100:00100000:0.0:1787893000.745458:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481710208 00000100:00100000:0.0:1787893000.745469:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481710208 00000100:00100000:0.0:1787893000.745533:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481710080 00000100:00100000:0.0:1787893000.745535:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481710080 00000100:00100000:0.0:1787893000.745553:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 83 00000100:00100000:0.0:1787893000.745559:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+5:2391:x1874741481710208:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893000.745616:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+5:2391:x1874741481710208:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 57us (2882us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893000.745620:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 83 00000100:00100000:0.0:1787893000.745631:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 84 00000100:00100000:0.0:1787893000.745635:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+6:2391:x1874741481710080:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893000.745648:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+6:2391:x1874741481710080:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 13us (2893us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893000.745651:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 84 00000100:00100000:0.0:1787893000.745671:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481710336 00000100:00100000:0.0:1787893000.745674:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481710336 00000100:00100000:0.0:1787893000.745689:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481710464 00000100:00100000:0.0:1787893000.745691:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481710464 00000100:00100000:0.0:1787893000.745702:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 18 00000100:00100000:0.0:1787893000.745705:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7201f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+5:2389:x1874741481710336:12345-192.168.202.35@tcp:9:kworker.0 00000020:00000080:0.0:1787893000.745724:0:8420:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf0bff 00000100:00080000:0.0:1787893000.745731:0:8420:0:(import.c:65:import_set_state_nolock()) ffff9fc9ffb14800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787893000.745763:0:8420:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1787893000.745863:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7201f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+2:2389:x1874741481710336:12345-192.168.202.35@tcp:9:kworker.0 Request processed in 156us (3075us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893000.745870:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 18 00000100:00100000:0.0:1787893000.745882:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 19 00000100:00100000:0.0:1787893000.745887:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7203100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+5:2389:x1874741481710464:12345-192.168.202.35@tcp:9:kworker.0 00000020:00000080:0.0:1787893000.745897:0:8420:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf0c06 00000100:00080000:0.0:1787893000.745902:0:8420:0:(import.c:65:import_set_state_nolock()) ffff9fc8c76ae000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787893000.745917:0:8420:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1787893000.745964:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7203100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+2:2389:x1874741481710464:12345-192.168.202.35@tcp:9:kworker.0 Request processed in 77us (3151us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893000.745968:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 19 00010000:00010000:0.0:1787893000.746051:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787893000.746345:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787893000.746350:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787893000.746352:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787893000.746354:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787893000.746476:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893000.888403:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893000.888415:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493308544:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787893000.888487:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893000.888590:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493308544 00000100:00100000:2.0:1787893000.888598:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493308544 00000100:00100000:2.0:1787893000.888641:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787893000.888650:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7203800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493308544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787893000.888681:0:7865:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787893000.888942:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7203800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493308544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 292us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893000.888950:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787893000.888998:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493308544:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787893001.906825:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893001.910540:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787893001.910566:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493308672:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787893001.910636:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893001.911790:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493308672 00000100:00100000:1.0:1787893001.911803:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493308672 00000100:00100000:1.0:1787893001.911857:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787893001.911879:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7200e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493308672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787893001.911916:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787893001.912147:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7200e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493308672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 270us (1510us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893001.912155:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787893001.912233:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493308672:0@lo:41:osp-pre-0-1.0 00000001:02000400:1.0:1787893001.963699:0:10925:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg235-server.virtnet: executing yml_node 00000100:00100000:1.0:1787893002.419771:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787893002.419794:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493308800:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787893002.419862:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893002.419955:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493308800 00000100:00100000:1.0:1787893002.419963:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493308800 00000100:00100000:1.0:1787893002.420018:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787893002.420028:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493308800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787893002.420057:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787893002.420100:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493308800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893002.420107:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1787893002.420127:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787893002.420153:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb9bb80 x1874741493308800/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893018 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893002.420170:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493308800:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787893002.422174:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7203b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493308928:0@lo:400:kworker.0 00000100:00100000:1.0:1787893002.422283:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893002.422376:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787893002.422389:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493309056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787893002.422422:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893002.422548:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493309312:0@lo:400:kworker.0 00000100:00100000:3.0:1787893002.422575:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893002.422892:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787893002.422907:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493309184:0@lo:400:kworker.0 00000100:00100000:1.0:1787893002.422935:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893002.423012:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493309056 00000100:00100000:1.0:1787893002.423019:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493309056 00000100:00100000:1.0:1787893002.423063:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787893002.423071:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493309056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787893002.423091:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787893002.423128:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493309056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893002.423136:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1787893002.423157:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787893002.423349:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493309312 00000100:00100000:2.0:1787893002.423353:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493309312 00000100:00100000:2.0:1787893002.423387:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787893002.423394:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493309312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893002.423431:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493309312:12345-0@lo:400:kworker.0 Request processed in 39us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893002.423437:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787893002.423458:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493309824:0@lo:400:kworker.0 00000100:00100000:2.0:1787893002.423480:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893002.423534:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493309568:0@lo:400:kworker.0 00000100:00100000:1.0:1787893002.423561:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893002.423580:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493310080:0@lo:400:kworker.0 00000100:00100000:1.0:1787893002.423603:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893002.423623:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787893002.423629:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493309696:0@lo:400:kworker.0 00000100:00100000:1.0:1787893002.423667:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493309568 00000100:00100000:1.0:1787893002.423671:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493309568 00000100:00100000:1.0:1787893002.423696:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787893002.423702:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493309568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893002.423736:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493309568:12345-0@lo:400:kworker.0 Request processed in 34us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893002.423742:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787893002.423760:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874741493309440:0@lo:400:kworker.0 00000100:00100000:0.0:1787893002.423962:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493308928 00000100:00100000:0.0:1787893002.423967:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493308928 00000100:00100000:0.0:1787893002.424003:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1787893002.424011:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+24:3633:x1874741493308928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893002.424051:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+24:3633:x1874741493308928:12345-0@lo:400:kworker.0 Request processed in 41us (1768us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893002.424064:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1787893002.424092:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493310080 00000100:00100000:0.0:1787893002.424096:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493310080 00000100:00100000:0.0:1787893002.424127:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787893002.424134:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493310080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893002.424169:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493310080:12345-0@lo:400:kworker.0 Request processed in 36us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893002.424175:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1787893002.424204:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787893002.424410:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493310336:0@lo:400:kworker.0 00000100:00100000:2.0:1787893002.424435:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893002.424482:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493309184 00000100:00100000:3.0:1787893002.424486:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493309184 00000100:00100000:0.0:1787893002.424712:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493309824 00000100:00100000:0.0:1787893002.424717:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493309824 00000100:00100000:0.0:1787893002.424747:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787893002.424754:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493309184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893002.424786:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493309184:12345-0@lo:400:kworker.0 Request processed in 33us (1850us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893002.424792:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787893002.424806:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787893002.424812:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493309824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893002.424836:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493309824:12345-0@lo:400:kworker.0 Request processed in 25us (1356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893002.424841:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1787893002.424856:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787893002.425052:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493310336 00000100:00100000:3.0:1787893002.425064:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493310336 00000100:00100000:3.0:1787893002.425090:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787893002.425097:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493310336:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787893002.425142:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787893002.425169:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893002.425239:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1874741493310208:0@lo:400:kworker.0 00000100:00100000:1.0:1787893002.425266:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893002.425311:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493309312:0@lo:400:kworker.0 00010000:00080000:2.0:1787893002.425340:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c67a9f80 x1874741493309824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893002.425351:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493309824:0@lo:400:kworker.0 00010000:00080000:2.0:1787893002.425379:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffbdc380 x1874741493309056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893018 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893002.425395:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493309056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787893002.427816:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493310336:12345-0@lo:400:kworker.0 Request processed in 2712us (3372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893002.427830:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787893002.428772:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493309568:0@lo:400:kworker.0 00010000:00080000:1.0:1787893002.428788:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c67aa680 x1874741493310080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893002.428799:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493310080:0@lo:400:kworker.0 00000100:00100000:1.0:1787893002.428812:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493309184:0@lo:400:kworker.0 00000100:00100000:0.0:1787893002.429228:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493309696 00000100:00100000:0.0:1787893002.429237:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493309696 00000100:00100000:0.0:1787893002.429296:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493310208 00000100:00100000:0.0:1787893002.429300:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493310208 00000100:00100000:0.0:1787893002.429331:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787893002.429339:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493309696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893002.429412:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493309696:12345-0@lo:400:kworker.0 Request processed in 73us (4242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893002.429418:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787893002.429433:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787893002.429439:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874741493310208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893002.429471:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874741493310208:12345-0@lo:400:kworker.0 Request processed in 32us (4204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893002.429476:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:0.0:1787893002.429515:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787893002.429538:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493309696:0@lo:400:kworker.0 00000100:00100000:0.0:1787893002.429549:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1874741493310208:0@lo:400:kworker.0 00000100:00100000:0.0:1787893002.429754:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893002.429783:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493309952:0@lo:400:kworker.0 00000100:00100000:0.0:1787893002.429822:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893002.429847:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7203b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493308928:0@lo:400:kworker.0 00000100:00100000:0.0:1787893002.429874:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493309952 00000100:00100000:0.0:1787893002.429878:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493309952 00000100:00100000:0.0:1787893002.429907:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787893002.429914:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe5ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493309952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893002.430022:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe5ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493309952:12345-0@lo:400:kworker.0 Request processed in 107us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893002.430028:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1787893002.430210:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787893002.430226:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493309440 00000100:00100000:0.0:1787893002.430230:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493309440 00000100:00100000:0.0:1787893002.430252:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787893002.430258:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7db3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1874741493309440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893002.430288:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7db3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1874741493309440:12345-0@lo:400:kworker.0 Request processed in 30us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893002.430294:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787893002.430322:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874741493309440:0@lo:400:kworker.0 00010000:00080000:0.0:1787893002.430335:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c67ab100 x1874741493309952/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893002.430344:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493309952:0@lo:400:kworker.0 00010000:00080000:3.0:1787893002.431796:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7e04a80 x1874741493310336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893002.431811:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493310336:0@lo:400:kworker.0 00010000:00010000:3.0:1787893002.930558:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893003.954633:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893004.465810:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493310464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787893004.465872:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787893004.465887:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7e05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493310592:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787893004.465893:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893004.465971:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493310464 00000100:00100000:1.0:1787893004.465979:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493310464 00000100:00100000:1.0:1787893004.466025:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787893004.466034:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7db1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493310464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787893004.466060:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1787893004.466131:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787893004.466187:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893004.466746:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493310592 00000100:00100000:3.0:1787893004.466752:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493310592 00000100:00100000:3.0:1787893004.466798:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787893004.466805:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493310592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787893004.466817:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787893004.466852:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493310592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893004.466859:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1787893004.466921:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787893004.466949:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7e05180 x1874741493310592/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893020 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893004.466969:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7e05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493310592:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787893004.469529:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7db1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493310464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3488us (3631us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893004.469543:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1787893004.469670:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb98380 x1874741493310464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893020 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893004.469693:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493310464:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787893004.978805:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893005.850888:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893005.850942:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893005.850979:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893005.851006:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481710848 00000100:00100000:2.0:1787893005.851015:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481710848 00000100:00100000:2.0:1787893005.851067:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481710720 00000100:00100000:2.0:1787893005.851070:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481710720 00000100:00100000:2.0:1787893005.851091:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 91 00000100:00100000:2.0:1787893005.851101:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481710848:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893005.851176:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481710848:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 76us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893005.851184:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 91 00000100:00100000:2.0:1787893005.851201:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 92 00000100:00100000:2.0:1787893005.851207:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+6:2390:x1874741481710720:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893005.851231:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+6:2390:x1874741481710720:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 24us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893005.851236:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 92 00000100:00080000:2.0:1787893005.851250:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787893005.851253:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787893005.851361:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481710592 00000100:00100000:3.0:1787893005.851366:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481710592 00000100:00100000:3.0:1787893005.851399:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 279 00000100:00100000:3.0:1787893005.851406:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:2390:x1874741481710592:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893005.851430:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:2390:x1874741481710592:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 26us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893005.851437:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 279 00000100:00100000:1.0:1787893006.003111:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787893006.003128:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493310720:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787893006.003203:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893006.003254:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493310720 00000100:00100000:0.0:1787893006.003264:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493310720 00000100:00100000:0.0:1787893006.003366:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787893006.003378:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493310720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787893006.003415:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787893006.003471:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493310720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893006.003479:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787893006.003591:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493310720:0@lo:41:osp-pre-1-0.0 00000001:00100000:0.0:1787893006.005517:0:9497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 58232959-285a-4954-a3ac-571a2b817017 00000020:00000080:0.0:1787893006.005525:0:9497:0:(genops.c:885:class_export_put()) final put ffff9fc8c76a8800/58232959-285a-4954-a3ac-571a2b817017 00000020:00000080:1.0:1787893006.006004:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c76a8800/58232959-285a-4954-a3ac-571a2b817017 for lustre-OST0001 00000020:00000080:1.0:1787893006.006078:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc8c76ae000 for lustre-OST0001 00010000:00010000:3.0:1787893006.007333:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787893006.008705:0:8413:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 58232959-285a-4954-a3ac-571a2b817017 00000020:00000080:1.0:1787893006.008710:0:8413:0:(genops.c:885:class_export_put()) final put ffff9fc8c64ba800/58232959-285a-4954-a3ac-571a2b817017 00000020:00000080:0.0:1787893006.008777:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c64ba800/58232959-285a-4954-a3ac-571a2b817017 for lustre-OST0000 00000020:00000080:0.0:1787893006.008814:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc9ffb14800 for lustre-OST0000 00000001:02000400:0.0:1787893006.535240:0:11109:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.84 00010000:00010000:1.0:1787893007.041570:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893007.041671:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787893007.041694:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493310848:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787893007.041758:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893007.041830:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493310848 00000100:00100000:1.0:1787893007.041838:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493310848 00000100:00100000:1.0:1787893007.041898:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787893007.041907:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493310848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787893007.041939:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787893007.041983:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493310848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893007.041990:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787893007.042035:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493310848:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787893007.539639:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787893007.539670:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493310976:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787893007.539765:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893007.539853:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493310976 00000100:00100000:3.0:1787893007.539863:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493310976 00000100:00100000:3.0:1787893007.539936:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787893007.539949:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493310976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787893007.539987:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787893007.540040:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493310976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893007.540047:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1787893007.540073:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787893007.540110:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffbdc700 x1874741493310976/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893023 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893007.541573:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493310976:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787893007.551285:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1874741493311232:0@lo:400:kworker.0 00000100:00100000:0.0:1787893007.551387:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893007.551441:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1874741493311744:0@lo:400:kworker.0 00000100:00100000:0.0:1787893007.553188:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893007.553260:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1874741493312256:0@lo:400:kworker.0 00000100:00100000:2.0:1787893007.553299:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493311232 00000100:00100000:0.0:1787893007.553309:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893007.553317:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493311232 00000100:00100000:1.0:1787893007.553460:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493311104:0@lo:400:kworker.0 00000100:00100000:1.0:1787893007.553568:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893007.553620:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493311616:0@lo:400:kworker.0 00000100:00100000:0.0:1787893007.553638:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493311104 00000100:00100000:0.0:1787893007.553649:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493311104 00000100:00100000:1.0:1787893007.553658:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893007.553693:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493312128:0@lo:400:kworker.0 00000100:00100000:0.0:1787893007.553710:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1787893007.553723:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+24:3630:x1874741493311104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893007.553734:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893007.553803:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+24:3630:x1874741493311104:12345-0@lo:400:kworker.0 Request processed in 82us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893007.553810:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1787893007.553936:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493311616 00000100:00100000:0.0:1787893007.553941:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493311616 00000100:00100000:0.0:1787893007.553969:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787893007.553976:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493311616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893007.554038:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787893007.554052:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493312640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787893007.554411:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893007.554452:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493312640 00000100:00100000:3.0:1787893007.554458:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493312640 00000100:00100000:3.0:1787893007.554544:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787893007.554554:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493312640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787893007.554578:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787893007.554621:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493312640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893007.554628:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1787893007.554685:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787893007.554728:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffbdc700 x1874741493312640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893023 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893007.554752:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493312640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787893007.555575:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493311616:12345-0@lo:400:kworker.0 Request processed in 1591us (1910us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893007.555586:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787893007.555629:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874741493311488:0@lo:400:kworker.0 00000100:00100000:0.0:1787893007.555689:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893007.556252:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493311360:0@lo:400:kworker.0 00000100:00100000:3.0:1787893007.556314:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893007.556356:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493311872:0@lo:400:kworker.0 00000100:00100000:3.0:1787893007.556396:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493311360 00000100:00100000:3.0:1787893007.556404:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493311360 00000100:00100000:3.0:1787893007.556457:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787893007.556467:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493311360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893007.556547:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493311360:12345-0@lo:400:kworker.0 Request processed in 81us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893007.556554:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787893007.558159:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493312000:0@lo:400:kworker.0 00000100:00100000:0.0:1787893007.558213:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893007.558230:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493312512:0@lo:400:kworker.0 00000100:00100000:0.0:1787893007.558245:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893007.558292:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493312128 00000100:00100000:0.0:1787893007.558299:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493312128 00000100:00100000:0.0:1787893007.558451:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493312000 00000100:00100000:0.0:1787893007.558456:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493312000 00000100:00100000:0.0:1787893007.558472:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493312512 00000100:00100000:0.0:1787893007.558475:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493312512 00000100:00100000:0.0:1787893007.558507:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787893007.558517:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493312128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893007.558568:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493312128:12345-0@lo:400:kworker.0 Request processed in 53us (4840us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893007.558575:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787893007.558590:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787893007.558596:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493312000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893007.558624:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493312000:12345-0@lo:400:kworker.0 Request processed in 29us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893007.558630:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787893007.558639:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787893007.558644:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493312512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893007.558664:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493312512:12345-0@lo:400:kworker.0 Request processed in 20us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893007.558669:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787893007.558756:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493311744 00000100:00100000:2.0:1787893007.558770:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493311744 00000100:00100000:2.0:1787893007.558822:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493312256 00000100:00100000:2.0:1787893007.558826:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493312256 00000100:00100000:2.0:1787893007.558854:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493311488 00000100:00100000:2.0:1787893007.558859:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493311488 00000100:00100000:2.0:1787893007.558883:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787893007.558895:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7db0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1874741493311232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893007.559088:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787893007.559099:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3631:x1874741493311744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893007.559272:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7db0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1874741493311232:12345-0@lo:400:kworker.0 Request processed in 380us (7884us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893007.559278:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787893007.559337:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1874741493311232:0@lo:400:kworker.0 00000100:00100000:2.0:1787893007.559367:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787893007.559375:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1874741493312256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893007.560070:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1874741493312256:12345-0@lo:400:kworker.0 Request processed in 693us (6763us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893007.560079:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787893007.560302:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3631:x1874741493311744:12345-0@lo:400:kworker.0 Request processed in 1204us (7292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893007.560312:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787893007.560335:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787893007.560345:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1874741493311488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893007.560396:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1874741493311488:12345-0@lo:400:kworker.0 Request processed in 55us (4707us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893007.560403:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787893007.560526:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1874741493312256:0@lo:400:kworker.0 00000100:00100000:2.0:1787893007.560553:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1874741493311744:0@lo:400:kworker.0 00000100:00100000:2.0:1787893007.560708:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893007.560749:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493312384:0@lo:400:kworker.0 00000100:00100000:2.0:1787893007.560790:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893007.560824:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493311360:0@lo:400:kworker.0 00000100:00100000:2.0:1787893007.560844:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493311872 00000100:00100000:2.0:1787893007.560850:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493311872 00000100:00100000:2.0:1787893007.560885:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493312384 00000100:00100000:2.0:1787893007.560887:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493312384 00000100:00100000:2.0:1787893007.560904:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787893007.560910:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493311872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893007.561037:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493311872:12345-0@lo:400:kworker.0 Request processed in 127us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893007.561044:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787893007.561068:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787893007.561075:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493312384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893007.561107:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493312384:12345-0@lo:400:kworker.0 Request processed in 33us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893007.561125:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:2.0:1787893007.561170:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7db0000 x1874741493311872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893007.561181:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493311872:0@lo:400:kworker.0 00010000:00080000:2.0:1787893007.561191:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7db2d80 x1874741493312384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893007.561199:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493312384:0@lo:400:kworker.0 00000100:00100000:2.0:1787893007.561619:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493311104:0@lo:400:kworker.0 00000100:00100000:2.0:1787893007.561638:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493311616:0@lo:400:kworker.0 00010000:00080000:2.0:1787893007.561665:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7db0a80 x1874741493312128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893007.561678:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493312128:0@lo:400:kworker.0 00000100:00080000:2.0:1787893007.565353:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787893007.565364:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787893007.565370:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787893007.566248:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874741493311488:0@lo:400:kworker.0 00010000:00080000:3.0:1787893007.566666:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7db3480 x1874741493312000/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893007.566682:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493312000:0@lo:400:kworker.0 00010000:00080000:3.0:1787893007.566700:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7db1180 x1874741493312512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893007.566719:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493312512:0@lo:400:kworker.0 00010000:00010000:0.0:1787893008.049899:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893009.081094:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787893009.553744:0:11206:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.84 00000100:00100000:1.0:1787893009.585686:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787893009.585711:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493312768:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787893009.585784:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893009.585901:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493312896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787893009.585927:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893009.586032:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493312768 00000100:00100000:3.0:1787893009.586111:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493312768 00000100:00100000:3.0:1787893009.586193:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493312896 00000100:00100000:3.0:1787893009.586197:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493312896 00000100:00100000:3.0:1787893009.586256:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787893009.586270:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493312768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787893009.586300:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787893009.586357:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493312768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893009.586365:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787893009.586388:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787893009.586395:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493312896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787893009.586406:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787893009.586452:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493312896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893009.586460:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1787893009.586548:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb99180 x1874741493312896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893025 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893009.586571:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493312896:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1787893009.586610:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb9aa00 x1874741493312768/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893025 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893009.586622:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493312768:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787893009.586841:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787893010.097723:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893010.974208:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893010.974252:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893010.974338:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481711104 00000100:00100000:2.0:1787893010.974347:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481711104 00000100:00100000:2.0:1787893010.974417:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 99 00000100:00100000:2.0:1787893010.974451:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+6:2390:x1874741481711104:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893010.974569:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+6:2390:x1874741481711104:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 110us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893010.974577:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 99 00000100:00100000:3.0:1787893010.974979:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00080000:0.0:1787893010.975089:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787893010.975146:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481711232 00000100:00100000:2.0:1787893010.975151:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481711232 00000100:00100000:2.0:1787893010.975198:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 100 00000100:00100000:2.0:1787893010.975206:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481711232:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893010.975240:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481711232:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 34us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893010.975246:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 100 00000100:00080000:0.0:1787893010.975514:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787893010.978146:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481710976 00000100:00100000:1.0:1787893010.978159:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481710976 00000100:00100000:1.0:1787893010.978296:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 281 00000100:00100000:1.0:1787893010.978307:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:2390:x1874741481710976:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893010.978386:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:2390:x1874741481710976:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 82us (4133us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893010.978394:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 281 00010000:00010000:1.0:1787893011.123015:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893011.123082:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493313024:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787893011.123220:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893011.123367:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493313024 00000100:00100000:1.0:1787893011.123376:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493313024 00000100:00100000:1.0:1787893011.123429:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787893011.123439:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493313024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787893011.123474:0:7865:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787893011.123565:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493313024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893011.123572:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787893011.123760:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493313024:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787893012.145698:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893012.147545:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7e07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493313152:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787893012.147710:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893012.151693:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493313152 00000100:00100000:2.0:1787893012.151707:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493313152 00000100:00100000:2.0:1787893012.151803:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787893012.151814:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493313152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787893012.151852:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787893012.151953:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493313152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 140us (4243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893012.151960:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787893012.155889:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7e07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493313152:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1787893012.170338:0:11304:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.84 00000100:00100000:0.0:1787893012.657810:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493313280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787893012.657883:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893012.657926:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493313280 00000100:00100000:1.0:1787893012.657934:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493313280 00000100:00100000:1.0:1787893012.657994:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787893012.658006:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7526d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493313280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787893012.658034:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787893012.658069:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7201180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493313792:0@lo:400:kworker.0 00000100:00100000:1.0:1787893012.658075:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7526d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493313280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893012.658082:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787893012.658105:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787893012.658124:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787893012.658124:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1874741493314304:0@lo:400:kworker.0 00000100:00100000:1.0:1787893012.658138:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493313792 00000100:00100000:1.0:1787893012.658142:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493313792 00000100:00100000:0.0:1787893012.658147:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893012.658164:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed563b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1874741493314816:0@lo:400:kworker.0 00000100:00100000:1.0:1787893012.658165:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787893012.658171:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493313792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893012.658182:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893012.658200:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493313792:12345-0@lo:400:kworker.0 Request processed in 30us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893012.658206:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:0.0:1787893012.658214:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffbdfb80 x1874741493313280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893028 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893012.658222:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493314304 00000100:00100000:1.0:1787893012.658224:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493314304 00000100:00100000:0.0:1787893012.658232:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493313280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787893012.658248:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493314816 00000100:00100000:1.0:1787893012.658251:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493314816 00000100:00100000:0.0:1787893012.658256:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7201180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493313792:0@lo:400:kworker.0 00000100:00100000:0.0:1787893012.658265:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787893012.658267:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787893012.658271:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7200380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1874741493313664:0@lo:400:kworker.0 00000100:00100000:1.0:1787893012.658272:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1874741493314304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893012.658292:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893012.658297:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1874741493314304:12345-0@lo:400:kworker.0 Request processed in 25us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893012.658303:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787893012.658322:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493313664 00000100:00100000:1.0:1787893012.658325:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493313664 00000100:00100000:1.0:1787893012.658339:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787893012.658343:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1874741493314816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893012.658372:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1874741493314816:12345-0@lo:400:kworker.0 Request processed in 28us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893012.658377:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787893012.658387:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787893012.658392:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1874741493313664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893012.658415:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1874741493313664:12345-0@lo:400:kworker.0 Request processed in 23us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893012.658420:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:1.0:1787893012.658436:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787893012.658521:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493313408:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787893012.658557:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893012.658589:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7201f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493313920:0@lo:400:kworker.0 00000100:00100000:3.0:1787893012.658609:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893012.658624:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed562680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493314432:0@lo:400:kworker.0 00000100:00100000:3.0:1787893012.658662:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893012.658680:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7115f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493314944:0@lo:400:kworker.0 00000100:00100000:3.0:1787893012.658698:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893012.658715:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1787893012.658721:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493313536:0@lo:400:kworker.0 00000100:00100000:3.0:1787893012.658747:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893012.658765:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7203100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493314048:0@lo:400:kworker.0 00000100:00100000:3.0:1787893012.658787:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893012.658803:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493314560:0@lo:400:kworker.0 00000100:00100000:3.0:1787893012.658819:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893012.658835:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7115880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493315072:0@lo:400:kworker.0 00000100:00100000:3.0:1787893012.658851:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893012.658873:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493313536 00000100:00100000:3.0:1787893012.658878:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493313536 00000100:00100000:3.0:1787893012.658904:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1787893012.658910:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+24:3632:x1874741493313536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893012.658945:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+24:3632:x1874741493313536:12345-0@lo:400:kworker.0 Request processed in 35us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893012.658951:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1787893012.658975:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493314432 00000100:00100000:3.0:1787893012.658979:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493314432 00000100:00100000:3.0:1787893012.659010:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493314944 00000100:00100000:3.0:1787893012.659013:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493314944 00000100:00100000:3.0:1787893012.659024:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493314560 00000100:00100000:3.0:1787893012.659027:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493314560 00000100:00100000:3.0:1787893012.659037:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493315072 00000100:00100000:3.0:1787893012.659040:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493315072 00000100:00100000:3.0:1787893012.659051:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787893012.659057:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c772f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493314432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893012.659059:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7203b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1874741493314176:0@lo:400:kworker.0 00000100:00100000:0.0:1787893012.659082:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893012.659096:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c772f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493314432:12345-0@lo:400:kworker.0 Request processed in 29us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893012.659102:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787893012.659107:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1874741493314688:0@lo:400:kworker.0 00000100:00100000:3.0:1787893012.659114:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787893012.659119:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c772c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493314944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893012.659128:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893012.659144:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c772c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493314944:12345-0@lo:400:kworker.0 Request processed in 25us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893012.659150:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1787893012.659156:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e7202a00 x1874741493314304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893012.659159:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787893012.659165:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c772e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493314560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893012.659166:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1874741493314304:0@lo:400:kworker.0 00010000:00080000:0.0:1787893012.659176:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ed563b80 x1874741493314816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893012.659184:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed563b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1874741493314816:0@lo:400:kworker.0 00000100:00100000:3.0:1787893012.659188:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c772e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493314560:12345-0@lo:400:kworker.0 Request processed in 24us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893012.659193:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787893012.659199:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7200380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1874741493313664:0@lo:400:kworker.0 00000100:00100000:3.0:1787893012.659202:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787893012.659207:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c772e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493315072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893012.659232:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c772e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493315072:12345-0@lo:400:kworker.0 Request processed in 25us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893012.659236:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493313920 00000100:00100000:3.0:1787893012.659237:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787893012.659238:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493313920 00000100:00080000:3.0:1787893012.659249:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787893012.659253:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493314176 00000100:00100000:0.0:1787893012.659255:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493314176 00000100:00080000:3.0:1787893012.659257:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787893012.659270:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493314688 00000100:00100000:3.0:1787893012.659272:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493313536:0@lo:400:kworker.0 00000100:00100000:0.0:1787893012.659272:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493314688 00010000:00080000:3.0:1787893012.659282:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ed560700 x1874741493314560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893012.659285:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787893012.659290:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493313920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893012.659291:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493314560:0@lo:400:kworker.0 00010000:00080000:3.0:1787893012.659299:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e7115880 x1874741493315072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893012.659307:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7115880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493315072:0@lo:400:kworker.0 00000100:00100000:3.0:1787893012.659316:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7201f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493313920:0@lo:400:kworker.0 00000100:00100000:0.0:1787893012.659316:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493313920:12345-0@lo:400:kworker.0 Request processed in 26us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893012.659322:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:3.0:1787893012.659324:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ed562680 x1874741493314432/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893012.659332:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed562680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493314432:0@lo:400:kworker.0 00000100:00100000:0.0:1787893012.659332:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787893012.659337:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7201180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3631:x1874741493314176:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787893012.659340:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e7115f80 x1874741493314944/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893012.659347:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7115f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493314944:0@lo:400:kworker.0 00000100:00100000:0.0:1787893012.659363:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7201180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3631:x1874741493314176:12345-0@lo:400:kworker.0 Request processed in 26us (280us total) trans 0 rc 0/0 00000100:00080000:3.0:1787893012.659367:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787893012.659368:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787893012.659378:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787893012.659383:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1874741493314688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893012.659421:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1874741493314688:12345-0@lo:400:kworker.0 Request processed in 38us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893012.659427:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787893012.659450:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7203b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1874741493314176:0@lo:400:kworker.0 00000100:00100000:0.0:1787893012.659459:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1874741493314688:0@lo:400:kworker.0 00000100:00100000:1.0:1787893012.659582:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493313408 00000100:00100000:1.0:1787893012.659587:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493313408 00000100:00100000:1.0:1787893012.659620:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787893012.659626:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493313408:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787893012.659899:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493314048 00000100:00100000:2.0:1787893012.659904:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493314048 00000100:00100000:2.0:1787893012.659940:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787893012.659948:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c772ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493314048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893012.659993:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c772ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493314048:12345-0@lo:400:kworker.0 Request processed in 46us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893012.660005:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787893012.660034:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7203100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493314048:0@lo:400:kworker.0 00002000:00000024:1.0:1787893012.660111:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787893012.660238:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493313408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 612us (1679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893012.660245:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1787893012.666107:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb98380 x1874741493313408/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893028 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893012.666140:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493313408:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787893013.169671:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787893013.963437:0:11352:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Aug 28 00:56:52 EDT 2026 00010000:00010000:0.0:1787893014.196707:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893014.705935:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493315200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787893014.706014:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893014.706097:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787893014.706305:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493315328:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787893014.706333:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893014.710648:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493315200 00000100:00100000:3.0:1787893014.710665:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493315200 00000100:00100000:3.0:1787893014.710728:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493315328 00000100:00100000:3.0:1787893014.710731:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493315328 00000100:00100000:3.0:1787893014.710750:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787893014.710759:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493315200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787893014.710789:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787893014.710869:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493315200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (4854us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893014.710883:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787893014.710898:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787893014.710904:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493315328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787893014.710915:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787893014.710943:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493315328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (4608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893014.710949:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1787893014.710971:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787893014.711008:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e7116300 x1874741493315328/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893030 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893014.711027:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493315328:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1787893014.711040:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb98380 x1874741493315200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893030 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893014.711052:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493315200:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787893015.218128:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893016.094980:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893016.095901:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893016.095961:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893016.096032:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481711360 00000100:00100000:2.0:1787893016.096047:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481711360 00000100:00100000:2.0:1787893016.096127:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 283 00000100:00100000:2.0:1787893016.096139:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:2392:x1874741481711360:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893016.096248:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:2392:x1874741481711360:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 111us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893016.096257:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 283 00000100:00100000:1.0:1787893016.104339:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481711488 00000100:00100000:1.0:1787893016.104359:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481711488 00000100:00100000:1.0:1787893016.104468:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481711616 00000100:00100000:1.0:1787893016.104473:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481711616 00000100:00100000:1.0:1787893016.104520:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 107 00000100:00100000:1.0:1787893016.104547:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+6:2392:x1874741481711488:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893016.104877:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+6:2392:x1874741481711488:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 333us (9914us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893016.104886:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 107 00000100:00100000:1.0:1787893016.104908:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 108 00000100:00100000:1.0:1787893016.104915:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+5:2392:x1874741481711616:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893016.104946:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+5:2392:x1874741481711616:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 33us (8985us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893016.104952:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 108 00000100:00080000:0.0:1787893016.109389:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787893016.109403:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787893016.242017:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893016.242459:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7116680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493315456:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787893016.242608:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893016.242860:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493315456 00000100:00100000:1.0:1787893016.242873:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493315456 00000100:00100000:1.0:1787893016.242957:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787893016.242969:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493315456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787893016.243027:0:7865:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787893016.246252:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493315456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3275us (3634us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893016.246267:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787893016.246448:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7116680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493315456:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787893017.268147:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7e07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493315584:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787893017.268232:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787893017.268338:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893017.268512:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493315584 00000100:00100000:0.0:1787893017.268520:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493315584 00000100:00100000:0.0:1787893017.268567:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787893017.268574:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493315584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787893017.268606:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787893017.274589:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493315584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 6004us (6345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893017.274604:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787893017.278343:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7e07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493315584:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787893017.778611:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787893017.778632:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7e04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493315712:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787893017.778760:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893017.788822:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787893017.788843:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493315840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787893017.788925:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893017.788990:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493315712 00000100:00100000:3.0:1787893017.788998:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493315712 00000100:00100000:3.0:1787893017.789167:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493315840 00000100:00100000:3.0:1787893017.789172:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493315840 00000100:00100000:3.0:1787893017.789192:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787893017.789200:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493315712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787893017.789229:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787893017.789271:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493315712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (10512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893017.789343:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787893017.789360:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787893017.789367:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493315840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787893017.789377:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787893017.789406:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493315840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893017.789411:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1787893017.789456:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7e04e00 x1874741493315712/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893033 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893017.789477:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7e04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493315712:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1787893017.789531:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787893017.789550:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb48a80 x1874741493315840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893033 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893017.789563:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493315840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787893017.789853:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493315968:0@lo:400:kworker.0 00000100:00100000:0.0:1787893017.789894:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893017.789931:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7203100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493316480:0@lo:400:kworker.0 00000100:00100000:0.0:1787893017.789957:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893017.789977:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1874741493316992:0@lo:400:kworker.0 00000100:00100000:0.0:1787893017.789999:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893017.790018:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787893017.790023:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed562680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493316096:0@lo:400:kworker.0 00000100:00100000:0.0:1787893017.790057:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893017.790074:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7203b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493316608:0@lo:400:kworker.0 00000100:00100000:0.0:1787893017.790095:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893017.790109:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493317120:0@lo:400:kworker.0 00000100:00100000:0.0:1787893017.790126:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893017.790152:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493315968 00000100:00100000:0.0:1787893017.790156:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493315968 00000100:00100000:0.0:1787893017.790187:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787893017.790194:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+24:3632:x1874741493315968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893017.790229:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+24:3632:x1874741493315968:12345-0@lo:400:kworker.0 Request processed in 35us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893017.790235:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787893017.790261:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493316480 00000100:00100000:0.0:1787893017.790265:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493316480 00000100:00100000:0.0:1787893017.790287:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493316992 00000100:00100000:0.0:1787893017.790290:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493316992 00000100:00100000:0.0:1787893017.790301:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493316096 00000100:00100000:0.0:1787893017.790303:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493316096 00000100:00100000:0.0:1787893017.790311:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493316608 00000100:00100000:0.0:1787893017.790313:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493316608 00000100:00100000:0.0:1787893017.790324:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493317120 00000100:00100000:0.0:1787893017.790326:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493317120 00000100:00100000:0.0:1787893017.790351:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787893017.790357:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493316480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893017.790386:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493316480:12345-0@lo:400:kworker.0 Request processed in 30us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893017.790392:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787893017.790402:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787893017.790407:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1874741493316992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893017.790431:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1874741493316992:12345-0@lo:400:kworker.0 Request processed in 23us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893017.790436:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787893017.790446:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787893017.790452:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493316096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893017.790476:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493316096:12345-0@lo:400:kworker.0 Request processed in 25us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893017.790482:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787893017.790530:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787893017.790537:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c71b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493316608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893017.790564:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c71b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493316608:12345-0@lo:400:kworker.0 Request processed in 28us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893017.790570:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787893017.790580:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787893017.790586:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c71b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493317120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893017.790612:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c71b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493317120:12345-0@lo:400:kworker.0 Request processed in 27us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893017.790618:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787893017.790681:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed562680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493316096:0@lo:400:kworker.0 00010000:00080000:0.0:1787893017.790694:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e7203b80 x1874741493316608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893017.790701:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7203b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493316608:0@lo:400:kworker.0 00010000:00080000:0.0:1787893017.790709:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9c3e6ca80 x1874741493317120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893017.790716:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493317120:0@lo:400:kworker.0 00000100:00100000:0.0:1787893017.790723:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493315968:0@lo:400:kworker.0 00000100:00100000:0.0:1787893017.790731:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7203100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493316480:0@lo:400:kworker.0 00000100:00100000:0.0:1787893017.790738:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1874741493316992:0@lo:400:kworker.0 00000100:00100000:3.0:1787893017.791456:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874741493316224:0@lo:400:kworker.0 00000100:00100000:3.0:1787893017.791543:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893017.791572:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7201f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493316736:0@lo:400:kworker.0 00000100:00100000:3.0:1787893017.791600:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893017.791628:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787893017.791636:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed563b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493316352:0@lo:400:kworker.0 00000100:00100000:3.0:1787893017.791661:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893017.791681:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7200380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493316864:0@lo:400:kworker.0 00000100:00100000:3.0:1787893017.791702:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893017.791737:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493316224 00000100:00100000:3.0:1787893017.791744:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493316224 00000100:00100000:3.0:1787893017.791785:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787893017.791793:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874741493316224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893017.791832:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874741493316224:12345-0@lo:400:kworker.0 Request processed in 40us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893017.791839:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:3.0:1787893017.791858:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787893017.791863:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787893017.791874:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493316352 00000100:00100000:3.0:1787893017.791878:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493316352 00000100:00100000:3.0:1787893017.791905:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787893017.791911:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493316352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893017.791943:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493316352:12345-0@lo:400:kworker.0 Request processed in 33us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893017.792076:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493316736 00000100:00100000:1.0:1787893017.792081:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493316736 00000100:00100000:1.0:1787893017.792115:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493316864 00000100:00100000:1.0:1787893017.792118:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493316864 00000100:00100000:1.0:1787893017.792138:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787893017.792145:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493316736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893017.792180:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493316736:12345-0@lo:400:kworker.0 Request processed in 35us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893017.792185:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787893017.792199:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787893017.792213:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493316864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893017.792240:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493316864:12345-0@lo:400:kworker.0 Request processed in 29us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893017.792246:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787893017.792286:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787893017.792328:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed563b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493316352:0@lo:400:kworker.0 00010000:00080000:3.0:1787893017.792341:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e7200380 x1874741493316864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893017.792355:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7200380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493316864:0@lo:400:kworker.0 00000100:00100000:3.0:1787893017.792367:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874741493316224:0@lo:400:kworker.0 00010000:00080000:3.0:1787893017.792376:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e7201f80 x1874741493316736/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893017.792383:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7201f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493316736:0@lo:400:kworker.0 00000100:00080000:3.0:1787893017.792408:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787893018.291400:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893019.316746:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893019.827946:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787893019.827972:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493317248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787893019.828070:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893019.828149:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493317248 00000100:00100000:3.0:1787893019.828159:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493317248 00000100:00100000:3.0:1787893019.828220:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787893019.828232:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493317248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787893019.828261:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787893019.828308:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493317248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893019.828315:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1787893019.828335:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787893019.828366:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb4aa00 x1874741493317248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893035 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893019.828385:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493317248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787893019.828999:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787893019.829013:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7114000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493317376:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787893019.829067:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893019.831171:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493317376 00000100:00100000:3.0:1787893019.831185:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493317376 00000100:00100000:3.0:1787893019.831250:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787893019.831269:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493317376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787893019.831297:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787893019.831384:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493317376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (2316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893019.831391:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1787893019.831412:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787893019.831447:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e7114000 x1874741493317376/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893035 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893019.831466:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7114000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493317376:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787893020.338484:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893021.224284:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893021.224355:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893021.224450:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893021.224537:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481712000 00000100:00100000:0.0:1787893021.224547:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481712000 00000100:00100000:0.0:1787893021.224614:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481711872 00000100:00100000:0.0:1787893021.224616:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481711872 00000100:00100000:0.0:1787893021.224633:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 115 00000100:00100000:0.0:1787893021.224640:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+5:2392:x1874741481712000:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893021.224700:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+5:2392:x1874741481712000:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 61us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893021.224705:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 115 00000100:00100000:0.0:1787893021.224716:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 116 00000100:00100000:0.0:1787893021.224720:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+6:2393:x1874741481711872:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893021.224735:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+6:2393:x1874741481711872:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 16us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893021.224745:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 116 00000100:00100000:3.0:1787893021.224868:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481711744 00000100:00100000:3.0:1787893021.224883:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481711744 00000100:00100000:3.0:1787893021.224957:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 285 00000100:00100000:3.0:1787893021.224969:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:2392:x1874741481711744:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893021.225335:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:2392:x1874741481711744:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 367us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893021.225343:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 285 00000100:00080000:2.0:1787893021.226057:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787893021.226066:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787893021.362862:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893021.362913:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7e04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493317504:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787893021.362984:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893021.363155:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493317504 00000100:00100000:2.0:1787893021.363164:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493317504 00000100:00100000:2.0:1787893021.363214:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787893021.363224:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c71b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493317504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787893021.363258:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787893021.363312:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c71b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493317504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893021.363319:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787893021.363419:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7e04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493317504:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787893022.386474:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7e04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493317632:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787893022.386568:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893022.386705:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493317632 00000100:00100000:3.0:1787893022.386713:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493317632 00000100:00100000:3.0:1787893022.386777:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787893022.386788:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c71b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493317632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787893022.386825:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00010000:00010000:1.0:1787893022.390708:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893022.394820:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c71b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493317632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 8021us (8239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893022.394836:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787893022.396597:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7e04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493317632:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787893022.897755:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7201f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1874741493317888:0@lo:400:kworker.0 00000100:00100000:0.0:1787893022.897827:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893022.897876:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7203b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1874741493318400:0@lo:400:kworker.0 00000100:00100000:0.0:1787893022.897899:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893022.897916:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed562680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1874741493318912:0@lo:400:kworker.0 00000100:00100000:0.0:1787893022.897937:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893022.897966:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787893022.897972:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493317760:0@lo:400:kworker.0 00000100:00100000:0.0:1787893022.898013:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893022.898035:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7203100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1874741493318272:0@lo:400:kworker.0 00000100:00100000:0.0:1787893022.898056:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893022.898071:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1874741493318784:0@lo:400:kworker.0 00000100:00100000:0.0:1787893022.898089:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893022.898132:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7200380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493318016:0@lo:400:kworker.0 00000100:00100000:0.0:1787893022.898156:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893022.898180:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493318528:0@lo:400:kworker.0 00000100:00100000:0.0:1787893022.898204:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893022.898224:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7788700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493319040:0@lo:400:kworker.0 00000100:00100000:0.0:1787893022.898244:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893022.898263:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787893022.898268:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493318144:0@lo:400:kworker.0 00000100:00100000:0.0:1787893022.898528:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893022.898550:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed563b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493318656:0@lo:400:kworker.0 00000100:00100000:0.0:1787893022.898573:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893022.898589:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7789880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493319168:0@lo:400:kworker.0 00000100:00100000:0.0:1787893022.898609:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893022.898641:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493317888 00000100:00100000:0.0:1787893022.898648:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493317888 00000100:00100000:0.0:1787893022.898688:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493318400 00000100:00100000:0.0:1787893022.898691:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493318400 00000100:00100000:0.0:1787893022.898725:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493318912 00000100:00100000:0.0:1787893022.898728:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493318912 00000100:00100000:0.0:1787893022.898740:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493318272 00000100:00100000:0.0:1787893022.898743:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493318272 00000100:00100000:0.0:1787893022.898753:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493318784 00000100:00100000:0.0:1787893022.898756:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493318784 00000100:00100000:0.0:1787893022.898767:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493318016 00000100:00100000:0.0:1787893022.898769:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493318016 00000100:00100000:0.0:1787893022.898781:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787893022.898789:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c778a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1874741493317888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893022.898844:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c778a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1874741493317888:12345-0@lo:400:kworker.0 Request processed in 55us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893022.898852:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787893022.898878:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787893022.898884:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c778a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1874741493318400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893022.898915:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c778a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1874741493318400:12345-0@lo:400:kworker.0 Request processed in 32us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893022.898921:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787893022.898933:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787893022.898939:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7789f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1874741493318912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893022.898966:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7789f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1874741493318912:12345-0@lo:400:kworker.0 Request processed in 27us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893022.898971:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787893022.898983:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787893022.898989:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3631:x1874741493318272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893022.899030:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3631:x1874741493318272:12345-0@lo:400:kworker.0 Request processed in 41us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893022.899036:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787893022.899049:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787893022.899055:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1874741493318784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893022.899082:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1874741493318784:12345-0@lo:400:kworker.0 Request processed in 27us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893022.899088:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787893022.899099:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787893022.899699:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493318016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893022.899743:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493318016:12345-0@lo:400:kworker.0 Request processed in 638us (1585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893022.899750:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787893022.899791:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493317760 00000100:00100000:0.0:1787893022.899796:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493317760 00000100:00100000:0.0:1787893022.899895:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787893022.899902:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+24:3631:x1874741493317760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893022.899934:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+24:3631:x1874741493317760:12345-0@lo:400:kworker.0 Request processed in 33us (1921us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893022.899943:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787893022.899982:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493318528 00000100:00100000:0.0:1787893022.899985:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493318528 00000100:00100000:0.0:1787893022.900016:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493319040 00000100:00100000:0.0:1787893022.900019:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493319040 00000100:00100000:0.0:1787893022.900030:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493318656 00000100:00100000:0.0:1787893022.900032:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493318656 00000100:00100000:0.0:1787893022.900043:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493319168 00000100:00100000:0.0:1787893022.900045:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493319168 00000100:00100000:0.0:1787893022.900055:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787893022.900061:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493318528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893022.900093:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493318528:12345-0@lo:400:kworker.0 Request processed in 32us (1888us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893022.900098:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787893022.900336:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787893022.900345:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493319040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893022.900388:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493319040:12345-0@lo:400:kworker.0 Request processed in 45us (2143us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893022.900395:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787893022.900407:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787893022.900413:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493318656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893022.900440:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493318656:12345-0@lo:400:kworker.0 Request processed in 27us (1866us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893022.900445:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787893022.900469:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787893022.900475:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493319168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893022.900524:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493319168:12345-0@lo:400:kworker.0 Request processed in 49us (1914us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893022.900530:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787893022.900595:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493319296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787893022.900626:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893022.900650:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787893022.900656:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493319424:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787893022.900676:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893022.900699:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493319296 00000100:00100000:3.0:1787893022.900703:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493319296 00000100:00100000:3.0:1787893022.900725:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493319424 00000100:00100000:3.0:1787893022.900727:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493319424 00000100:00100000:3.0:1787893022.900739:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787893022.900744:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493319296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787893022.900764:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787893022.900796:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493319296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893022.900823:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787893022.900836:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787893022.900842:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493319424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787893022.900852:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787893022.900875:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493319424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 34us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893022.900880:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1787893022.900935:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb4bb80 x1874741493319424/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893038 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893022.900953:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493319424:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1787893022.900963:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb4aa00 x1874741493319296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893038 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893022.900972:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493319296:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787893022.901023:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787893022.901028:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787893022.901031:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787893022.901034:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787893022.901605:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493318144 00000100:00100000:0.0:1787893022.901612:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493318144 00000100:00100000:0.0:1787893022.901663:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787893022.901670:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493318144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893022.901720:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493318144:12345-0@lo:400:kworker.0 Request processed in 50us (3192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893022.901725:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787893022.901784:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493318144:0@lo:400:kworker.0 00010000:00080000:0.0:1787893022.903570:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ed563b80 x1874741493318656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893022.903587:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed563b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493318656:0@lo:400:kworker.0 00010000:00080000:0.0:1787893022.903602:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7789880 x1874741493319168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893022.903611:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7789880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493319168:0@lo:400:kworker.0 00000100:00100000:0.0:1787893022.903625:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7200380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493318016:0@lo:400:kworker.0 00010000:00080000:0.0:1787893022.903636:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ed560700 x1874741493318528/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893022.903645:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493318528:0@lo:400:kworker.0 00010000:00080000:0.0:1787893022.903656:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7788700 x1874741493319040/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893022.903664:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7788700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493319040:0@lo:400:kworker.0 00000100:00100000:0.0:1787893022.903731:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493317760:0@lo:400:kworker.0 00000100:00100000:0.0:1787893022.903745:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7203100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1874741493318272:0@lo:400:kworker.0 00000100:00100000:0.0:1787893022.903756:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1874741493318784:0@lo:400:kworker.0 00000100:00100000:0.0:1787893022.903769:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7201f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1874741493317888:0@lo:400:kworker.0 00010000:00080000:0.0:1787893022.903780:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e7203b80 x1874741493318400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893022.903789:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7203b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1874741493318400:0@lo:400:kworker.0 00010000:00080000:0.0:1787893022.903822:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ed562680 x1874741493318912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893022.903831:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed562680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1874741493318912:0@lo:400:kworker.0 00010000:00010000:2.0:1787893023.410581:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893024.443479:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893024.945749:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787893024.945773:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493319552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787893024.945845:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893024.945968:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493319552 00000100:00100000:3.0:1787893024.945986:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493319552 00000100:00100000:3.0:1787893024.946050:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787893024.946061:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493319552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787893024.946090:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787893024.946136:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493319552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893024.946143:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1787893024.946200:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb4aa00 x1874741493319552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893040 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893024.946219:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493319552:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787893024.946285:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787893024.947726:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787893024.947742:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493319680:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787893024.947794:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893024.947913:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493319680 00000100:00100000:1.0:1787893024.947920:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493319680 00000100:00100000:1.0:1787893024.947990:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787893024.948001:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493319680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787893024.948021:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787893024.948067:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493319680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893024.948074:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1787893024.948111:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e7117480 x1874741493319680/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893040 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893024.948126:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493319680:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787893024.948215:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787893025.460243:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893026.330119:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893026.330167:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893026.330239:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893026.330334:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481712128 00000100:00100000:0.0:1787893026.330344:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481712128 00000100:00100000:2.0:1787893026.330401:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481712256 00000100:00100000:2.0:1787893026.330406:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481712256 00000100:00100000:0.0:1787893026.337015:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 287 00000100:00100000:0.0:1787893026.337039:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:2393:x1874741481712128:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893026.337126:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:2393:x1874741481712128:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 98us (7017us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893026.337134:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 287 00000100:00100000:2.0:1787893026.337433:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481712384 00000100:00100000:2.0:1787893026.337447:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481712384 00000100:00100000:0.0:1787893026.340141:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 123 00000100:00100000:0.0:1787893026.340175:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+6:2393:x1874741481712256:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893026.340248:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+6:2393:x1874741481712256:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 80us (10080us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893026.340257:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 123 00000100:00100000:0.0:1787893026.340282:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 124 00000100:00100000:0.0:1787893026.340290:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+5:2392:x1874741481712384:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893026.340315:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+5:2392:x1874741481712384:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 27us (10076us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893026.340322:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 124 00000100:00080000:2.0:1787893026.349236:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787893026.349246:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787893026.481609:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893026.486697:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493319808:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787893026.486772:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893026.486855:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493319808 00000100:00100000:1.0:1787893026.486864:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493319808 00000100:00100000:1.0:1787893026.486919:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787893026.486930:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493319808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787893026.486975:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787893026.487040:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493319808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893026.487047:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787893026.487199:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493319808:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787893027.505708:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893027.505825:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493319936:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787893027.505891:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893027.506033:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493319936 00000100:00100000:2.0:1787893027.506041:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493319936 00000100:00100000:2.0:1787893027.506101:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787893027.506111:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493319936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787893027.506144:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787893027.506198:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493319936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893027.506206:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787893027.506450:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493319936:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787893028.019667:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874741493320192:0@lo:400:kworker.0 00000100:00100000:2.0:1787893028.019766:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893028.019832:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1874741493320704:0@lo:400:kworker.0 00000100:00100000:2.0:1787893028.020422:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893028.020449:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1874741493321216:0@lo:400:kworker.0 00000100:00100000:2.0:1787893028.020474:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893028.020544:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787893028.020551:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7e04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493320064:0@lo:400:kworker.0 00000100:00100000:2.0:1787893028.020587:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893028.020632:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1874741493320576:0@lo:400:kworker.0 00000100:00100000:2.0:1787893028.020657:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893028.020673:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1874741493321088:0@lo:400:kworker.0 00000100:00100000:2.0:1787893028.020695:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893028.020756:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874741493320320:0@lo:400:kworker.0 00000100:00100000:2.0:1787893028.020784:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893028.020797:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493320832:0@lo:400:kworker.0 00000100:00100000:2.0:1787893028.020823:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893028.021758:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493320192 00000100:00100000:1.0:1787893028.021785:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493320192 00000100:00100000:1.0:1787893028.021858:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493320704 00000100:00100000:1.0:1787893028.021862:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493320704 00000100:00100000:1.0:1787893028.021893:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493321216 00000100:00100000:1.0:1787893028.021896:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493321216 00000100:00100000:1.0:1787893028.021910:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493320576 00000100:00100000:1.0:1787893028.021913:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493320576 00000100:00100000:1.0:1787893028.021924:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493321088 00000100:00100000:1.0:1787893028.021927:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493321088 00000100:00100000:1.0:1787893028.021937:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493320320 00000100:00100000:1.0:1787893028.021940:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493320320 00000100:00100000:1.0:1787893028.021967:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787893028.021979:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7db0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1874741493320192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893028.022104:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7db0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1874741493320192:12345-0@lo:400:kworker.0 Request processed in 127us (2337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893028.022242:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787893028.022266:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787893028.022273:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7db0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1874741493320704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893028.022321:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7db0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1874741493320704:12345-0@lo:400:kworker.0 Request processed in 49us (1899us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893028.022327:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787893028.022339:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787893028.022345:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1874741493321216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893028.022374:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1874741493321216:12345-0@lo:400:kworker.0 Request processed in 29us (1899us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893028.022381:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787893028.022393:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787893028.022399:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1874741493320576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893028.022891:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1874741493320576:12345-0@lo:400:kworker.0 Request processed in 492us (2233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893028.022898:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787893028.022914:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787893028.022921:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1874741493321088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893028.022962:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1874741493321088:12345-0@lo:400:kworker.0 Request processed in 43us (2266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893028.022968:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787893028.022982:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787893028.022990:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874741493320320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893028.023019:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874741493320320:12345-0@lo:400:kworker.0 Request processed in 31us (2234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893028.023042:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787893028.023571:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493320448:0@lo:400:kworker.0 00000100:00100000:0.0:1787893028.023633:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893028.023676:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493320960:0@lo:400:kworker.0 00000100:00100000:0.0:1787893028.023730:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493320064 00000100:00100000:0.0:1787893028.023740:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493320064 00000100:00100000:0.0:1787893028.023789:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1787893028.023797:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+24:3633:x1874741493320064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893028.023841:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+24:3633:x1874741493320064:12345-0@lo:400:kworker.0 Request processed in 44us (3253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893028.023848:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1787893028.023887:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493320448 00000100:00100000:0.0:1787893028.023891:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493320448 00000100:00100000:0.0:1787893028.023921:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787893028.023928:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493320448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893028.023977:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493320448:12345-0@lo:400:kworker.0 Request processed in 49us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893028.023984:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787893028.024708:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493321344:0@lo:400:kworker.0 00000100:00100000:2.0:1787893028.024750:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893028.024803:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874741493320320:0@lo:400:kworker.0 00000100:00080000:2.0:1787893028.024854:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787893028.024860:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787893028.024882:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7e04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493320064:0@lo:400:kworker.0 00000100:00100000:2.0:1787893028.024898:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1874741493320576:0@lo:400:kworker.0 00000100:00100000:2.0:1787893028.024909:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1874741493321088:0@lo:400:kworker.0 00000100:00100000:2.0:1787893028.024921:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874741493320192:0@lo:400:kworker.0 00010000:00080000:2.0:1787893028.024939:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7db0a80 x1874741493320704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893028.024960:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1874741493320704:0@lo:400:kworker.0 00010000:00080000:2.0:1787893028.024974:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7db0000 x1874741493321216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893028.024983:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1874741493321216:0@lo:400:kworker.0 00000100:00100000:0.0:1787893028.026984:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493320832 00000100:00100000:0.0:1787893028.027003:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493320832 00000100:00100000:0.0:1787893028.027115:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493321344 00000100:00100000:0.0:1787893028.027120:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493321344 00000100:00100000:0.0:1787893028.027156:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787893028.027170:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493320832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893028.027303:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493320832:12345-0@lo:400:kworker.0 Request processed in 137us (6477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893028.027328:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787893028.027349:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787893028.027355:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493321344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893028.027390:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493321344:12345-0@lo:400:kworker.0 Request processed in 35us (2639us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893028.027396:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1787893028.027702:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787893028.027707:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787893028.027749:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893028.027794:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493321472:0@lo:400:kworker.0 00000100:00100000:0.0:1787893028.027832:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893028.028163:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493320960 00000100:00100000:2.0:1787893028.028171:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493320960 00000100:00100000:2.0:1787893028.028217:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493321472 00000100:00100000:2.0:1787893028.028220:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493321472 00000100:00100000:2.0:1787893028.028254:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787893028.028261:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493320960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893028.028321:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493320960:12345-0@lo:400:kworker.0 Request processed in 60us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893028.028328:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787893028.028344:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787893028.028351:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493321472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893028.028380:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493321472:12345-0@lo:400:kworker.0 Request processed in 31us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893028.028385:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1787893028.028990:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7db2680 x1874741493321472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893028.029010:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493321472:0@lo:400:kworker.0 00000100:00100000:0.0:1787893028.029534:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493320448:0@lo:400:kworker.0 00010000:00080000:0.0:1787893028.029551:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7db3100 x1874741493320960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893028.029561:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493320960:0@lo:400:kworker.0 00000100:00080000:0.0:1787893028.029602:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787893028.029607:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787893028.029653:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7db2300 x1874741493320832/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893028.029666:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493320832:0@lo:400:kworker.0 00010000:00080000:0.0:1787893028.029680:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7db1f80 x1874741493321344/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893028.029703:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493321344:0@lo:400:kworker.0 00000100:00100000:1.0:1787893028.033956:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493321600:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787893028.034074:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893028.034171:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493321600 00000100:00100000:1.0:1787893028.034181:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493321600 00000100:00100000:1.0:1787893028.034245:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787893028.034256:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7114a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493321600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787893028.034305:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787893028.034360:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7114a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493321600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893028.034367:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787893028.036019:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493321728:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1787893028.036150:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e7117480 x1874741493321600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893044 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893028.036201:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493321600:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787893028.043812:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893028.050595:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493321728 00000100:00100000:1.0:1787893028.050619:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493321728 00000100:00100000:1.0:1787893028.052406:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787893028.052442:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493321728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787893028.052476:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787893028.052597:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493321728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 167us (8798us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893028.052605:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1787893028.055638:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c67a9f80 x1874741493321728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893044 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893028.055674:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493321728:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787893028.531227:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893029.554818:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893030.066074:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787893030.066115:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493321856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787893030.066222:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893030.066477:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787893030.066522:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493321984:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787893030.066594:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493321856 00000100:00100000:3.0:1787893030.066597:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893030.066610:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493321856 00000100:00080000:1.0:1787893030.066787:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787893030.067061:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493321984 00000100:00100000:2.0:1787893030.067070:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493321984 00000100:00100000:2.0:1787893030.067201:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787893030.067211:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7117480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493321856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787893030.067244:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787893030.067303:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7117480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493321856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893030.067311:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787893030.067341:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787893030.067348:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493321984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787893030.067360:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787893030.067392:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493321984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893030.067415:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1787893030.067456:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c67a9f80 x1874741493321984/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893046 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893030.067477:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493321984:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1787893030.067553:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb4bb80 x1874741493321856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893046 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893030.067567:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493321856:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787893030.070426:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787893030.577746:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893031.450107:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893031.450176:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893031.450219:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893031.450290:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481712640 00000100:00100000:3.0:1787893031.450304:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481712640 00000100:00100000:0.0:1787893031.450343:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481712512 00000100:00100000:0.0:1787893031.450350:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481712512 00000100:00100000:3.0:1787893031.450414:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481712768 00000100:00100000:3.0:1787893031.450420:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481712768 00000100:00100000:0.0:1787893031.450421:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 289 00000100:00100000:0.0:1787893031.450442:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:2393:x1874741481712512:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893031.450467:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 131 00000100:00100000:3.0:1787893031.450480:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+6:2393:x1874741481712640:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893031.450617:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 132 00000100:00100000:1.0:1787893031.450626:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+5:2393:x1874741481712768:12345-192.168.202.35@tcp:400:kworker.0 00000100:00080000:2.0:1787893031.450690:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787893031.450697:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:2393:x1874741481712512:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 262us (519us total) trans 0 rc 0/0 00000100:00080000:2.0:1787893031.450698:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787893031.450707:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 289 00000100:00100000:1.0:1787893031.458374:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+5:2393:x1874741481712768:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 7734us (8139us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893031.458376:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+6:2393:x1874741481712640:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 7878us (8277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893031.458396:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 131 00000100:00100000:1.0:1787893031.458448:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 132 00010000:00010000:1.0:1787893031.602124:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893031.617793:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7e04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493322112:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787893031.617907:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893031.619433:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493322112 00000100:00100000:2.0:1787893031.619448:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493322112 00000100:00100000:2.0:1787893031.619562:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787893031.619573:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493322112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787893031.619623:0:7865:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787893031.619718:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493322112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 146us (1811us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893031.619725:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787893031.619958:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7e04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493322112:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787893032.630736:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893032.630793:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7e04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493322240:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787893032.630865:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893032.631003:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493322240 00000100:00100000:2.0:1787893032.631011:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493322240 00000100:00100000:2.0:1787893032.631061:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787893032.631071:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493322240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787893032.631116:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787893032.631168:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493322240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893032.631175:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787893032.631216:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7e04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493322240:0@lo:41:osp-pre-0-1.0 00000001:02000400:1.0:1787893032.655804:0:11982:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 00:57:11 (1787893031) === 00000100:00100000:2.0:1787893033.137994:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787893033.138024:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7e04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493322368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787893033.138106:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893033.138263:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493322368 00000100:00100000:0.0:1787893033.138273:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493322368 00000100:00100000:3.0:1787893033.138560:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874741493322752:0@lo:400:kworker.0 00000100:00100000:3.0:1787893033.138593:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893033.138614:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1874741493323264:0@lo:400:kworker.0 00000100:00100000:3.0:1787893033.138635:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893033.138650:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1874741493323776:0@lo:400:kworker.0 00000100:00100000:3.0:1787893033.138680:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893033.138699:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787893033.138705:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493322624:0@lo:400:kworker.0 00000100:00100000:3.0:1787893033.138734:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893033.138756:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1874741493323136:0@lo:400:kworker.0 00000100:00100000:3.0:1787893033.138775:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893033.138788:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1874741493323648:0@lo:400:kworker.0 00000100:00100000:3.0:1787893033.138804:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893033.138827:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493322752 00000100:00100000:3.0:1787893033.138832:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493322752 00000100:00100000:3.0:1787893033.138857:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493323264 00000100:00100000:3.0:1787893033.138860:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493323264 00000100:00100000:3.0:1787893033.138874:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493323776 00000100:00100000:3.0:1787893033.138876:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493323776 00000100:00100000:3.0:1787893033.138886:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493323136 00000100:00100000:3.0:1787893033.138888:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493323136 00000100:00100000:3.0:1787893033.138914:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493323648 00000100:00100000:3.0:1787893033.138917:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493323648 00000100:00100000:3.0:1787893033.138932:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787893033.138940:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1874741493322752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893033.138992:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1874741493322752:12345-0@lo:400:kworker.0 Request processed in 53us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893033.138999:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787893033.139015:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787893033.139021:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1874741493323264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893033.139049:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1874741493323264:12345-0@lo:400:kworker.0 Request processed in 29us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893033.139063:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787893033.139076:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787893033.139081:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1874741493323776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893033.139109:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1874741493323776:12345-0@lo:400:kworker.0 Request processed in 28us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893033.139115:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787893033.139125:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787893033.139130:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1874741493323136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893033.139153:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1874741493323136:12345-0@lo:400:kworker.0 Request processed in 23us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893033.139159:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787893033.139283:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874741493322880:0@lo:400:kworker.0 00000100:00100000:1.0:1787893033.139319:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893033.139332:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493323392:0@lo:400:kworker.0 00000100:00100000:1.0:1787893033.139354:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893033.139370:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493323904:0@lo:400:kworker.0 00000100:00100000:1.0:1787893033.139388:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893033.139409:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787893033.139415:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493322496:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787893033.139434:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893033.139454:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787893033.139464:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1874741493323648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893033.139512:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1874741493323648:12345-0@lo:400:kworker.0 Request processed in 50us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893033.139518:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787893033.139530:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493322880 00000100:00100000:3.0:1787893033.139534:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493322880 00000100:00100000:3.0:1787893033.139551:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787893033.139556:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7116d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874741493322880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893033.139583:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7116d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874741493322880:12345-0@lo:400:kworker.0 Request processed in 26us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893033.139588:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787893033.139629:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1874741493323136:0@lo:400:kworker.0 00000100:00100000:3.0:1787893033.139652:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1874741493323648:0@lo:400:kworker.0 00000100:00100000:3.0:1787893033.139661:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874741493322752:0@lo:400:kworker.0 00010000:00080000:3.0:1787893033.139672:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb4bb80 x1874741493323264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893033.139681:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1874741493323264:0@lo:400:kworker.0 00010000:00080000:3.0:1787893033.139691:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb9fb80 x1874741493323776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893033.139699:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1874741493323776:0@lo:400:kworker.0 00000100:00100000:3.0:1787893033.139749:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493322624 00000100:00100000:3.0:1787893033.139753:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493322624 00000100:00100000:3.0:1787893033.139779:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1787893033.139786:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+24:3633:x1874741493322624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893033.139821:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+24:3633:x1874741493322624:12345-0@lo:400:kworker.0 Request processed in 36us (1087us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893033.139828:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00080000:3.0:1787893033.139858:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787893033.139862:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787893033.139865:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787893033.139879:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493322624:0@lo:400:kworker.0 00000100:00100000:3.0:1787893033.139921:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493323392 00000100:00100000:3.0:1787893033.139925:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493323392 00000100:00100000:3.0:1787893033.139953:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493323904 00000100:00100000:3.0:1787893033.139956:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493323904 00000100:00100000:3.0:1787893033.139973:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787893033.139979:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7115180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493323392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893033.140015:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7115180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493323392:12345-0@lo:400:kworker.0 Request processed in 36us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893033.140021:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787893033.140032:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787893033.140038:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7114700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493323904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893033.140063:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7114700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493323904:12345-0@lo:400:kworker.0 Request processed in 26us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893033.140069:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1787893033.140090:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787893033.140093:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787893033.146833:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493323008:0@lo:400:kworker.0 00000100:00100000:1.0:1787893033.146894:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893033.146930:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493323520:0@lo:400:kworker.0 00000100:00100000:1.0:1787893033.146954:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893033.146996:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874741493322880:0@lo:400:kworker.0 00010000:00080000:1.0:1787893033.147011:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb9c700 x1874741493323392/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893033.147023:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493323392:0@lo:400:kworker.0 00010000:00080000:1.0:1787893033.147033:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb9f800 x1874741493323904/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893033.147041:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493323904:0@lo:400:kworker.0 00000100:00100000:1.0:1787893033.147086:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493323008 00000100:00100000:1.0:1787893033.147092:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493323008 00000100:00100000:1.0:1787893033.147142:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787893033.147150:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7115500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493323008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893033.147232:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7115500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493323008:12345-0@lo:400:kworker.0 Request processed in 82us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893033.147240:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787893033.147276:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493323520 00000100:00100000:1.0:1787893033.147280:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493323520 00000100:00100000:1.0:1787893033.147317:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787893033.147323:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7117b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493323520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893033.147364:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7117b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493323520:12345-0@lo:400:kworker.0 Request processed in 30us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893033.147371:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1787893033.147398:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787893033.147417:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493323008:0@lo:400:kworker.0 00010000:00080000:1.0:1787893033.147426:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb9ea00 x1874741493323520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893033.147435:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493323520:0@lo:400:kworker.0 00000100:00100000:0.0:1787893033.148844:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493322496 00000100:00100000:0.0:1787893033.148856:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493322496 00000100:00100000:0.0:1787893033.148908:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787893033.148918:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7db1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493322368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787893033.148946:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787893033.149015:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7db1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493322368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (10908us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893033.149031:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787893033.149057:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787893033.149063:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7116a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493322496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787893033.149072:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787893033.154838:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7116a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493322496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5764us (15391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893033.154854:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:0.0:1787893033.154935:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb48e00 x1874741493322496/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893049 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893033.154959:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493322496:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1787893033.155676:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7e04000 x1874741493322368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893049 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893033.155696:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7e04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493322368:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787893033.649689:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893033.658052:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893033.658148:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481712896 00000100:00100000:2.0:1787893033.658158:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481712896 00000100:00100000:2.0:1787893033.658238:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 291 00000100:00100000:2.0:1787893033.658249:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:8724:x1874741481712896:12345-192.168.202.35@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787893033.658266:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893033.658292:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c771fc00/0x9232577658cf0cf4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa65a expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893033.658323:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c771fc00/0x9232577658cf0cf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa65a expref: 11 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893033.658334:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c771fc00/0x9232577658cf0cf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa65a expref: 11 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893033.658344:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c771fc00, rc 0) 00000100:00100000:2.0:1787893033.658410:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+11:8724:x1874741481712896:12345-192.168.202.35@tcp:101:mount.lustre.0 Request processed in 164us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893033.658417:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 291 00000100:00100000:0.0:1787893033.666616:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893033.666813:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481713024 00000100:00100000:3.0:1787893033.666824:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481713024 00000100:00100000:3.0:1787893033.666884:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 292 00000100:00100000:3.0:1787893033.666931:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+11:8724:x1874741481713024:12345-192.168.202.35@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787893033.667103:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+11:8724:x1874741481713024:12345-192.168.202.35@tcp:501:mount.lustre.0 Request processed in 208us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893033.667112:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 292 00000100:00100000:0.0:1787893033.678391:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893033.678582:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481713152 00000100:00100000:3.0:1787893033.678593:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481713152 00000100:00100000:3.0:1787893033.678649:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 293 00000100:00100000:3.0:1787893033.678659:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+11:8724:x1874741481713152:12345-192.168.202.35@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787893033.678814:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+11:8724:x1874741481713152:12345-192.168.202.35@tcp:503:mount.lustre.0 Request processed in 155us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893033.678822:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 293 00000100:00100000:0.0:1787893033.684731:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893033.685588:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481713280 00000100:00100000:2.0:1787893033.685601:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481713280 00000100:00100000:2.0:1787893033.685665:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 294 00000100:00100000:2.0:1787893033.685675:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+11:8728:x1874741481713280:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787893033.685839:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+11:8728:x1874741481713280:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 165us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893033.685846:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 294 00000100:00100000:2.0:1787893033.718627:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893033.718932:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481713408 00000100:00100000:0.0:1787893033.718943:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481713408 00000100:00100000:0.0:1787893033.719002:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 295 00000100:00100000:0.0:1787893033.719012:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+11:8728:x1874741481713408:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787893033.720481:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+11:8728:x1874741481713408:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 1461us (1856us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893033.720510:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 295 00000100:00100000:0.0:1787893033.736796:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893033.737129:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481713536 00000100:00100000:3.0:1787893033.737155:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481713536 00000100:00100000:3.0:1787893033.737239:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 296 00000100:00100000:3.0:1787893033.737250:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+11:8728:x1874741481713536:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787893033.737885:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+11:8728:x1874741481713536:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 634us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893033.737913:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 296 00000100:00100000:1.0:1787893033.754553:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893033.754649:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481713664 00000100:00100000:0.0:1787893033.754660:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481713664 00000100:00100000:0.0:1787893033.754719:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 297 00000100:00100000:0.0:1787893033.754728:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+11:8724:x1874741481713664:12345-192.168.202.35@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787893033.754760:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893033.754777:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9edb31800/0x9232577658cf0cfb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa68b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893033.754806:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9edb31800/0x9232577658cf0cfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa68b expref: 12 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893033.754817:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9edb31800/0x9232577658cf0cfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa68b expref: 12 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893033.754826:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb31800, rc 0) 00000100:00100000:0.0:1787893033.755267:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+12:8724:x1874741481713664:12345-192.168.202.35@tcp:101:mount.lustre.0 Request processed in 537us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893033.755275:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 297 00000100:00100000:0.0:1787893033.762963:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893033.763060:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481713792 00000100:00100000:2.0:1787893033.763070:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481713792 00000100:00100000:2.0:1787893033.763127:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 298 00000100:00100000:2.0:1787893033.763138:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+12:8724:x1874741481713792:12345-192.168.202.35@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787893033.763163:0:6499:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787893033.763184:0:6499:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787893033.763187:0:6499:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787893033.763190:0:6499:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787893033.763658:0:6499:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1787893033.763662:0:6499:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1787893033.776808:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+12:8724:x1874741481713792:12345-192.168.202.35@tcp:256:mount.lustre.0 Request processed in 13659us (13842us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893033.776823:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 298 00000100:00100000:1.0:1787893033.793245:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893033.793578:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481713920 00000100:00100000:0.0:1787893033.793588:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481713920 00000100:00100000:0.0:1787893033.793646:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 299 00000100:00100000:0.0:1787893033.793656:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+12:8724:x1874741481713920:12345-192.168.202.35@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787893033.793673:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893033.793692:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9edb31600/0x9232577658cf0d02 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa692 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893033.793719:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9edb31600/0x9232577658cf0d02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa692 expref: 13 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893033.793744:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9edb31600/0x9232577658cf0d02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa692 expref: 13 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893033.793754:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb31600, rc 0) 00000100:00100000:0.0:1787893033.793815:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:8724:x1874741481713920:12345-192.168.202.35@tcp:101:mount.lustre.0 Request processed in 160us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893033.793822:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 299 00000100:00100000:2.0:1787893033.797047:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893033.797153:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481714048 00000100:00100000:0.0:1787893033.797162:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481714048 00000100:00100000:0.0:1787893033.797268:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 300 00000100:00100000:0.0:1787893033.797280:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:8724:x1874741481714048:12345-192.168.202.35@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787893033.797458:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:8724:x1874741481714048:12345-192.168.202.35@tcp:501:mount.lustre.0 Request processed in 180us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893033.797467:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 300 00000100:00100000:2.0:1787893033.800108:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893033.800296:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481714176 00000100:00100000:3.0:1787893033.800306:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481714176 00000100:00100000:3.0:1787893033.800560:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 301 00000100:00100000:3.0:1787893033.800572:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:8724:x1874741481714176:12345-192.168.202.35@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787893033.800707:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:8724:x1874741481714176:12345-192.168.202.35@tcp:503:mount.lustre.0 Request processed in 137us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893033.800715:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 301 00000100:00100000:3.0:1787893033.805373:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893033.806538:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481714304 00000100:00100000:0.0:1787893033.806549:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481714304 00000100:00100000:0.0:1787893033.806600:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 302 00000100:00100000:0.0:1787893033.806609:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:8731:x1874741481714304:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787893033.806878:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:8731:x1874741481714304:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 268us (1519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893033.806886:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 302 00000100:00100000:3.0:1787893033.810586:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893033.810662:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481714432 00000100:00100000:0.0:1787893033.810673:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481714432 00000100:00100000:0.0:1787893033.810731:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 303 00000100:00100000:0.0:1787893033.810742:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:8731:x1874741481714432:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787893033.817077:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:8731:x1874741481714432:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 6323us (6488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893033.817093:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 303 00000100:00100000:3.0:1787893033.822847:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893033.822902:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893033.823036:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893033.823818:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893033.823855:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481714560 00000100:00100000:0.0:1787893033.823866:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481714560 00000100:00100000:2.0:1787893033.824016:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481714816 00000100:00100000:2.0:1787893033.824021:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481714816 00000100:00100000:1.0:1787893033.824157:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481715200 00000100:00100000:1.0:1787893033.824161:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481715200 00000100:00100000:1.0:1787893033.824215:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 139 00000100:00100000:1.0:1787893033.824225:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+6:2393:x1874741481715200:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893033.824302:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+6:2393:x1874741481715200:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 78us (1265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893033.824323:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 139 00000100:00100000:1.0:1787893033.824345:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 16 00000100:00100000:1.0:1787893033.824363:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2389:x1874741481714560:12345-192.168.202.35@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787893033.824386:0:6505:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 9c50492c-5fef-4e80-9bbb-0b2782d59443@192.168.202.35@tcp t0 exp 0000000000000000 cur 277 last 0 00000020:00000080:1.0:1787893033.824447:0:6505:0:(genops.c:1385:class_connect()) connect: client 9c50492c-5fef-4e80-9bbb-0b2782d59443, cookie 0x9232577658cf0d09 00000004:00100000:1.0:1787893033.824473:0:6505:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787893033.825817:0:6505:0:(import.c:65:import_set_state_nolock()) ffff9fc8c75fe800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787893033.825871:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c50492c-5fef-4e80-9bbb-0b2782d59443+6:2389:x1874741481714560:12345-192.168.202.35@tcp:38:mount.lustre.0 Request processed in 1505us (3033us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893033.825881:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 16 00000100:00100000:1.0:1787893033.825916:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481715328 00000100:00100000:1.0:1787893033.825922:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481715328 00000100:00100000:1.0:1787893033.825955:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 140 00000100:00100000:1.0:1787893033.825963:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+5:2393:x1874741481715328:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893033.826114:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+5:2393:x1874741481715328:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 151us (2298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893033.826122:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 140 00000100:00100000:1.0:1787893033.826138:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 17 00000100:00100000:1.0:1787893033.826143:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2389:x1874741481714816:12345-192.168.202.35@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787893033.826163:0:6505:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 9c50492c-5fef-4e80-9bbb-0b2782d59443@192.168.202.35@tcp t0 exp 0000000000000000 cur 277 last 0 00000020:00000080:1.0:1787893033.826190:0:6505:0:(genops.c:1385:class_connect()) connect: client 9c50492c-5fef-4e80-9bbb-0b2782d59443, cookie 0x9232577658cf0d10 00000004:00100000:1.0:1787893033.826208:0:6505:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787893033.826271:0:6505:0:(import.c:65:import_set_state_nolock()) ffff9fc8c75f9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787893033.826308:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c50492c-5fef-4e80-9bbb-0b2782d59443+6:2389:x1874741481714816:12345-192.168.202.35@tcp:38:mount.lustre.0 Request processed in 162us (3415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893033.826315:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 17 00000100:00080000:1.0:1787893033.826340:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787893033.826344:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787893033.832290:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893033.832330:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893033.832402:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893033.832837:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481715072 00000100:00100000:3.0:1787893033.832847:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481715072 00000100:00100000:3.0:1787893033.832928:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481714688 00000100:00100000:3.0:1787893033.832932:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481714688 00000100:00100000:3.0:1787893033.832949:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481714944 00000100:00100000:3.0:1787893033.832951:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481714944 00000100:00100000:3.0:1787893033.832969:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 18 00000100:00100000:3.0:1787893033.832978:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7db2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c50492c-5fef-4e80-9bbb-0b2782d59443+7:8724:x1874741481715072:12345-192.168.202.35@tcp:41:mount.lustre.0 00000100:00080000:2.0:1787893033.833080:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787893033.833084:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787893033.833098:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 19 00000100:00100000:2.0:1787893033.833121:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7db3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c50492c-5fef-4e80-9bbb-0b2782d59443+7:0:x1874741481714688:12345-192.168.202.35@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787893033.833158:0:6506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787893033.833240:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7db3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c50492c-5fef-4e80-9bbb-0b2782d59443+7:0:x1874741481714688:12345-192.168.202.35@tcp:41:mount.lustre.0 Request processed in 121us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893033.833246:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 19 00000100:00100000:2.0:1787893033.833263:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 20 00000100:00100000:2.0:1787893033.833269:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7db3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c50492c-5fef-4e80-9bbb-0b2782d59443+6:0:x1874741481714944:12345-192.168.202.35@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787893033.833283:0:6506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787893033.833317:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7db3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c50492c-5fef-4e80-9bbb-0b2782d59443+6:0:x1874741481714944:12345-192.168.202.35@tcp:41:mount.lustre.0 Request processed in 48us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893033.833322:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 20 00000004:00000024:3.0:1787893033.833811:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787893033.833841:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7db2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c50492c-5fef-4e80-9bbb-0b2782d59443+6:8724:x1874741481715072:12345-192.168.202.35@tcp:41:mount.lustre.0 Request processed in 863us (1560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893033.833847:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 18 00000100:00100000:1.0:1787893033.835848:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893033.836168:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481715456 00000100:00100000:2.0:1787893033.836251:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481715456 00000100:00100000:2.0:1787893033.836341:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 21 00000100:00100000:2.0:1787893033.836361:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7117800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c50492c-5fef-4e80-9bbb-0b2782d59443+6:8724:x1874741481715456:12345-192.168.202.35@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787893033.836608:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7117800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c50492c-5fef-4e80-9bbb-0b2782d59443+6:8724:x1874741481715456:12345-192.168.202.35@tcp:40:mount.lustre.0 Request processed in 257us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893033.836617:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 21 00000100:00100000:0.0:1787893033.843545:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893033.843861:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481715840 00000100:00100000:3.0:1787893033.843872:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481715840 00000100:00100000:3.0:1787893033.843951:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 5 00000100:00100000:3.0:1787893033.843963:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9c50492c-5fef-4e80-9bbb-0b2782d59443+6:8724:x1874741481715840:12345-192.168.202.35@tcp:900:mount.lustre.0 00000100:00100000:3.0:1787893033.844063:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9c50492c-5fef-4e80-9bbb-0b2782d59443+6:8724:x1874741481715840:12345-192.168.202.35@tcp:900:mount.lustre.0 Request processed in 102us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893033.844071:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 5 00000100:00100000:0.0:1787893033.855515:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893033.855563:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893033.855647:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893033.855820:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481715968 00000100:00100000:3.0:1787893033.855830:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481715968 00000100:00100000:3.0:1787893033.855909:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 1 00000100:00100000:3.0:1787893033.855920:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c50492c-5fef-4e80-9bbb-0b2782d59443+6:8724:x1874741481715968:12345-192.168.202.35@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787893033.856017:0:6507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787893033.856094:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c50492c-5fef-4e80-9bbb-0b2782d59443+6:8724:x1874741481715968:12345-192.168.202.35@tcp:33:mount.lustre.0 Request processed in 176us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893033.856102:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 1 00000100:00100000:2.0:1787893033.856417:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481715584 00000100:00100000:2.0:1787893033.856422:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481715584 00000100:00100000:2.0:1787893033.856463:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481715712 00000100:00100000:2.0:1787893033.856466:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481715712 00000100:00100000:2.0:1787893033.856512:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 20 00000100:00100000:2.0:1787893033.856519:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2389:x1874741481715584:12345-192.168.202.35@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787893033.856544:0:8535:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 9c50492c-5fef-4e80-9bbb-0b2782d59443@192.168.202.35@tcp t0 exp 0000000000000000 cur 277 last 0 00000020:00000080:2.0:1787893033.856583:0:8535:0:(genops.c:1385:class_connect()) connect: client 9c50492c-5fef-4e80-9bbb-0b2782d59443, cookie 0x9232577658cf0d17 00002000:00100000:2.0:1787893033.856594:0:8535:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9c50492c-5fef-4e80-9bbb-0b2782d59443/ffff9fc8c7760000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787893033.856611:0:8535:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787893033.856679:0:8535:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787893033.856706:0:8535:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7761800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787893033.856743:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c50492c-5fef-4e80-9bbb-0b2782d59443+6:2389:x1874741481715584:12345-192.168.202.35@tcp:8:mount.lustre.0 Request processed in 222us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893033.856750:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 20 00000100:00100000:2.0:1787893033.856766:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 21 00000100:00100000:2.0:1787893033.856770:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2389:x1874741481715712:12345-192.168.202.35@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787893033.856786:0:8535:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 9c50492c-5fef-4e80-9bbb-0b2782d59443@192.168.202.35@tcp t0 exp 0000000000000000 cur 277 last 0 00000020:00000080:2.0:1787893033.856803:0:8535:0:(genops.c:1385:class_connect()) connect: client 9c50492c-5fef-4e80-9bbb-0b2782d59443, cookie 0x9232577658cf0d1e 00002000:00100000:2.0:1787893033.856809:0:8535:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9c50492c-5fef-4e80-9bbb-0b2782d59443/ffff9fc8c7762800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787893033.856815:0:8535:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787893033.856850:0:8535:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787893033.856864:0:8535:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7764000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787893033.856885:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c50492c-5fef-4e80-9bbb-0b2782d59443+6:2389:x1874741481715712:12345-192.168.202.35@tcp:8:mount.lustre.0 Request processed in 114us (1238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893033.856910:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 21 00010000:00010000:1.0:1787893034.674833:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893035.188656:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787893035.188682:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493324032:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787893035.188759:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893035.189559:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493324032 00000100:00100000:1.0:1787893035.189568:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493324032 00000100:00100000:1.0:1787893035.189641:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787893035.189652:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493324032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787893035.189684:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787893035.189737:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493324032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893035.189744:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1787893035.189809:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787893035.189987:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e7115c00 x1874741493324032/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893051 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893035.190138:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493324032:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787893035.190738:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787893035.190751:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493324160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787893035.190808:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893035.190904:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493324160 00000100:00100000:3.0:1787893035.190911:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493324160 00000100:00100000:3.0:1787893035.190962:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787893035.190971:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7788700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493324160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787893035.190987:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787893035.191044:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7788700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493324160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893035.191064:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:3.0:1787893035.191096:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb9c000 x1874741493324160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893051 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893035.191111:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493324160:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787893035.191525:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787893035.699920:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893036.721655:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893036.722336:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787893036.722359:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493324288:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787893036.722423:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893036.722570:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493324288 00000100:00100000:0.0:1787893036.722579:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493324288 00000100:00100000:0.0:1787893036.722633:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787893036.722642:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493324288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787893036.722671:0:7865:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787893036.722721:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493324288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893036.722744:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787893036.722880:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493324288:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787893037.746260:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787893037.746284:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7114e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493324416:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787893037.746370:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893037.746442:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493324416 00000100:00100000:1.0:1787893037.746452:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493324416 00000100:00100000:1.0:1787893037.746529:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787893037.746538:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493324416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787893037.746571:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787893037.746617:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493324416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893037.746638:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787893037.746684:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7114e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493324416:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787893037.752083:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893038.257741:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874741493324928:0@lo:400:kworker.0 00000100:00100000:3.0:1787893038.257809:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893038.257875:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493325440:0@lo:400:kworker.0 00000100:00100000:3.0:1787893038.257903:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893038.257921:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493325952:0@lo:400:kworker.0 00000100:00100000:3.0:1787893038.257940:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893038.257968:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1787893038.257974:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493324544:0@lo:400:kworker.0 00000100:00100000:3.0:1787893038.258000:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893038.258018:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493325056:0@lo:400:kworker.0 00000100:00100000:3.0:1787893038.258043:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893038.258056:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493325568:0@lo:400:kworker.0 00000100:00100000:3.0:1787893038.258093:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893038.258108:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493326080:0@lo:400:kworker.0 00000100:00100000:3.0:1787893038.258128:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893038.258154:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493324672:0@lo:400:kworker.0 00000100:00100000:3.0:1787893038.258174:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893038.258200:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493325184:0@lo:400:kworker.0 00000100:00100000:3.0:1787893038.258237:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893038.258250:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1874741493325696:0@lo:400:kworker.0 00000100:00100000:3.0:1787893038.258266:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893038.258282:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787893038.258287:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493324800:0@lo:400:kworker.0 00000100:00100000:3.0:1787893038.258363:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893038.258379:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493325312:0@lo:400:kworker.0 00000100:00100000:3.0:1787893038.258399:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893038.258414:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493325824:0@lo:400:kworker.0 00000100:00100000:3.0:1787893038.258432:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893038.258460:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493324928 00000100:00100000:3.0:1787893038.258466:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493324928 00000100:00100000:3.0:1787893038.258528:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493324672 00000100:00100000:3.0:1787893038.258531:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493324672 00000100:00100000:3.0:1787893038.258542:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493325184 00000100:00100000:3.0:1787893038.258545:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493325184 00000100:00100000:3.0:1787893038.258564:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493325696 00000100:00100000:3.0:1787893038.258567:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493325696 00000100:00100000:3.0:1787893038.258576:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493325312 00000100:00100000:3.0:1787893038.258578:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493325312 00000100:00100000:3.0:1787893038.258587:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493325824 00000100:00100000:3.0:1787893038.258589:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493325824 00000100:00100000:3.0:1787893038.258602:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787893038.258609:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874741493324928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893038.258663:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874741493324928:12345-0@lo:400:kworker.0 Request processed in 52us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893038.258669:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787893038.258693:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787893038.258699:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493324672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893038.258730:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493324672:12345-0@lo:400:kworker.0 Request processed in 32us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893038.258735:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787893038.258744:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787893038.258749:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493325184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893038.258770:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493325184:12345-0@lo:400:kworker.0 Request processed in 22us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893038.258776:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787893038.258784:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787893038.258789:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1874741493325696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893038.258809:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1874741493325696:12345-0@lo:400:kworker.0 Request processed in 20us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893038.258814:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787893038.258822:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787893038.258828:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493325312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893038.258863:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493325312:12345-0@lo:400:kworker.0 Request processed in 23us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893038.258869:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787893038.258881:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787893038.258887:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493325824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893038.258912:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493325824:12345-0@lo:400:kworker.0 Request processed in 26us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893038.258917:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787893038.258940:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493325440 00000100:00100000:3.0:1787893038.258944:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493325440 00000100:00100000:3.0:1787893038.258961:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493325952 00000100:00100000:3.0:1787893038.258963:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493325952 00000100:00100000:3.0:1787893038.258974:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493325568 00000100:00100000:3.0:1787893038.258976:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493325568 00000100:00100000:3.0:1787893038.258985:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493326080 00000100:00100000:3.0:1787893038.258987:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493326080 00000100:00100000:3.0:1787893038.258999:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787893038.259004:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493325440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893038.259037:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493325440:12345-0@lo:400:kworker.0 Request processed in 32us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893038.259042:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787893038.259053:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787893038.259058:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493325952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893038.259082:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493325952:12345-0@lo:400:kworker.0 Request processed in 25us (1141us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893038.259087:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787893038.259096:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787893038.259102:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493325568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893038.259125:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493325568:12345-0@lo:400:kworker.0 Request processed in 24us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893038.259130:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787893038.259139:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787893038.259144:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493326080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893038.259166:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493326080:12345-0@lo:400:kworker.0 Request processed in 22us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893038.259181:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1787893038.259213:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787893038.259217:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787893038.259220:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787893038.259222:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787893038.259249:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb9ea00 x1874741493325312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893038.259264:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493325312:0@lo:400:kworker.0 00010000:00080000:3.0:1787893038.259275:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb4a680 x1874741493325824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893038.259283:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493325824:0@lo:400:kworker.0 00000100:00100000:3.0:1787893038.259293:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493324672:0@lo:400:kworker.0 00000100:00100000:3.0:1787893038.259302:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493325184:0@lo:400:kworker.0 00000100:00100000:3.0:1787893038.259311:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1874741493325696:0@lo:400:kworker.0 00010000:00080000:3.0:1787893038.259349:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb9c700 x1874741493325568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893038.259358:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493325568:0@lo:400:kworker.0 00010000:00080000:3.0:1787893038.259367:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb49f80 x1874741493326080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893038.259375:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493326080:0@lo:400:kworker.0 00000100:00100000:3.0:1787893038.259383:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874741493324928:0@lo:400:kworker.0 00010000:00080000:3.0:1787893038.259393:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb9f800 x1874741493325440/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893038.259407:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493325440:0@lo:400:kworker.0 00010000:00080000:3.0:1787893038.259417:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb4a300 x1874741493325952/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893038.259425:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493325952:0@lo:400:kworker.0 00000100:00100000:1.0:1787893038.259722:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493324544 00000100:00100000:1.0:1787893038.259728:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493324544 00000100:00100000:1.0:1787893038.259760:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1787893038.259767:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+24:3630:x1874741493324544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893038.259808:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+24:3630:x1874741493324544:12345-0@lo:400:kworker.0 Request processed in 42us (1807us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893038.259814:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1787893038.259862:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493325056 00000100:00100000:1.0:1787893038.259866:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493325056 00000100:00100000:1.0:1787893038.259888:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493324800 00000100:00100000:1.0:1787893038.259891:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493324800 00000100:00100000:1.0:1787893038.259904:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787893038.259909:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c43050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493325056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893038.259940:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c43050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493325056:12345-0@lo:400:kworker.0 Request processed in 31us (1897us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893038.259946:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787893038.260196:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787893038.260218:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493324800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893038.260258:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493324800:12345-0@lo:400:kworker.0 Request processed in 55us (1894us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893038.260264:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787893038.260308:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493324800:0@lo:400:kworker.0 00000100:00100000:1.0:1787893038.260332:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493324544:0@lo:400:kworker.0 00000100:00100000:1.0:1787893038.260354:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493325056:0@lo:400:kworker.0 00000100:00100000:3.0:1787893038.260668:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787893038.260681:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493326208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787893038.260715:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893038.261487:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787893038.261525:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493326336:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787893038.261555:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893038.272092:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493326208 00000100:00100000:2.0:1787893038.272108:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493326208 00000100:00100000:2.0:1787893038.272211:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493326336 00000100:00100000:2.0:1787893038.272215:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493326336 00000100:00100000:2.0:1787893038.272235:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787893038.272245:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493326208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787893038.272277:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787893038.272364:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493326208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (11648us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893038.272371:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787893038.272389:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787893038.272396:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7114380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493326336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787893038.272406:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787893038.272447:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7114380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493326336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (10891us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893038.272454:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:2.0:1787893038.272516:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7db2680 x1874741493326208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893054 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893038.272535:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493326208:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1787893038.274791:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb75f80 x1874741493326336/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893054 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893038.274817:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493326336:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787893038.771917:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893039.151770:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893039.151816:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893039.151856:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893039.151898:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893039.151989:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481716096 00000100:00100000:2.0:1787893039.152000:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481716096 00000100:00100000:2.0:1787893039.152063:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 305 00000100:00100000:2.0:1787893039.152072:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2393:x1874741481716096:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893039.152135:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2393:x1874741481716096:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 64us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893039.152156:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 305 00000100:00100000:1.0:1787893039.152422:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481716224 00000100:00100000:1.0:1787893039.152427:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481716224 00000100:00100000:1.0:1787893039.152478:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481716480 00000100:00100000:1.0:1787893039.152481:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481716480 00000100:00100000:1.0:1787893039.152546:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 147 00000100:00100000:1.0:1787893039.152554:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7789880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+6:2392:x1874741481716224:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893039.152588:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7789880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+6:2392:x1874741481716224:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 36us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893039.152594:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 147 00000100:00100000:1.0:1787893039.152608:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 148 00000100:00100000:1.0:1787893039.152614:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c778aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c50492c-5fef-4e80-9bbb-0b2782d59443+6:2392:x1874741481716480:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893039.152635:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c778aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c50492c-5fef-4e80-9bbb-0b2782d59443+6:2392:x1874741481716480:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 22us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893039.152641:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 148 00000100:00080000:2.0:1787893039.152723:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787893039.152942:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481716736 00000100:00100000:3.0:1787893039.152948:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481716736 00000100:00100000:3.0:1787893039.153005:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 57 00000100:00100000:3.0:1787893039.153013:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ed562300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c50492c-5fef-4e80-9bbb-0b2782d59443+6:2392:x1874741481716736:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893039.153055:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ed562300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c50492c-5fef-4e80-9bbb-0b2782d59443+6:2392:x1874741481716736:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 44us (1157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893039.153061:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 57 00000100:00080000:2.0:1787893039.153183:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787893039.164089:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893039.164129:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893039.164225:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893039.164482:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481716864 00000100:00100000:2.0:1787893039.164522:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481716864 00000100:00100000:2.0:1787893039.164589:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 58 00000100:00100000:2.0:1787893039.164599:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ed560e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c50492c-5fef-4e80-9bbb-0b2782d59443+6:2393:x1874741481716864:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893039.164683:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ed560e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c50492c-5fef-4e80-9bbb-0b2782d59443+6:2393:x1874741481716864:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 84us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893039.164690:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 58 00000100:00100000:3.0:1787893039.165310:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481716352 00000100:00100000:3.0:1787893039.165316:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481716352 00000100:00100000:3.0:1787893039.165356:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481716608 00000100:00100000:3.0:1787893039.165360:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481716608 00000100:00100000:3.0:1787893039.165384:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 149 00000100:00100000:3.0:1787893039.165392:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ed560a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+5:2393:x1874741481716352:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893039.165431:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ed560a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+5:2393:x1874741481716352:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 39us (1351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893039.165438:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 149 00000100:00100000:3.0:1787893039.165463:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 150 00000100:00100000:3.0:1787893039.165470:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ed560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c50492c-5fef-4e80-9bbb-0b2782d59443+6:2393:x1874741481716608:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893039.165524:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ed560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c50492c-5fef-4e80-9bbb-0b2782d59443+6:2393:x1874741481716608:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 55us (1395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893039.165531:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 150 00000100:00080000:0.0:1787893039.168341:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787893039.168351:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:1.0:1787893039.288729:0:9497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9c50492c-5fef-4e80-9bbb-0b2782d59443 00000001:00100000:1.0:1787893039.291279:0:8413:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9c50492c-5fef-4e80-9bbb-0b2782d59443 00000001:00100000:3.0:1787893039.291649:0:7436:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 9c50492c-5fef-4e80-9bbb-0b2782d59443 00000001:00100000:1.0:1787893039.291864:0:6484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9c50492c-5fef-4e80-9bbb-0b2782d59443 00010000:00010000:2.0:1787893039.793682:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893040.323347:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787893040.323372:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493326464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787893040.323734:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893040.323852:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493326464 00000100:00100000:3.0:1787893040.323860:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493326464 00000100:00100000:3.0:1787893040.323925:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787893040.323936:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe7ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493326464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787893040.323967:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787893040.324014:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe7ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493326464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893040.324021:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1787893040.325097:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787893040.325158:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e7115500 x1874741493326464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893056 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893040.325181:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493326464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787893040.326267:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787893040.326282:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493326592:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787893040.326343:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893040.326390:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493326592 00000100:00100000:3.0:1787893040.326396:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493326592 00000100:00100000:3.0:1787893040.328535:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787893040.328559:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493326592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787893040.328588:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787893040.328663:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493326592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (2320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893040.328670:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:3.0:1787893040.328716:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb74e00 x1874741493326592/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893056 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787893040.330126:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787893040.330218:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493326592:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787893040.819527:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787893041.159961:0:12175:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg235-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:3.0:1787893041.843232:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787893041.843257:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493326720:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787893041.843323:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787893041.843726:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893041.843780:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493326720 00000100:00100000:2.0:1787893041.843787:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493326720 00000100:00100000:2.0:1787893041.843877:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787893041.843887:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493326720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787893041.843919:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787893041.843983:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493326720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893041.843990:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787893041.844111:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493326720:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787893042.866330:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893042.873302:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787893042.873329:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493326848:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787893042.873400:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893042.873630:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493326848 00000100:00100000:2.0:1787893042.873639:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493326848 00000100:00100000:2.0:1787893042.873693:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787893042.873702:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ed561c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493326848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787893042.873734:0:7865:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787893042.873788:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ed561c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493326848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893042.873804:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787893042.873950:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493326848:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787893043.383507:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493327104:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787893043.383580:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893043.383641:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787893043.383648:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493326976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787893043.383673:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893043.383706:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493327104 00000100:00100000:1.0:1787893043.383713:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493327104 00000100:00100000:1.0:1787893043.383761:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493326976 00000100:00100000:1.0:1787893043.383764:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493326976 00000100:00100000:1.0:1787893043.383782:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787893043.383790:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7117100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493327104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787893043.383979:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787893043.384023:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7117100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493327104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 233us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893043.384030:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787893043.384048:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787893043.384055:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7115c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493326976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787893043.384064:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787893043.384087:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7115c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493326976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893043.384100:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:1.0:1787893043.384116:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787893043.384144:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7db0a80 x1874741493326976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893059 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893043.384163:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493326976:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1787893043.384174:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e7115500 x1874741493327104/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893059 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893043.384184:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493327104:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787893043.391878:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493327488:0@lo:400:kworker.0 00000100:00100000:2.0:1787893043.391956:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893043.391999:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493328000:0@lo:400:kworker.0 00000100:00100000:2.0:1787893043.392034:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893043.392050:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe349880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1874741493328512:0@lo:400:kworker.0 00000100:00100000:2.0:1787893043.392070:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893043.392090:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787893043.392095:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874741493327616:0@lo:400:kworker.0 00000100:00100000:2.0:1787893043.392115:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893043.392133:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493328128:0@lo:400:kworker.0 00000100:00100000:2.0:1787893043.392158:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893043.392188:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493327488 00000100:00100000:2.0:1787893043.392195:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493327488 00000100:00100000:2.0:1787893043.392239:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787893043.392248:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe34a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493327488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893043.392311:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe34a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493327488:12345-0@lo:400:kworker.0 Request processed in 63us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893043.392319:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787893043.392362:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493327488:0@lo:400:kworker.0 00000100:00100000:3.0:1787893043.392617:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493327232:0@lo:400:kworker.0 00000100:00100000:3.0:1787893043.392653:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893043.392679:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493327744:0@lo:400:kworker.0 00000100:00100000:3.0:1787893043.392701:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893043.392718:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493328256:0@lo:400:kworker.0 00000100:00100000:3.0:1787893043.392737:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893043.392756:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787893043.392762:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493327360:0@lo:400:kworker.0 00000100:00100000:3.0:1787893043.392782:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893043.392801:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493327872:0@lo:400:kworker.0 00000100:00100000:3.0:1787893043.392833:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893043.392850:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe34b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1874741493328384:0@lo:400:kworker.0 00000100:00100000:3.0:1787893043.392868:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893043.392892:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493328000 00000100:00100000:3.0:1787893043.392896:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493328000 00000100:00100000:3.0:1787893043.392939:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493328512 00000100:00100000:3.0:1787893043.392943:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493328512 00000100:00100000:3.0:1787893043.392956:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493327616 00000100:00100000:3.0:1787893043.392959:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493327616 00000100:00100000:3.0:1787893043.392982:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493327360 00000100:00100000:3.0:1787893043.392984:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493327360 00000100:00100000:3.0:1787893043.392991:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493327872 00000100:00100000:3.0:1787893043.392994:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493327872 00000100:00100000:3.0:1787893043.393004:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493328384 00000100:00100000:3.0:1787893043.393006:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493328384 00000100:00100000:3.0:1787893043.393026:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787893043.393033:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe348000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493328000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893043.393071:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe348000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493328000:12345-0@lo:400:kworker.0 Request processed in 39us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893043.393077:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787893043.393089:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787893043.393095:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe348a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1874741493328512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893043.393121:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe348a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1874741493328512:12345-0@lo:400:kworker.0 Request processed in 27us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893043.393128:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787893043.393139:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787893043.393146:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe348380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874741493327616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893043.393172:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe348380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874741493327616:12345-0@lo:400:kworker.0 Request processed in 26us (1055us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893043.393177:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787893043.393187:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787893043.393192:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493327360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893043.393222:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493327360:12345-0@lo:400:kworker.0 Request processed in 30us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893043.393228:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787893043.393239:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787893043.393251:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493327872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893043.393449:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493327872:12345-0@lo:400:kworker.0 Request processed in 197us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893043.393455:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787893043.393469:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787893043.393475:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1874741493328384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893043.393522:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1874741493328384:12345-0@lo:400:kworker.0 Request processed in 48us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893043.393527:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787893043.393550:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493328128 00000100:00100000:3.0:1787893043.393554:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493328128 00000100:00100000:3.0:1787893043.393577:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493328256 00000100:00100000:3.0:1787893043.393580:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493328256 00000100:00100000:3.0:1787893043.393598:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787893043.393604:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe34ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493328128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893043.393634:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe34ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493328128:12345-0@lo:400:kworker.0 Request processed in 31us (1476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893043.393640:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787893043.393650:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787893043.393656:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493328256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893043.393680:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493328256:12345-0@lo:400:kworker.0 Request processed in 25us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893043.393685:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787893043.393702:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493327744 00000100:00100000:3.0:1787893043.393704:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493327744 00000100:00100000:3.0:1787893043.393725:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787893043.393730:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493327744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893043.393766:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493327744:12345-0@lo:400:kworker.0 Request processed in 36us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893043.393772:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:3.0:1787893043.393797:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787893043.393800:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787893043.393815:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787893043.393838:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493327360:0@lo:400:kworker.0 00000100:00100000:3.0:1787893043.393847:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493327872:0@lo:400:kworker.0 00000100:00100000:3.0:1787893043.393855:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe34b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1874741493328384:0@lo:400:kworker.0 00000100:00100000:3.0:1787893043.393863:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493327744:0@lo:400:kworker.0 00010000:00080000:3.0:1787893043.393873:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7db1f80 x1874741493328256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893043.393882:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493328256:0@lo:400:kworker.0 00000100:00100000:3.0:1787893043.394221:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874741493327616:0@lo:400:kworker.0 00010000:00080000:3.0:1787893043.394234:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7db1c00 x1874741493328128/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893043.394244:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493328128:0@lo:400:kworker.0 00010000:00080000:3.0:1787893043.394254:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7db3b80 x1874741493328000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893043.394328:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493328000:0@lo:400:kworker.0 00010000:00080000:3.0:1787893043.394342:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9fe349880 x1874741493328512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893043.394364:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe349880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1874741493328512:0@lo:400:kworker.0 00000100:00100000:2.0:1787893043.394573:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493327232 00000100:00100000:2.0:1787893043.394578:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493327232 00000100:00100000:2.0:1787893043.394614:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1787893043.394621:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+24:3632:x1874741493327232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893043.394673:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+24:3632:x1874741493327232:12345-0@lo:400:kworker.0 Request processed in 52us (2019us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893043.394680:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1787893043.394764:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493327232:0@lo:400:kworker.0 00010000:00010000:3.0:1787893043.903398:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893044.260437:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893044.263561:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893044.263607:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893044.263636:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893044.263671:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893044.263689:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893044.263711:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893044.263743:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481717248 00000100:00100000:0.0:1787893044.263754:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481717248 00000100:00100000:0.0:1787893044.263819:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481717504 00000100:00100000:0.0:1787893044.263822:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481717504 00000100:00100000:0.0:1787893044.263835:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481717120 00000100:00100000:0.0:1787893044.263838:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481717120 00000100:00100000:0.0:1787893044.263846:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481717376 00000100:00100000:0.0:1787893044.263856:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481717376 00000100:00100000:0.0:1787893044.263877:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 157 00000100:00100000:0.0:1787893044.263885:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ed561f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481717248:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893044.263951:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ed561f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481717248:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 67us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893044.263957:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 157 00000100:00100000:0.0:1787893044.263971:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 158 00000100:00100000:0.0:1787893044.263977:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ed560380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481717504:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893044.263999:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ed560380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481717504:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 23us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893044.264005:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 158 00000100:00100000:0.0:1787893044.264029:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 159 00000100:00100000:0.0:1787893044.264036:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ed563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+6:2390:x1874741481717120:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893044.264059:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ed563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+6:2390:x1874741481717120:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 24us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893044.264065:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 159 00000100:00100000:0.0:1787893044.264075:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 160 00000100:00100000:0.0:1787893044.264082:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ed561500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481717376:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893044.264101:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ed561500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481717376:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 20us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893044.264107:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 160 00000100:00100000:0.0:1787893044.264123:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481717760 00000100:00100000:0.0:1787893044.264126:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481717760 00000100:00100000:0.0:1787893044.264151:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481717632 00000100:00100000:0.0:1787893044.264159:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481717632 00000100:00100000:0.0:1787893044.264184:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 61 00000100:00100000:0.0:1787893044.264190:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ed561880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481717760:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893044.264215:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ed561880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481717760:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 25us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893044.264220:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 61 00000100:00100000:0.0:1787893044.264230:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 62 00000100:00100000:0.0:1787893044.264236:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ed562680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481717632:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893044.264442:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ed562680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481717632:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 204us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893044.264449:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 62 00000100:00080000:0.0:1787893044.264477:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787893044.264481:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787893044.264484:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787893044.264486:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787893044.276283:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481716992 00000100:00100000:1.0:1787893044.276298:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481716992 00000100:00100000:1.0:1787893044.276388:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 307 00000100:00100000:1.0:1787893044.276399:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2390:x1874741481716992:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893044.289903:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2390:x1874741481716992:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 13492us (29463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893044.289931:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 307 00010000:00010000:1.0:1787893044.914049:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893045.426075:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493328640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787893045.426150:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893045.426220:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493328640 00000100:00100000:1.0:1787893045.426228:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493328640 00000100:00100000:1.0:1787893045.426284:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787893045.426294:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7114e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493328640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787893045.426334:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787893045.426378:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7114e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493328640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893045.426411:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1787893045.426433:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787893045.426466:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e7115500 x1874741493328640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893061 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893045.426485:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493328640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787893045.446825:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493328768:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787893045.446898:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893045.447122:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493328768 00000100:00100000:0.0:1787893045.447130:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493328768 00000100:00100000:0.0:1787893045.447193:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787893045.447204:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493328768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787893045.447226:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787893045.447273:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493328768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893045.447280:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:3.0:1787893045.447625:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e7115500 x1874741493328768/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893061 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893045.447646:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493328768:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787893045.447715:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787893045.937842:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893046.962674:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893046.962760:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787893046.962790:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7114000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493328896:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787893046.962852:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893046.962909:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493328896 00000100:00100000:1.0:1787893046.962916:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493328896 00000100:00100000:1.0:1787893046.962953:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787893046.962960:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7116680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493328896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787893046.962988:0:7865:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787893046.963040:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7116680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493328896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893046.963046:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787893046.963088:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7114000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493328896:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787893047.985739:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493329024:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787893047.985827:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893047.987455:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493329024 00000100:00100000:0.0:1787893047.987468:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493329024 00000100:00100000:0.0:1787893047.987560:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787893047.987571:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493329024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787893047.987621:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787893047.987693:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493329024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (1867us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893047.987700:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00010000:1.0:1787893047.989726:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893047.989798:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493329024:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787893048.497819:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493329152:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787893048.498117:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893048.500157:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787893048.500190:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe34b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493329280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787893048.500261:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893048.502446:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493329536:0@lo:400:kworker.0 00000100:00100000:1.0:1787893048.502548:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893048.502580:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493330048:0@lo:400:kworker.0 00000100:00100000:1.0:1787893048.502603:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893048.502622:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1874741493330560:0@lo:400:kworker.0 00000100:00100000:1.0:1787893048.502641:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893048.502671:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787893048.502677:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7114a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493329664:0@lo:400:kworker.0 00000100:00100000:1.0:1787893048.502699:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893048.502715:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493330176:0@lo:400:kworker.0 00000100:00100000:1.0:1787893048.502735:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893048.502748:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1874741493330688:0@lo:400:kworker.0 00000100:00100000:1.0:1787893048.502782:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893048.502813:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493329664 00000100:00100000:1.0:1787893048.502819:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493329664 00000100:00100000:1.0:1787893048.502860:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787893048.502868:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493329664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893048.502934:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493329664:12345-0@lo:400:kworker.0 Request processed in 66us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893048.502940:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787893048.502978:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7114a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493329664:0@lo:400:kworker.0 00000100:00100000:1.0:1787893048.504145:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493329536 00000100:00100000:1.0:1787893048.504155:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493329536 00000100:00100000:1.0:1787893048.504186:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493330048 00000100:00100000:1.0:1787893048.504189:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493330048 00000100:00100000:1.0:1787893048.504211:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493330560 00000100:00100000:1.0:1787893048.504220:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493330560 00000100:00100000:1.0:1787893048.504239:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493330176 00000100:00100000:1.0:1787893048.504241:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493330176 00000100:00100000:1.0:1787893048.504252:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493330688 00000100:00100000:1.0:1787893048.504254:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493330688 00000100:00100000:1.0:1787893048.504269:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787893048.504276:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493329536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893048.504333:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493329536:12345-0@lo:400:kworker.0 Request processed in 57us (1785us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893048.504340:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787893048.504355:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787893048.504361:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493330048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893048.504389:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493330048:12345-0@lo:400:kworker.0 Request processed in 28us (1784us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893048.504394:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787893048.504405:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787893048.504411:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874741493330560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893048.504439:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874741493330560:12345-0@lo:400:kworker.0 Request processed in 29us (1797us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893048.504445:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787893048.504455:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787893048.504461:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493330176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893048.504487:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493330176:12345-0@lo:400:kworker.0 Request processed in 27us (1751us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893048.504518:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787893048.504530:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787893048.504537:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1874741493330688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893048.504575:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1874741493330688:12345-0@lo:400:kworker.0 Request processed in 40us (1792us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893048.504580:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:1.0:1787893048.504596:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787893048.504600:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787893048.504625:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c64b5c00 x1874741493330176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893048.504638:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493330176:0@lo:400:kworker.0 00010000:00080000:1.0:1787893048.504650:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c64b6680 x1874741493330688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893048.504659:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1874741493330688:0@lo:400:kworker.0 00000100:00100000:1.0:1787893048.504669:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493329536:0@lo:400:kworker.0 00000100:00100000:1.0:1787893048.504679:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493330048:0@lo:400:kworker.0 00000100:00100000:1.0:1787893048.504688:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1874741493330560:0@lo:400:kworker.0 00000100:00100000:0.0:1787893048.505583:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493329792:0@lo:400:kworker.0 00000100:00100000:0.0:1787893048.505632:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893048.505673:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493330304:0@lo:400:kworker.0 00000100:00100000:0.0:1787893048.505698:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893048.505717:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493330816:0@lo:400:kworker.0 00000100:00100000:0.0:1787893048.505736:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893048.505771:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787893048.505778:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7115880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493329408:0@lo:400:kworker.0 00000100:00100000:0.0:1787893048.505805:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893048.505833:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7116a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493329920:0@lo:400:kworker.0 00000100:00100000:0.0:1787893048.505856:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893048.505882:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493330432:0@lo:400:kworker.0 00000100:00100000:0.0:1787893048.505902:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893048.505932:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493329792 00000100:00100000:0.0:1787893048.505938:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493329792 00000100:00100000:0.0:1787893048.505970:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787893048.505977:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ed560700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493329792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893048.506021:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ed560700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493329792:12345-0@lo:400:kworker.0 Request processed in 44us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893048.506028:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787893048.506054:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493329920 00000100:00100000:0.0:1787893048.506069:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493329920 00000100:00100000:0.0:1787893048.506092:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787893048.506098:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7203480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493329920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893048.506128:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7203480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493329920:12345-0@lo:400:kworker.0 Request processed in 31us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893048.506133:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787893048.506165:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493330304 00000100:00100000:0.0:1787893048.506169:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493330304 00000100:00100000:0.0:1787893048.506196:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493330816 00000100:00100000:0.0:1787893048.506199:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493330816 00000100:00100000:0.0:1787893048.506210:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493330432 00000100:00100000:0.0:1787893048.506212:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493330432 00000100:00100000:0.0:1787893048.506460:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787893048.506466:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ed563b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493330304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893048.506524:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ed563b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493330304:12345-0@lo:400:kworker.0 Request processed in 57us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893048.506531:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787893048.506543:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787893048.506548:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ed561180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493330816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893048.506574:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ed561180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493330816:12345-0@lo:400:kworker.0 Request processed in 26us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893048.506579:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787893048.506589:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787893048.506595:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7201500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493330432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893048.506619:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7201500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493330432:12345-0@lo:400:kworker.0 Request processed in 25us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893048.506623:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787893048.506671:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7116a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493329920:0@lo:400:kworker.0 00010000:00080000:0.0:1787893048.506683:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c64b5500 x1874741493330432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893048.506692:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493330432:0@lo:400:kworker.0 00000100:00100000:0.0:1787893048.506702:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493329792:0@lo:400:kworker.0 00010000:00080000:0.0:1787893048.506710:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c64b7800 x1874741493330304/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893048.506718:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493330304:0@lo:400:kworker.0 00010000:00080000:0.0:1787893048.506731:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c64b7100 x1874741493330816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893048.506739:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493330816:0@lo:400:kworker.0 00000100:00080000:1.0:1787893048.510371:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787893048.510381:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787893048.514121:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493329408 00000100:00100000:0.0:1787893048.514137:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493329408 00000100:00100000:0.0:1787893048.514224:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1787893048.514235:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+24:3632:x1874741493329408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893048.514329:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+24:3632:x1874741493329408:12345-0@lo:400:kworker.0 Request processed in 95us (8522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893048.514336:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1787893048.514398:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7115880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493329408:0@lo:400:kworker.0 00000100:00100000:3.0:1787893048.517042:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493329152 00000100:00100000:3.0:1787893048.517056:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493329152 00000100:00100000:3.0:1787893048.517162:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493329280 00000100:00100000:3.0:1787893048.517167:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493329280 00000100:00100000:3.0:1787893048.517200:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787893048.517210:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7115f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493329152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787893048.517247:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787893048.517323:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7115f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493329152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (19206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893048.517330:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787893048.517347:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787893048.517353:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe349180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493329280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787893048.517363:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787893048.517387:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe349180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493329280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (17127us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893048.517402:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:3.0:1787893048.517443:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e7116300 x1874741493329152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893064 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893048.517462:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493329152:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1787893048.517546:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9fe34b800 x1874741493329280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893064 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893048.517559:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe34b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493329280:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787893048.518072:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787893049.009844:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893049.376717:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893049.376798:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893049.376834:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893049.376897:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893049.376915:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893049.376936:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893049.376958:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893049.376986:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481718016 00000100:00100000:0.0:1787893049.376996:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481718016 00000100:00100000:0.0:1787893049.377050:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481718272 00000100:00100000:0.0:1787893049.377054:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481718272 00000100:00100000:0.0:1787893049.377067:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481718144 00000100:00100000:0.0:1787893049.377069:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481718144 00000100:00100000:0.0:1787893049.377081:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481718400 00000100:00100000:0.0:1787893049.377083:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481718400 00000100:00100000:0.0:1787893049.377100:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 167 00000100:00100000:0.0:1787893049.377109:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7200000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+6:2393:x1874741481718016:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893049.377199:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7200000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+6:2393:x1874741481718016:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 91us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893049.377440:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 168 00000100:00100000:2.0:1787893049.377450:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7201880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2393:x1874741481718272:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893049.377481:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7201880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2393:x1874741481718272:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 34us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893049.377488:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 168 00000100:00100000:2.0:1787893049.377527:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 169 00000100:00100000:2.0:1787893049.377534:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7203800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+5:2393:x1874741481718144:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893049.377558:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7203800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+5:2393:x1874741481718144:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 25us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893049.377565:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 169 00000100:00100000:2.0:1787893049.377577:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 170 00000100:00100000:2.0:1787893049.377583:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7200e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2393:x1874741481718400:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893049.377605:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7200e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2393:x1874741481718400:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 23us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893049.377611:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 170 00000100:00100000:2.0:1787893049.377838:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481718528 00000100:00100000:2.0:1787893049.377853:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481718528 00000100:00100000:2.0:1787893049.377899:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481718656 00000100:00100000:2.0:1787893049.377903:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481718656 00000100:00100000:2.0:1787893049.377925:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 66 00000100:00100000:2.0:1787893049.377931:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7200a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2393:x1874741481718528:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893049.377964:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7200a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2393:x1874741481718528:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 33us (1129us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893049.377970:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 66 00000100:00100000:2.0:1787893049.377982:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 67 00000100:00100000:2.0:1787893049.377988:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7203b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2393:x1874741481718656:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893049.378016:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7203b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2393:x1874741481718656:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 28us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893049.378022:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 67 00000100:00080000:2.0:1787893049.378081:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787893049.378085:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787893049.378088:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787893049.378090:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787893049.378436:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 167 00000100:00100000:1.0:1787893049.379766:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481717888 00000100:00100000:1.0:1787893049.379777:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481717888 00000100:00100000:1.0:1787893049.379837:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 309 00000100:00100000:1.0:1787893049.379857:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2393:x1874741481717888:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893049.379932:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2393:x1874741481717888:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 87us (3034us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893049.379939:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 309 00010000:00010000:3.0:1787893050.039603:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893050.550657:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe349c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493330944:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787893050.550729:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893050.550817:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493330944 00000100:00100000:0.0:1787893050.550825:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493330944 00000100:00100000:0.0:1787893050.550891:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787893050.550902:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7201f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493330944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787893050.550933:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787893050.550982:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7201f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493330944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893050.550989:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1787893050.551011:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787893050.551049:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9fe349c00 x1874741493330944/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893066 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893050.551067:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe349c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493330944:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787893050.561460:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493331072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787893050.561555:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893050.561708:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493331072 00000100:00100000:3.0:1787893050.561718:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493331072 00000100:00100000:3.0:1787893050.561790:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787893050.561800:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7203100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493331072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787893050.561822:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787893050.561880:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7203100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493331072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893050.561888:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:3.0:1787893050.561926:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb76d80 x1874741493331072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893066 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893050.561945:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493331072:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787893050.562069:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787893051.057794:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893052.082164:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493331200:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787893052.082248:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893052.082461:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493331200 00000100:00100000:1.0:1787893052.082469:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493331200 00000100:00100000:1.0:1787893052.082545:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787893052.082555:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493331200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787893052.082589:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787893052.082636:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493331200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893052.082643:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787893052.082976:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493331200:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787893052.084148:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787893052.482977:0:12490:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787893052.483365:0:12490:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787893053.109519:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893053.110941:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787893053.110966:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7200380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493331328:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787893053.111046:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893053.112458:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493331328 00000100:00100000:0.0:1787893053.112472:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493331328 00000100:00100000:0.0:1787893053.112566:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787893053.112576:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493331328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787893053.112624:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787893053.112708:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493331328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 133us (1661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893053.112724:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787893053.112843:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7200380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493331328:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787893053.629594:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493331840:0@lo:400:kworker.0 00000100:00100000:0.0:1787893053.629662:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893053.629723:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493332352:0@lo:400:kworker.0 00000100:00100000:0.0:1787893053.629748:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893053.629766:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493332864:0@lo:400:kworker.0 00000100:00100000:0.0:1787893053.629784:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893053.629811:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1787893053.629816:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493331456:0@lo:400:kworker.0 00000100:00100000:0.0:1787893053.629842:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893053.629863:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493331968:0@lo:400:kworker.0 00000100:00100000:0.0:1787893053.629885:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893053.629911:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493332480:0@lo:400:kworker.0 00000100:00100000:0.0:1787893053.629933:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893053.629949:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493332992:0@lo:400:kworker.0 00000100:00100000:0.0:1787893053.629969:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893053.630010:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7200380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493331584:0@lo:400:kworker.0 00000100:00100000:0.0:1787893053.630032:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893053.630049:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493332096:0@lo:400:kworker.0 00000100:00100000:0.0:1787893053.630067:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893053.630082:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1874741493332608:0@lo:400:kworker.0 00000100:00100000:0.0:1787893053.630101:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893053.630116:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787893053.630121:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493331712:0@lo:400:kworker.0 00000100:00100000:0.0:1787893053.630141:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893053.630157:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493332224:0@lo:400:kworker.0 00000100:00100000:0.0:1787893053.630262:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893053.630278:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1874741493332736:0@lo:400:kworker.0 00000100:00100000:0.0:1787893053.630298:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893053.630326:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493331840 00000100:00100000:0.0:1787893053.630333:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493331840 00000100:00100000:0.0:1787893053.630367:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493331584 00000100:00100000:0.0:1787893053.630370:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493331584 00000100:00100000:0.0:1787893053.630382:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493332096 00000100:00100000:0.0:1787893053.630384:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493332096 00000100:00100000:0.0:1787893053.630404:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493332608 00000100:00100000:0.0:1787893053.630407:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493332608 00000100:00100000:0.0:1787893053.630419:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493332224 00000100:00100000:0.0:1787893053.630422:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493332224 00000100:00100000:0.0:1787893053.630444:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493332736 00000100:00100000:0.0:1787893053.630447:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493332736 00000100:00100000:0.0:1787893053.630463:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787893053.630473:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493331840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893053.630549:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493331840:12345-0@lo:400:kworker.0 Request processed in 77us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893053.630556:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787893053.630573:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787893053.630580:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493331584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893053.630612:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493331584:12345-0@lo:400:kworker.0 Request processed in 33us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893053.630618:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787893053.630630:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787893053.630636:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493332096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893053.630662:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493332096:12345-0@lo:400:kworker.0 Request processed in 27us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893053.630668:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787893053.630678:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787893053.630684:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874741493332608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893053.630724:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874741493332608:12345-0@lo:400:kworker.0 Request processed in 27us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893053.630730:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787893053.630741:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787893053.630747:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493332224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893053.630773:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493332224:12345-0@lo:400:kworker.0 Request processed in 26us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893053.630784:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787893053.630794:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787893053.630800:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1874741493332736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893053.630827:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1874741493332736:12345-0@lo:400:kworker.0 Request processed in 27us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893053.630833:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787893053.630850:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493332352 00000100:00100000:0.0:1787893053.630854:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493332352 00000100:00100000:0.0:1787893053.630870:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493332864 00000100:00100000:0.0:1787893053.630873:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493332864 00000100:00100000:0.0:1787893053.630884:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493332480 00000100:00100000:0.0:1787893053.630887:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493332480 00000100:00100000:0.0:1787893053.630896:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493332992 00000100:00100000:0.0:1787893053.630898:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493332992 00000100:00100000:0.0:1787893053.630907:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787893053.630914:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493332352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893053.630943:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493332352:12345-0@lo:400:kworker.0 Request processed in 30us (1195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893053.630948:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787893053.630958:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787893053.630963:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493332864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893053.630987:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493332864:12345-0@lo:400:kworker.0 Request processed in 25us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893053.630992:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787893053.631000:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787893053.631005:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493332480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893053.631035:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493332480:12345-0@lo:400:kworker.0 Request processed in 30us (1102us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893053.631040:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787893053.631050:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787893053.631056:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493332992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893053.631077:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493332992:12345-0@lo:400:kworker.0 Request processed in 22us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893053.631082:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787893053.631099:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493331456 00000100:00100000:0.0:1787893053.631102:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493331456 00000100:00100000:0.0:1787893053.631122:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1787893053.631127:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+24:3632:x1874741493331456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893053.631152:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+24:3632:x1874741493331456:12345-0@lo:400:kworker.0 Request processed in 24us (1310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893053.631157:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1787893053.631803:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493333248:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787893053.631841:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893053.631876:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787893053.631882:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493333120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787893053.631903:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893053.631926:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493333248 00000100:00100000:3.0:1787893053.631931:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493333248 00000100:00100000:3.0:1787893053.631958:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493333120 00000100:00100000:3.0:1787893053.631961:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493333120 00000100:00100000:3.0:1787893053.631972:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787893053.631979:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493333248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787893053.632002:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787893053.632037:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493333248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893053.632043:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787893053.632055:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787893053.632060:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c778ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493333120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787893053.632069:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787893053.632088:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c778ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493333120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 29us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893053.632093:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:3.0:1787893053.632124:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9c3e6d500 x1874741493333120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893069 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893053.632140:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493333120:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787893053.632150:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9c3e6e300 x1874741493333248/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893069 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893053.632292:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493333248:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787893053.637973:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493331968 00000100:00100000:0.0:1787893053.637990:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493331968 00000100:00100000:0.0:1787893053.638035:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493331712 00000100:00100000:0.0:1787893053.638038:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493331712 00000100:00100000:0.0:1787893053.638056:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787893053.638065:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493331968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893053.638154:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493331968:12345-0@lo:400:kworker.0 Request processed in 89us (8267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893053.638162:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787893053.638193:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787893053.638199:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493331712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893053.638241:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493331712:12345-0@lo:400:kworker.0 Request processed in 42us (8099us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893053.638248:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:0.0:1787893053.638289:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787893053.638294:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787893053.638298:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787893053.638300:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787893053.638333:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493331456:0@lo:400:kworker.0 00000100:00100000:0.0:1787893053.638348:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493331968:0@lo:400:kworker.0 00010000:00080000:0.0:1787893053.638363:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c76f4000 x1874741493332480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893053.638373:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493332480:0@lo:400:kworker.0 00010000:00080000:0.0:1787893053.638384:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c76f7800 x1874741493332992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893053.638393:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493332992:0@lo:400:kworker.0 00000100:00100000:0.0:1787893053.638405:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493331840:0@lo:400:kworker.0 00010000:00080000:0.0:1787893053.638417:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c76f4e00 x1874741493332352/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893053.638425:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493332352:0@lo:400:kworker.0 00010000:00080000:0.0:1787893053.638436:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c76f5180 x1874741493332864/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893053.638445:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493332864:0@lo:400:kworker.0 00000100:00100000:0.0:1787893053.638688:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493331712:0@lo:400:kworker.0 00010000:00080000:0.0:1787893053.638720:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c76f5f80 x1874741493332224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893053.638731:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493332224:0@lo:400:kworker.0 00010000:00080000:0.0:1787893053.638744:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c76f4380 x1874741493332736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893053.638751:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1874741493332736:0@lo:400:kworker.0 00000100:00100000:0.0:1787893053.638761:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7200380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493331584:0@lo:400:kworker.0 00000100:00100000:0.0:1787893053.638770:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493332096:0@lo:400:kworker.0 00000100:00100000:0.0:1787893053.638779:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1874741493332608:0@lo:400:kworker.0 00010000:00010000:1.0:1787893054.129860:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893054.490604:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893054.490644:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893054.490678:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893054.490747:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481719424 00000100:00100000:3.0:1787893054.490758:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481719424 00000100:00100000:3.0:1787893054.490824:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481719552 00000100:00100000:3.0:1787893054.490827:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481719552 00000100:00100000:3.0:1787893054.490844:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 22 00000100:00100000:3.0:1787893054.490851:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe348700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2389:x1874741481719424:12345-192.168.202.35@tcp:9:kworker.0 00000020:00000080:3.0:1787893054.490875:0:8420:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf0d17 00000100:00080000:3.0:1787893054.490882:0:8420:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7761800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787893054.490917:0:8420:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1787893054.491077:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe348700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c50492c-5fef-4e80-9bbb-0b2782d59443+2:2389:x1874741481719424:12345-192.168.202.35@tcp:9:kworker.0 Request processed in 225us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893054.491085:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 22 00000100:00100000:3.0:1787893054.491099:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 23 00000100:00100000:3.0:1787893054.491106:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe349c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2389:x1874741481719552:12345-192.168.202.35@tcp:9:kworker.0 00000020:00000080:3.0:1787893054.491117:0:8420:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf0d1e 00000100:00080000:3.0:1787893054.491122:0:8420:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7764000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787893054.491145:0:8420:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1787893054.491218:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe349c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c50492c-5fef-4e80-9bbb-0b2782d59443+2:2389:x1874741481719552:12345-192.168.202.35@tcp:9:kworker.0 Request processed in 111us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893054.491224:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 23 00010000:00010000:3.0:1787893054.491241:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893054.491350:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893054.491512:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481718784 00000100:00100000:0.0:1787893054.491517:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481718784 00000100:00100000:0.0:1787893054.491549:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 311 00000100:00100000:0.0:1787893054.491556:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2391:x1874741481718784:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893054.491604:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2391:x1874741481718784:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 48us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893054.491610:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 311 00000100:00080000:2.0:1787893054.491740:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787893054.491744:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787893054.494390:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893054.494467:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893054.494645:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893054.494663:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481719040 00000100:00100000:0.0:1787893054.494671:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481719040 00000100:00100000:1.0:1787893054.494725:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481719296 00000100:00100000:1.0:1787893054.494729:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481719296 00000100:00080000:0.0:1787893054.494851:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787893054.494947:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 177 00000100:00100000:1.0:1787893054.494958:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe349880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2391:x1874741481719296:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893054.495035:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe349880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2391:x1874741481719296:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 80us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893054.495043:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 177 00000100:00100000:2.0:1787893054.495371:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893054.495595:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481718912 00000100:00100000:3.0:1787893054.495600:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481718912 00000100:00100000:3.0:1787893054.495638:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 178 00000100:00100000:3.0:1787893054.495646:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe34b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+6:2390:x1874741481718912:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893054.495681:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe34b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+6:2390:x1874741481718912:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 37us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893054.495688:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 178 00000100:00100000:1.0:1787893054.497090:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 179 00000100:00100000:1.0:1787893054.497104:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe34b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+5:2391:x1874741481719040:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893054.497173:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe34b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+5:2391:x1874741481719040:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 71us (2792us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893054.497180:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 179 00000100:00100000:1.0:1787893054.498465:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481719168 00000100:00100000:1.0:1787893054.498478:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481719168 00000100:00100000:1.0:1787893054.498549:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 180 00000100:00100000:1.0:1787893054.498559:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7db2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481719168:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893054.498615:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7db2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481719168:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 57us (3244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893054.498621:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 180 00000100:00080000:1.0:1787893054.499651:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787893054.499659:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000004:2.0:1787893054.871765:0:12588:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787893054.871994:0:12588:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787893055.153726:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893055.665663:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787893055.665687:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7788700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493333376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787893055.665767:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893055.665947:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493333376 00000100:00100000:3.0:1787893055.665955:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493333376 00000100:00100000:3.0:1787893055.666011:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787893055.666022:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493333376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787893055.666049:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787893055.666093:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493333376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893055.666100:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:3.0:1787893055.666142:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7788700 x1874741493333376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893071 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893055.666161:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7788700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493333376:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787893055.666197:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787893055.669565:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493333504:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787893055.669630:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893055.669701:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493333504 00000100:00100000:2.0:1787893055.669708:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493333504 00000100:00100000:2.0:1787893055.669763:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787893055.669772:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7db1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493333504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787893055.669792:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787893055.669832:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7db1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493333504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893055.669839:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:2.0:1787893055.669878:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7db3b80 x1874741493333504/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893071 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893055.669896:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493333504:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787893055.670883:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787893056.178001:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893057.205254:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787893057.205278:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493333632:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787893057.205349:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893057.205831:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493333632 00000100:00100000:0.0:1787893057.205845:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493333632 00000100:00100000:0.0:1787893057.205896:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787893057.205906:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493333632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787893057.205965:0:7865:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787893057.206019:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493333632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893057.206027:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787893057.206072:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493333632:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787893057.210984:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787893057.396447:0:12686:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787893057.397960:0:12686:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787893058.226537:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893058.226814:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493333760:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787893058.226887:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893058.228774:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493333760 00000100:00100000:2.0:1787893058.228797:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493333760 00000100:00100000:2.0:1787893058.228858:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787893058.228868:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493333760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787893058.228904:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787893058.229374:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493333760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 506us (2485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893058.229382:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787893058.229571:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493333760:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787893058.738422:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493333888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787893058.738508:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893058.738593:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493333888 00000100:00100000:3.0:1787893058.738600:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493333888 00000100:00100000:3.0:1787893058.738650:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787893058.738673:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493333888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787893058.738701:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787893058.738744:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493333888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893058.738751:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1787893058.738771:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787893058.738812:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb49500 x1874741493333888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893074 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893058.738830:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493333888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787893058.741573:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493334016:0@lo:400:kworker.0 00000100:00100000:2.0:1787893058.741578:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493334144:0@lo:400:kworker.0 00000100:00100000:0.0:1787893058.741964:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1874741493334272:0@lo:400:kworker.0 00000100:00100000:1.0:1787893058.746163:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493334400:0@lo:400:kworker.0 00000100:00100000:2.0:1787893058.747419:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893058.747479:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493334656:0@lo:400:kworker.0 00000100:00100000:3.0:1787893058.748656:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893058.748718:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1874741493334528:0@lo:400:kworker.0 00000100:00100000:3.0:1787893058.748761:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893058.748807:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1874741493335040:0@lo:400:kworker.0 00000100:00100000:3.0:1787893058.748830:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893058.748876:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493334016 00000100:00100000:3.0:1787893058.748883:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493334016 00000100:00100000:3.0:1787893058.748941:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1787893058.748951:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+24:3633:x1874741493334016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893058.749003:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+24:3633:x1874741493334016:12345-0@lo:400:kworker.0 Request processed in 53us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893058.749010:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1787893058.749054:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493334144 00000100:00100000:3.0:1787893058.749058:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493334144 00000100:00100000:3.0:1787893058.749082:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493334528 00000100:00100000:3.0:1787893058.749085:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493334528 00000100:00100000:3.0:1787893058.749108:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493335040 00000100:00100000:3.0:1787893058.749111:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493335040 00000100:00100000:3.0:1787893058.749125:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787893058.749131:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493334144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893058.749176:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493334144:12345-0@lo:400:kworker.0 Request processed in 46us (1762us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893058.749182:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787893058.749194:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787893058.749200:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1874741493334528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893058.749225:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1874741493334528:12345-0@lo:400:kworker.0 Request processed in 25us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893058.749232:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787893058.749242:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787893058.749249:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1874741493335040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893058.749274:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1874741493335040:12345-0@lo:400:kworker.0 Request processed in 26us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893058.749279:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00080000:3.0:1787893058.749319:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787893058.749346:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493334016:0@lo:400:kworker.0 00000100:00100000:3.0:1787893058.749359:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1874741493334528:0@lo:400:kworker.0 00000100:00100000:3.0:1787893058.749367:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1874741493335040:0@lo:400:kworker.0 00000100:00100000:2.0:1787893058.752745:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893058.752793:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1874741493335168:0@lo:400:kworker.0 00000100:00100000:2.0:1787893058.752813:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893058.754323:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493334144:0@lo:400:kworker.0 00000100:00100000:2.0:1787893058.754371:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493334656 00000100:00100000:2.0:1787893058.754379:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493334656 00000100:00100000:2.0:1787893058.754436:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493335168 00000100:00100000:2.0:1787893058.754439:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493335168 00000100:00100000:2.0:1787893058.754458:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787893058.754466:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493334656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893058.754542:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493334656:12345-0@lo:400:kworker.0 Request processed in 77us (1801us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893058.754549:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787893058.754563:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787893058.754569:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1874741493335168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893058.754592:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1874741493335168:12345-0@lo:400:kworker.0 Request processed in 24us (1779us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893058.754597:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00080000:2.0:1787893058.754620:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787893058.754645:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7db1880 x1874741493334656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893058.754657:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493334656:0@lo:400:kworker.0 00010000:00080000:2.0:1787893058.754677:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e5f72300 x1874741493335168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893058.754687:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1874741493335168:0@lo:400:kworker.0 00000100:00100000:0.0:1787893058.756377:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893058.756413:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493334272 00000100:00100000:0.0:1787893058.756425:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493334784:0@lo:400:kworker.0 00000100:00100000:3.0:1787893058.756426:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493334272 00000100:00100000:0.0:1787893058.756472:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893058.756477:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787893058.756487:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1874741493334272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893058.756522:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493335296:0@lo:400:kworker.0 00000100:00100000:0.0:1787893058.756563:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893058.756572:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1874741493334272:12345-0@lo:400:kworker.0 Request processed in 86us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893058.756579:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787893058.756606:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493334784 00000100:00100000:0.0:1787893058.756609:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1874741493334272:0@lo:400:kworker.0 00000100:00100000:3.0:1787893058.756611:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493334784 00000100:00100000:0.0:1787893058.756645:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493335296 00000100:00100000:0.0:1787893058.756650:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493335296 00000100:00100000:3.0:1787893058.756655:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787893058.756676:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493334784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893058.756696:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787893058.756707:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493335296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893058.756723:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493334784:12345-0@lo:400:kworker.0 Request processed in 59us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893058.756730:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787893058.756751:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493335296:12345-0@lo:400:kworker.0 Request processed in 46us (187us total) trans 0 rc 0/0 00000100:00080000:3.0:1787893058.756757:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787893058.756758:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1787893058.756763:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787893058.756800:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7db1180 x1874741493334784/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893058.756810:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493334784:0@lo:400:kworker.0 00010000:00080000:3.0:1787893058.756820:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e5f73480 x1874741493335296/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893058.756836:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493335296:0@lo:400:kworker.0 00000100:00100000:1.0:1787893058.766065:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893058.766120:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493334912:0@lo:400:kworker.0 00000100:00100000:1.0:1787893058.767277:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893058.767384:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493335424:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787893058.767416:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893058.767467:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493335424 00000100:00100000:1.0:1787893058.767474:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493335424 00000100:00100000:0.0:1787893058.767971:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493334400 00000100:00100000:0.0:1787893058.767978:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493334400 00000100:00100000:3.0:1787893058.767984:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493334912 00000100:00100000:3.0:1787893058.767990:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493334912 00000100:00100000:0.0:1787893058.768022:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787893058.768034:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493334400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893058.768086:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787893058.768095:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493334912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893058.768105:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493334400:12345-0@lo:400:kworker.0 Request processed in 74us (2048us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893058.768121:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787893058.768140:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493334912:12345-0@lo:400:kworker.0 Request processed in 46us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893058.770032:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787893058.770757:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493334400:0@lo:400:kworker.0 00010000:00080000:0.0:1787893058.770777:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e5f73800 x1874741493334912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893058.770787:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493334912:0@lo:400:kworker.0 00000100:00100000:1.0:1787893058.771395:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787893058.771413:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493335424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787893058.771435:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787893058.771516:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493335424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (4099us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893058.771522:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:1.0:1787893058.771555:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c64b7100 x1874741493335424/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893074 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893058.771570:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493335424:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787893058.778567:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787893059.250017:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893059.613002:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893059.613047:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893059.613086:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893059.613113:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893059.613142:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893059.613173:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481719680 00000100:00100000:3.0:1787893059.613184:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481719680 00000100:00100000:3.0:1787893059.613237:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 313 00000100:00100000:3.0:1787893059.613247:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2390:x1874741481719680:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893059.613319:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2390:x1874741481719680:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 73us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893059.613327:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 313 00000100:00100000:3.0:1787893059.613382:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481719808 00000100:00100000:3.0:1787893059.613387:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481719808 00000100:00100000:3.0:1787893059.613421:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481720064 00000100:00100000:3.0:1787893059.613424:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481720064 00000100:00100000:3.0:1787893059.613434:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481719936 00000100:00100000:3.0:1787893059.613436:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481719936 00000100:00100000:3.0:1787893059.613446:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481720192 00000100:00100000:3.0:1787893059.613448:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481720192 00000100:00100000:3.0:1787893059.613459:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 187 00000100:00100000:3.0:1787893059.613465:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+6:2391:x1874741481719808:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893059.613526:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+6:2391:x1874741481719808:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 60us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893059.613532:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 187 00000100:00100000:3.0:1787893059.613545:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 188 00000100:00100000:3.0:1787893059.613772:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2391:x1874741481720064:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893059.613802:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2391:x1874741481720064:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 33us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893059.626358:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 189 00000100:00100000:0.0:1787893059.626390:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481719936:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893059.626474:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481719936:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 102us (13360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893059.626483:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 189 00000100:00100000:0.0:1787893059.626530:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 190 00000100:00100000:0.0:1787893059.626538:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481720192:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893059.631875:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 188 00000100:00080000:3.0:1787893059.632178:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787893059.632184:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787893059.632426:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481720192:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 5885us (19279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893059.632438:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 190 00010000:00010000:3.0:1787893060.276351:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787893060.285285:0:8413:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9c50492c-5fef-4e80-9bbb-0b2782d59443 00000020:00000080:0.0:1787893060.285298:0:8413:0:(genops.c:885:class_export_put()) final put ffff9fc8c7760000/9c50492c-5fef-4e80-9bbb-0b2782d59443 00000020:00000080:3.0:1787893060.285382:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c7760000/9c50492c-5fef-4e80-9bbb-0b2782d59443 for lustre-OST0000 00000020:00000080:3.0:1787893060.285435:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc8c7761800 for lustre-OST0000 00000001:00100000:3.0:1787893060.286930:0:9497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9c50492c-5fef-4e80-9bbb-0b2782d59443 00000020:00000080:3.0:1787893060.286938:0:9497:0:(genops.c:885:class_export_put()) final put ffff9fc8c7762800/9c50492c-5fef-4e80-9bbb-0b2782d59443 00000020:00000080:0.0:1787893060.287007:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c7762800/9c50492c-5fef-4e80-9bbb-0b2782d59443 for lustre-OST0001 00000020:00000080:0.0:1787893060.287052:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc8c7764000 for lustre-OST0001 00000020:00000004:3.0:1787893060.574174:0:12783:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787893060.574349:0:12783:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787893060.786760:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787893060.786783:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493335552:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787893060.786851:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893060.786931:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493335552 00000100:00100000:2.0:1787893060.786938:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493335552 00000100:00100000:2.0:1787893060.786987:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787893060.786997:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493335552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787893060.787025:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787893060.787066:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493335552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893060.787073:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:2.0:1787893060.787112:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e5f72300 x1874741493335552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893076 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893060.787131:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493335552:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787893060.789382:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493335680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787893060.789448:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893060.789547:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493335680 00000100:00100000:2.0:1787893060.789554:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493335680 00000100:00100000:2.0:1787893060.789602:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787893060.789610:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493335680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787893060.789631:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787893060.789691:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493335680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893060.789698:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:2.0:1787893060.789734:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e5f72300 x1874741493335680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893076 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893060.789765:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493335680:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787893060.793756:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787893061.297738:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893062.323449:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787893062.323479:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493335808:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787893062.323607:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893062.323687:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493335808 00000100:00100000:1.0:1787893062.323695:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493335808 00000100:00100000:1.0:1787893062.323747:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787893062.323755:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493335808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787893062.323788:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787893062.323834:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493335808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893062.323840:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787893062.323884:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493335808:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787893062.332643:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787893062.862901:0:12881:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787893062.863275:0:12881:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787893063.360863:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493335936:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787893063.360941:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893063.361057:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493335936 00000100:00100000:0.0:1787893063.361065:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493335936 00000100:00100000:0.0:1787893063.361127:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787893063.361136:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493335936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787893063.361168:0:7865:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787893063.361214:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493335936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893063.361220:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787893063.361258:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493335936:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787893063.370050:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893063.859118:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493336064:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787893063.859185:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893063.859251:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493336192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787893063.859288:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893063.859331:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493336064 00000100:00100000:3.0:1787893063.859339:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493336064 00000100:00100000:3.0:1787893063.859574:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493336192 00000100:00100000:3.0:1787893063.859579:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493336192 00000100:00100000:3.0:1787893063.859598:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787893063.859607:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493336064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787893063.859663:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787893063.859707:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493336064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893063.859714:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787893063.859730:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787893063.859736:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7db0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493336192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787893063.859745:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787893063.859773:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7db0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493336192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893063.859855:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1787893063.859876:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787893063.859905:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb48e00 x1874741493336192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893079 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893063.859923:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493336192:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787893063.859950:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb49f80 x1874741493336064/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893079 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893063.859961:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493336064:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787893063.867369:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493336448:0@lo:400:kworker.0 00000100:00100000:2.0:1787893063.867393:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493336320:0@lo:400:kworker.0 00000100:00100000:3.0:1787893063.871335:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893063.871409:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493336960:0@lo:400:kworker.0 00000100:00100000:3.0:1787893063.871456:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893063.871481:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493337472:0@lo:400:kworker.0 00000100:00100000:3.0:1787893063.871517:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893063.871557:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787893063.871564:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493336576:0@lo:400:kworker.0 00000100:00100000:3.0:1787893063.871586:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893063.871606:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493337088:0@lo:400:kworker.0 00000100:00100000:3.0:1787893063.871642:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893063.871678:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493336448 00000100:00100000:3.0:1787893063.871685:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493336448 00000100:00100000:3.0:1787893063.871733:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493336960 00000100:00100000:3.0:1787893063.871736:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493336960 00000100:00100000:3.0:1787893063.871757:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493337472 00000100:00100000:3.0:1787893063.871759:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493337472 00000100:00100000:3.0:1787893063.871771:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493336576 00000100:00100000:3.0:1787893063.871773:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493336576 00000100:00100000:0.0:1787893063.871997:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787893063.872009:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493336448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893063.872065:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493336448:12345-0@lo:400:kworker.0 Request processed in 59us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893063.872072:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787893063.872089:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787893063.872095:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493336960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893063.872122:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493336960:12345-0@lo:400:kworker.0 Request processed in 27us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893063.872127:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787893063.872139:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787893063.872144:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493337472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893063.872172:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493337472:12345-0@lo:400:kworker.0 Request processed in 27us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893063.872177:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787893063.872311:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893063.872369:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1874741493336832:0@lo:400:kworker.0 00000100:00100000:2.0:1787893063.872395:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893063.872414:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493336832 00000100:00100000:2.0:1787893063.872417:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493336832 00000100:00100000:0.0:1787893063.872542:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493336320 00000100:00100000:0.0:1787893063.872546:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493336320 00000100:00100000:0.0:1787893063.872575:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1787893063.872582:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+24:3631:x1874741493336320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893063.872634:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+24:3631:x1874741493336320:12345-0@lo:400:kworker.0 Request processed in 52us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893063.872640:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1787893063.872842:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787893063.872850:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3631:x1874741493336832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893063.872880:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3631:x1874741493336832:12345-0@lo:400:kworker.0 Request processed in 32us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893063.872886:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1787893063.872889:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787893063.872896:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493336576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893063.872922:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1874741493336832:0@lo:400:kworker.0 00000100:00100000:3.0:1787893063.872924:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493336576:12345-0@lo:400:kworker.0 Request processed in 29us (1338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893063.872929:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7788700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1874741493337344:0@lo:400:kworker.0 00000100:00100000:3.0:1787893063.872930:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787893063.872950:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893063.872951:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493337088 00000100:00100000:3.0:1787893063.872954:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493337088 00000100:00100000:2.0:1787893063.872966:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493337344 00000100:00100000:2.0:1787893063.872969:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493337344 00000100:00100000:3.0:1787893063.872980:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787893063.872986:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493337088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893063.872987:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787893063.872992:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1874741493337344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893063.873013:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1874741493337344:12345-0@lo:400:kworker.0 Request processed in 21us (63us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893063.873014:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493337088:12345-0@lo:400:kworker.0 Request processed in 28us (1371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893063.873019:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1787893063.873020:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1787893063.873039:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787893063.873041:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7788700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1874741493337344:0@lo:400:kworker.0 00000100:00080000:3.0:1787893063.873043:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787893063.873045:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787893063.873055:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493336704:0@lo:400:kworker.0 00000100:00100000:2.0:1787893063.873075:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493336320:0@lo:400:kworker.0 00000100:00100000:3.0:1787893063.873520:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893063.873542:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493337216:0@lo:400:kworker.0 00000100:00100000:3.0:1787893063.873565:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893063.873603:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493336704 00000100:00100000:3.0:1787893063.873608:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493336704 00000100:00100000:3.0:1787893063.873645:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787893063.873652:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493336704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893063.873693:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493336704:12345-0@lo:400:kworker.0 Request processed in 40us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893063.873698:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787893063.873733:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493336576:0@lo:400:kworker.0 00010000:00080000:3.0:1787893063.873748:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb49f80 x1874741493337088/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893063.873758:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493337088:0@lo:400:kworker.0 00000100:00100000:3.0:1787893063.873768:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493336448:0@lo:400:kworker.0 00010000:00080000:3.0:1787893063.874611:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7db3b80 x1874741493336960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893063.874637:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493336960:0@lo:400:kworker.0 00010000:00080000:3.0:1787893063.874657:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb9ed80 x1874741493337472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893063.874665:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493337472:0@lo:400:kworker.0 00000100:00100000:2.0:1787893063.875638:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493336704:0@lo:400:kworker.0 00000100:00100000:0.0:1787893063.875723:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493337216 00000100:00100000:0.0:1787893063.875741:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493337216 00000100:00100000:0.0:1787893063.875801:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787893063.875811:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493337216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893063.875871:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493337216:12345-0@lo:400:kworker.0 Request processed in 63us (2305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893063.875877:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:2.0:1787893063.876002:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb48e00 x1874741493337216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893063.876014:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493337216:0@lo:400:kworker.0 00000100:00080000:3.0:1787893063.880051:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787893064.371294:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893064.731736:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893064.731799:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893064.731834:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893064.731858:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893064.731881:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893064.731978:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481720320 00000100:00100000:2.0:1787893064.731988:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481720320 00000100:00100000:2.0:1787893064.732045:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 315 00000100:00100000:2.0:1787893064.732056:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ec8ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2392:x1874741481720320:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893064.732135:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ec8ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2392:x1874741481720320:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 80us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893064.732143:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 315 00000100:00100000:2.0:1787893064.732175:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481720448 00000100:00100000:2.0:1787893064.732179:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481720448 00000100:00100000:2.0:1787893064.732212:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481720704 00000100:00100000:2.0:1787893064.732215:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481720704 00000100:00100000:2.0:1787893064.732228:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481720576 00000100:00100000:2.0:1787893064.732231:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481720576 00000100:00100000:2.0:1787893064.732241:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481720832 00000100:00100000:2.0:1787893064.732243:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481720832 00000100:00100000:2.0:1787893064.732257:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 197 00000100:00100000:2.0:1787893064.732263:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+6:2392:x1874741481720448:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893064.732294:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+6:2392:x1874741481720448:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 31us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893064.732301:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 197 00000100:00100000:2.0:1787893064.732321:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 198 00000100:00100000:2.0:1787893064.732329:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2392:x1874741481720704:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893064.732354:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2392:x1874741481720704:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 26us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893064.732360:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 198 00000100:00100000:2.0:1787893064.732372:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 199 00000100:00100000:2.0:1787893064.732378:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+5:2392:x1874741481720576:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893064.732399:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+5:2392:x1874741481720576:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 22us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893064.732405:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 199 00000100:00100000:2.0:1787893064.732416:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 200 00000100:00100000:2.0:1787893064.732423:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2392:x1874741481720832:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893064.732444:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2392:x1874741481720832:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 22us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893064.732450:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 200 00000100:00080000:2.0:1787893064.732618:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787893064.732623:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787893065.398533:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893065.906621:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493337728:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787893065.906702:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893065.906886:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493337728 00000100:00100000:0.0:1787893065.906895:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493337728 00000100:00100000:0.0:1787893065.906963:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787893065.906973:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7788700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493337728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787893065.907003:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787893065.907062:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7788700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493337728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893065.907068:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493337600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787893065.907070:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787893065.907099:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787893065.907114:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c64b7100 x1874741493337728/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893081 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893065.907129:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493337600 00000100:00100000:0.0:1787893065.907131:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493337728:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787893065.907132:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493337600 00000100:00100000:3.0:1787893065.907162:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787893065.907169:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493337600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787893065.907181:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787893065.907224:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493337600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893065.907230:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:0.0:1787893065.907297:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e5f72a00 x1874741493337600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893081 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893065.907312:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493337600:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787893065.907399:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787893066.417773:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787893067.079329:0:13025:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787893067.445245:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893067.445680:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493337856:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787893067.445782:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893067.446014:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493337856 00000100:00100000:1.0:1787893067.446023:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493337856 00000100:00100000:1.0:1787893067.446078:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787893067.446095:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493337856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787893067.446129:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787893067.446182:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493337856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893067.446189:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787893067.446364:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493337856:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787893068.465942:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787893068.465985:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493337984:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787893068.466122:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787893068.466304:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893068.466378:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493337984 00000100:00100000:0.0:1787893068.466388:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493337984 00000100:00100000:0.0:1787893068.466440:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787893068.466449:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7db3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493337984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787893068.466480:0:7865:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787893068.466547:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7db3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493337984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893068.466555:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787893068.467095:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493337984:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787893068.978636:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787893068.978657:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493338496:0@lo:400:kworker.0 00000100:00100000:3.0:1787893068.978826:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893068.978834:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493338624:0@lo:400:kworker.0 00000100:00100000:2.0:1787893068.978873:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893068.978881:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493338112:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787893068.978896:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493339136:0@lo:400:kworker.0 00000100:00100000:3.0:1787893068.978915:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893068.978931:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893068.978949:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493339008:0@lo:400:kworker.0 00000100:00100000:2.0:1787893068.978958:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493339648:0@lo:400:kworker.0 00000100:00100000:3.0:1787893068.978979:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893068.978999:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493339520:0@lo:400:kworker.0 00000100:00100000:3.0:1787893068.979018:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893068.979056:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493338112 00000100:00100000:3.0:1787893068.979062:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493338112 00000100:00100000:3.0:1787893068.979106:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787893068.979115:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493338112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787893068.979141:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787893068.979181:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493338112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893068.979187:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787893068.979209:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493339136 00000100:00100000:3.0:1787893068.979212:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493339136 00000100:00100000:3.0:1787893068.979235:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493339008 00000100:00100000:3.0:1787893068.979238:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493339008 00000100:00100000:3.0:1787893068.979249:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493339520 00000100:00100000:3.0:1787893068.979251:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493339520 00000100:00100000:3.0:1787893068.979260:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787893068.979266:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493339136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893068.979296:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493339136:12345-0@lo:400:kworker.0 Request processed in 30us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893068.979302:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787893068.979313:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787893068.979318:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493339008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893068.979342:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493339008:12345-0@lo:400:kworker.0 Request processed in 25us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893068.979348:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787893068.979357:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893068.979361:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787893068.979369:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493339520:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1787893068.979397:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb9a300 x1874741493339136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893068.979410:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493339136:0@lo:400:kworker.0 00000100:00100000:2.0:1787893068.979436:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493338240:0@lo:400:kworker.0 00000100:00100000:3.0:1787893068.979760:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493339520:12345-0@lo:400:kworker.0 Request processed in 333us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893068.979773:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787893068.979783:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493339648 00000100:00100000:3.0:1787893068.979786:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493339648 00000100:00100000:3.0:1787893068.979800:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787893068.979805:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493339648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893068.979875:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493339648:12345-0@lo:400:kworker.0 Request processed in 70us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893068.979881:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:3.0:1787893068.979908:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb98700 x1874741493339008/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893068.979918:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493339008:0@lo:400:kworker.0 00010000:00080000:3.0:1787893068.979927:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb9b100 x1874741493339520/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893068.979935:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493339520:0@lo:400:kworker.0 00010000:00080000:3.0:1787893068.979944:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffbde300 x1874741493338112/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893084 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893068.979955:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493338112:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787893068.980202:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893068.980235:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493338752:0@lo:400:kworker.0 00000100:00100000:2.0:1787893068.980325:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893068.980344:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1874741493339264:0@lo:400:kworker.0 00000100:00100000:2.0:1787893068.980364:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893068.980389:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493339776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787893068.980408:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893068.980427:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787893068.980433:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493338368:0@lo:400:kworker.0 00000100:00100000:2.0:1787893068.980453:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893068.980470:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493338880:0@lo:400:kworker.0 00000100:00100000:2.0:1787893068.980753:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893068.980776:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1874741493339392:0@lo:400:kworker.0 00000100:00100000:3.0:1787893068.980803:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493338240 00000100:00100000:3.0:1787893068.980810:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493338240 00000100:00100000:2.0:1787893068.980811:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893068.980848:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1787893068.980849:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493338496 00000100:00100000:2.0:1787893068.980855:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493338496 00000100:00100000:3.0:1787893068.980858:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ec8bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+24:3630:x1874741493338240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893068.980884:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493338752 00000100:00100000:2.0:1787893068.980888:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493338752 00000100:00100000:3.0:1787893068.980900:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ec8bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+24:3630:x1874741493338240:12345-0@lo:400:kworker.0 Request processed in 43us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893068.980904:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493339264 00000100:00100000:2.0:1787893068.980907:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493339264 00000100:00100000:3.0:1787893068.980908:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1787893068.980921:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493338368 00000100:00100000:2.0:1787893068.980924:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493338368 00000100:00100000:2.0:1787893068.980938:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493338880 00000100:00100000:2.0:1787893068.980941:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493338880 00000100:00100000:2.0:1787893068.980953:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493339392 00000100:00100000:2.0:1787893068.980955:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493339392 00000100:00100000:2.0:1787893068.980966:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1787893068.980972:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493338496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893068.981748:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493338496:12345-0@lo:400:kworker.0 Request processed in 773us (2920us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893068.981757:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1787893068.981778:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1787893068.981787:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493338752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893068.981816:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493338752:12345-0@lo:400:kworker.0 Request processed in 32us (1491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893068.981821:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1787893068.981832:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1787893068.981839:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874741493339264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893068.981872:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874741493339264:12345-0@lo:400:kworker.0 Request processed in 33us (1506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893068.981879:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1787893068.981899:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787893068.981905:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493338368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893068.981937:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493338368:12345-0@lo:400:kworker.0 Request processed in 32us (1483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893068.981943:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787893068.981955:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1787893068.981962:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493338880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893068.982010:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493338880:12345-0@lo:400:kworker.0 Request processed in 49us (1519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893068.982016:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1787893068.982173:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1787893068.982182:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1874741493339392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893068.982217:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1874741493339392:12345-0@lo:400:kworker.0 Request processed in 37us (1406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893068.982224:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00010000:00080000:1.0:1787893068.982691:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb9ad80 x1874741493339648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893068.982713:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493339648:0@lo:400:kworker.0 00000100:00100000:1.0:1787893068.982745:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493339776 00000100:00100000:1.0:1787893068.982751:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493339776 00000100:00100000:1.0:1787893068.982787:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787893068.982795:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7526d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493339776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787893068.982808:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787893068.982842:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7526d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493339776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (2432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893068.982849:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787893068.983152:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493338624 00000100:00100000:2.0:1787893068.983157:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493338624 00000100:00100000:2.0:1787893068.983200:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787893068.983208:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493338624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893068.983259:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493338624:12345-0@lo:400:kworker.0 Request processed in 51us (4385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893068.983266:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:2.0:1787893068.983294:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787893068.983299:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787893068.983302:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787893068.983305:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787893068.983349:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493338368:0@lo:400:kworker.0 00010000:00080000:2.0:1787893068.983374:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb9b800 x1874741493338880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893068.983384:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493338880:0@lo:400:kworker.0 00010000:00080000:2.0:1787893068.983395:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb99880 x1874741493339392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893068.983404:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1874741493339392:0@lo:400:kworker.0 00010000:00080000:2.0:1787893068.983415:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c64b5c00 x1874741493339776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893084 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893068.983429:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493339776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787893068.983444:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493338240:0@lo:400:kworker.0 00000100:00100000:2.0:1787893068.983455:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493338752:0@lo:400:kworker.0 00000100:00100000:2.0:1787893068.983466:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1874741493339264:0@lo:400:kworker.0 00000100:00100000:1.0:1787893068.983664:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493338624:0@lo:400:kworker.0 00000100:00100000:2.0:1787893068.984242:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493338496:0@lo:400:kworker.0 00010000:00010000:0.0:1787893069.490924:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893069.856792:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893069.856862:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893069.859804:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893069.859836:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893069.859963:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481721088 00000100:00100000:2.0:1787893069.859974:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481721088 00000100:00100000:2.0:1787893069.860039:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481721344 00000100:00100000:2.0:1787893069.860043:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481721344 00000100:00100000:2.0:1787893069.860067:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 207 00000100:00100000:2.0:1787893069.860087:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+6:2393:x1874741481721088:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893069.860157:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+6:2393:x1874741481721088:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 83us (3373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893069.860165:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 207 00000100:00100000:2.0:1787893069.860208:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 208 00000100:00100000:2.0:1787893069.860215:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2393:x1874741481721344:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893069.860243:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2393:x1874741481721344:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 28us (3380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893069.860249:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 208 00000100:00080000:2.0:1787893069.860780:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787893069.862781:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893069.862821:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481720960 00000100:00100000:1.0:1787893069.862830:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481720960 00000100:00100000:1.0:1787893069.862880:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 317 00000100:00100000:1.0:1787893069.862891:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ec8b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2393:x1874741481720960:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893069.862969:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ec8b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2393:x1874741481720960:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 80us (3173us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893069.862976:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 317 00000100:00100000:1.0:1787893069.863576:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481721216 00000100:00100000:1.0:1787893069.863581:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481721216 00000100:00100000:1.0:1787893069.863620:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481721472 00000100:00100000:1.0:1787893069.863623:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481721472 00000100:00100000:1.0:1787893069.863644:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 209 00000100:00100000:1.0:1787893069.863651:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7116300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+5:2393:x1874741481721216:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893069.863690:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7116300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+5:2393:x1874741481721216:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 39us (3853us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893069.863697:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 209 00000100:00100000:1.0:1787893069.863709:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 210 00000100:00100000:1.0:1787893069.863715:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7115880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2393:x1874741481721472:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893069.863736:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7115880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2393:x1874741481721472:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 23us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893069.863742:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 210 00000100:00080000:1.0:1787893069.863757:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787893070.513691:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893071.026938:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493339904:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787893071.027038:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893071.027110:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493339904 00000100:00100000:0.0:1787893071.027117:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493339904 00000100:00100000:0.0:1787893071.027166:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787893071.027175:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493339904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787893071.027203:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787893071.027258:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493339904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893071.027265:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:0.0:1787893071.027291:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787893071.027321:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c76f4380 x1874741493339904/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893087 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893071.027338:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493339904:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787893071.028423:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493340032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787893071.028464:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893071.028942:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493340032 00000100:00100000:2.0:1787893071.028950:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493340032 00000100:00100000:2.0:1787893071.029000:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787893071.029007:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493340032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787893071.029024:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787893071.029067:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493340032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893071.029074:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:2.0:1787893071.029092:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787893071.029112:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7527800 x1874741493340032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893087 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893071.029127:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493340032:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1787893071.429875:0:13173:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc28c534c0 20000000:00000080:3.0:1787893071.429890:0:13173:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fc9e7156c00 uarg=0000000000000000 20000000:01000000:3.0:1787893071.429928:0:13173:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787893071.429934:0:13173:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787893071.429938:0:13173:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787893071.437122:0:13174:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1787893071.437952:0:13173:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787893071.454088:0:13173:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787893071.454220:0:13173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0d25 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893071.454255:0:13173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9fe541400/0x9232577658cf0cb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa653 expref: 12 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893071.454266:0:13173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc8c771fe00/0x9232577658cf0cc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0cbc expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893071.454332:0:13173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9fe540e00/0x9232577658cf0cd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0cca expref: 23 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893071.454341:0:13173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9fe541200/0x9232577658cf0cdf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0cd8 expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893071.454348:0:13173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9fe540600/0x9232577658cf0ced lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0ce6 expref: 23 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893071.454354:0:13173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9edb31600/0x9232577658cf0d02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa692 expref: 12 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893071.454360:0:13173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0d25 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893071.454402:0:13173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9edb31600/0x9232577658cf0d02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa692 expref: 12 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893071.454419:0:13173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc9edb31600/0x9232577658cf0d02 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa692 expref: 12 pid: 6497 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893071.454434:0:13173:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13173:1874741493340160:192.168.202.35@tcp:104: 00010000:00010000:0.0:1787893071.455185:0:13173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9fe540600/0x9232577658cf0ced lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf0ce6 expref: 23 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893071.455203:0:13173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc9fe540600/0x9232577658cf0ced lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf0ce6 expref: 23 pid: 6497 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893071.455214:0:13173:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13173:1874741493340288:0@lo:104: 00000100:00100000:0.0:1787893071.455258:0:13173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787893071.455314:0:13173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9fe541200/0x9232577658cf0cdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf0cd8 expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893071.455321:0:13173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc9fe541200/0x9232577658cf0cdf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf0cd8 expref: 23 pid: 6500 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893071.455329:0:13173:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13173:1874741493340416:0@lo:104: 00000100:00100000:0.0:1787893071.455349:0:13173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787893071.455377:0:13173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9fe540e00/0x9232577658cf0cd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf0cca expref: 23 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893071.455385:0:13173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc9fe540e00/0x9232577658cf0cd1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf0cca expref: 23 pid: 6499 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893071.455392:0:13173:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13173:1874741493340544:0@lo:104: 00000100:00100000:0.0:1787893071.455413:0:13173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787893071.455429:0:13173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc8c771fe00/0x9232577658cf0cc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf0cbc expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893071.455436:0:13173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc8c771fe00/0x9232577658cf0cc3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf0cbc expref: 23 pid: 6500 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893071.455442:0:13173:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13173:1874741493340672:0@lo:104: 00000100:00100000:0.0:1787893071.455470:0:13173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787893071.455509:0:13173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9fe541400/0x9232577658cf0cb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa653 expref: 12 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893071.455518:0:13173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc9fe541400/0x9232577658cf0cb5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa653 expref: 12 pid: 6500 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893071.455527:0:13173:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f72a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13173:1874741493340800:192.168.202.35@tcp:104: 00000100:00100000:0.0:1787893071.455626:0:13173:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c67dc540 going to sleep for 11 seconds 00000100:00100000:3.0:1787893071.455815:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493340288 00000100:00100000:3.0:1787893071.455823:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493340288 00000100:00100000:3.0:1787893071.455864:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493340416 00000100:00100000:3.0:1787893071.455868:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493340416 00000100:00100000:3.0:1787893071.455880:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493340544 00000100:00100000:3.0:1787893071.455883:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493340544 00000100:00100000:3.0:1787893071.455891:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493340672 00000100:00100000:3.0:1787893071.455894:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493340672 00000100:00100000:3.0:1787893071.455906:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787893071.455914:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+6:13173:x1874741493340288:12345-0@lo:104: 00010000:00010000:3.0:1787893071.455926:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30e00/0x9232577658cf0ce6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0ced expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893071.455997:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787893071.456011:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+6:13173:x1874741493340288:12345-0@lo:104: Request processed in 91us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893071.456018:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787893071.456035:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787893071.456041:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+5:13173:x1874741493340416:12345-0@lo:104: 00010000:00010000:3.0:1787893071.456048:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31e00/0x9232577658cf0cd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0cdf expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893071.456089:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787893071.456094:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+5:13173:x1874741493340416:12345-0@lo:104: Request processed in 54us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893071.456100:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787893071.456112:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787893071.456118:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+4:13173:x1874741493340544:12345-0@lo:104: 00010000:00010000:3.0:1787893071.456125:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541c00/0x9232577658cf0cca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0cd1 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893071.456169:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787893071.456174:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+4:13173:x1874741493340544:12345-0@lo:104: Request processed in 58us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893071.456179:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787893071.456191:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787893071.456197:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+3:13173:x1874741493340672:12345-0@lo:104: 00010000:00010000:3.0:1787893071.456204:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31000/0x9232577658cf0cbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0cc3 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893071.456228:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787893071.456233:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ad7764-cf95-4087-88aa-57e4229a8397+3:13173:x1874741493340672:12345-0@lo:104: Request processed in 36us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893071.456238:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1787893071.456253:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787893071.456259:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30e00/0x9232577658cf0ce6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0ced expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893071.456265:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30e00 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:3.0:1787893071.456275:0:6493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30e00/0x9232577658cf0ce6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf0ced expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893071.456283:0:6493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30e00/0x9232577658cf0ce6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf0ced expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787893071.456289:0:6493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30e00/0x9232577658cf0ce6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf0ced expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787893071.456295:0:6493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787893071.456324:0:6493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30e00/0x9232577658cf0ce6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0ced expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893071.456331:0:6493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787893071.456356:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30e00/0x9232577658cf0ce6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0ced expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893071.456363:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30e00/0x9232577658cf0ce6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0ced expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893071.456375:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787893071.456378:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31e00/0x9232577658cf0cd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0cdf expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893071.456383:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31e00 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:3.0:1787893071.456386:0:6493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31e00/0x9232577658cf0cd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf0cdf expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893071.456392:0:6493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31e00/0x9232577658cf0cd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf0cdf expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787893071.456407:0:6493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31e00/0x9232577658cf0cd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf0cdf expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787893071.456411:0:6493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787893071.456426:0:6493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31e00/0x9232577658cf0cd8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0cdf expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893071.456431:0:6493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787893071.456443:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31e00/0x9232577658cf0cd8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0cdf expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893071.456449:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31e00/0x9232577658cf0cd8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0cdf expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893071.456458:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787893071.456460:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541c00/0x9232577658cf0cca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0cd1 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893071.456465:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe541c00 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:3.0:1787893071.456467:0:6493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541c00/0x9232577658cf0cca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf0cd1 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893071.456472:0:6493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541c00/0x9232577658cf0cca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf0cd1 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787893071.456478:0:6493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541c00/0x9232577658cf0cca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf0cd1 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787893071.456482:0:6493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787893071.456523:0:6493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541c00/0x9232577658cf0cca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0cd1 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893071.456529:0:6493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787893071.456535:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541c00/0x9232577658cf0cca lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0cd1 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893071.456541:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541c00/0x9232577658cf0cca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0cd1 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893071.457450:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787893071.457468:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493340928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787893071.457541:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893071.457603:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493341056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787893071.457628:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893071.457650:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787893071.457656:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493341184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787893071.457823:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893071.457863:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493340928 00000100:00100000:2.0:1787893071.457869:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493340928 00010000:00010000:2.0:1787893071.457898:0:6490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9fe540600/0x9232577658cf0ced lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0ce6 expref: 24 pid: 6497 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893071.457923:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493341056 00000100:00100000:2.0:1787893071.457926:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493341056 00010000:00010000:2.0:1787893071.457937:0:6490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9fe541200/0x9232577658cf0cdf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0cd8 expref: 25 pid: 6500 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893071.457945:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493341184 00000100:00100000:2.0:1787893071.457947:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493341184 00010000:00010000:2.0:1787893071.457955:0:6490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9fe540e00/0x9232577658cf0cd1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0cca expref: 26 pid: 6499 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893071.457968:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787893071.457974:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7527800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ad7764-cf95-4087-88aa-57e4229a8397+26:3632:x1874741493340928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787893071.457985:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893071.457989:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9fe540600/0x9232577658cf0ced lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0ce6 expref: 26 pid: 6497 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893071.457999:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9fe540600/0x9232577658cf0ced lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf0ce6 expref: 26 pid: 6497 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893071.458258:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893071.458302:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7527800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ad7764-cf95-4087-88aa-57e4229a8397+26:3632:x1874741493340928:12345-0@lo:103:ldlm_bl.0 Request processed in 328us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893071.458310:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787893071.458328:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787893071.458342:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7db1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ad7764-cf95-4087-88aa-57e4229a8397+25:3630:x1874741493341056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787893071.458350:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893071.458354:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9fe541200/0x9232577658cf0cdf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0cd8 expref: 25 pid: 6500 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893071.458361:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9fe541200/0x9232577658cf0cdf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf0cd8 expref: 25 pid: 6500 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893071.458370:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893071.458394:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7db1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ad7764-cf95-4087-88aa-57e4229a8397+25:3630:x1874741493341056:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893071.458399:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787893071.458411:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787893071.458416:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7db0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ad7764-cf95-4087-88aa-57e4229a8397+24:3630:x1874741493341184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787893071.458423:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893071.458427:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9fe540e00/0x9232577658cf0cd1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0cca expref: 24 pid: 6499 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893071.458434:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9fe540e00/0x9232577658cf0cd1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf0cca expref: 24 pid: 6499 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893071.458443:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893071.458463:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7db0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ad7764-cf95-4087-88aa-57e4229a8397+24:3630:x1874741493341184:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893071.458469:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787893071.458528:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493340928:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787893071.458807:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787893071.458812:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31000/0x9232577658cf0cbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0cc3 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893071.458819:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31000 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:3.0:1787893071.458823:0:6493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31000/0x9232577658cf0cbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf0cc3 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893071.458830:0:6493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31000/0x9232577658cf0cbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf0cc3 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787893071.458836:0:6493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31000/0x9232577658cf0cbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf0cc3 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787893071.458842:0:6493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787893071.458865:0:6493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31000/0x9232577658cf0cbc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0cc3 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893071.458871:0:6493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787893071.458956:0:13173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9fe540600/0x9232577658cf0ced lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf0ce6 expref: 23 pid: 6497 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893071.458966:0:13173:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13173:1874741493340288:0@lo:104: 00010000:00010000:0.0:1787893071.458976:0:13173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9fe541200/0x9232577658cf0cdf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf0cd8 expref: 22 pid: 6500 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893071.458983:0:13173:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13173:1874741493340416:0@lo:104: 00010000:00010000:0.0:1787893071.458991:0:13173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9fe540e00/0x9232577658cf0cd1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf0cca expref: 21 pid: 6499 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893071.458997:0:13173:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13173:1874741493340544:0@lo:104: 00000100:00100000:0.0:1787893071.459015:0:13173:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13173:1874741493340672:0@lo:104: 00000100:00100000:2.0:1787893071.459121:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493341184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787893071.459129:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493341056:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787893071.459185:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893071.459190:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893071.459205:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787893071.459214:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493341312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787893071.459245:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893071.459301:0:10383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493341312 00000100:00100000:2.0:1787893071.459306:0:10383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493341312 00010000:00010000:2.0:1787893071.459325:0:10383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc8c771fe00/0x9232577658cf0cc3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0cbc expref: 21 pid: 6500 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893071.459345:0:10383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787893071.459352:0:10383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7db2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:19ad7764-cf95-4087-88aa-57e4229a8397+21:3633:x1874741493341312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787893071.459360:0:10383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893071.459364:0:10383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc8c771fe00/0x9232577658cf0cc3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0cbc expref: 21 pid: 6500 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893071.459372:0:10383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc8c771fe00/0x9232577658cf0cc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf0cbc expref: 21 pid: 6500 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893071.459383:0:10383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c771fe00/0x9232577658cf0cc3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf0cbc expref: 21 pid: 6500 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893071.459390:0:10383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893071.459417:0:10383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7db2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:19ad7764-cf95-4087-88aa-57e4229a8397+20:3633:x1874741493341312:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893071.459423:0:10383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787893071.459448:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493341312:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787893071.467885:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31000/0x9232577658cf0cbc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0cc3 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893071.467920:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31000/0x9232577658cf0cbc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0cc3 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893071.468012:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893071.468020:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893071.468022:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893071.468206:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893071.468541:0:13173:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13173:1874741493340160:192.168.202.35@tcp:104: 00000100:00100000:0.0:1787893071.468567:0:13173:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f72a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13173:1874741493340800:192.168.202.35@tcp:104: 00010000:00010000:0.0:1787893071.468635:0:13173:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0d25 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893071.468939:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481721728 00000100:00100000:2.0:1787893071.468946:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481721728 00010000:00010000:2.0:1787893071.468982:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9fe541400/0x9232577658cf0cb5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa653 expref: 13 pid: 6500 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893071.469028:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 44 00000100:00100000:2.0:1787893071.469038:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7117480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2392:x1874741481721728:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787893071.469051:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893071.469057:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9fe541400/0x9232577658cf0cb5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa653 expref: 13 pid: 6500 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893071.469067:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9fe541400/0x9232577658cf0cb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa653 expref: 13 pid: 6500 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893071.469082:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9fe541400/0x9232577658cf0cb5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa653 expref: 13 pid: 6500 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893071.469096:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893071.469146:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7117480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+12:2392:x1874741481721728:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 109us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893071.469153:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 44 00000100:00100000:1.0:1787893071.469245:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893071.469608:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481721600 00000100:00100000:2.0:1787893071.469614:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481721600 00010000:00010000:2.0:1787893071.469633:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9edb31600/0x9232577658cf0d02 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa692 expref: 12 pid: 6497 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893071.469675:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 45 00000100:00100000:2.0:1787893071.469683:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+12:2393:x1874741481721600:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787893071.469711:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893071.469717:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9edb31600/0x9232577658cf0d02 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa692 expref: 12 pid: 6497 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893071.469727:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9edb31600/0x9232577658cf0d02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa692 expref: 12 pid: 6497 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893071.469738:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9edb31600/0x9232577658cf0d02 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa692 expref: 12 pid: 6497 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893071.469750:0:6492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0d25 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893071.469758:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0d25 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893071.469771:0:6492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0d25 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893071.469777:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0d25 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893071.469783:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0d25 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893071.469789:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0d25 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893071.469794:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30c00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787893071.469798:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0d25 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893071.469815:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0d25 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893071.469826:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0d25 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893071.469835:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893071.469859:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+11:2393:x1874741481721600:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 177us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893071.469865:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 45 00010000:00010000:0.0:1787893071.470118:0:13173:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0d25 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893071.470132:0:13173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0d25 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893071.470139:0:13173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0d25 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893071.544290:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893072.562091:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893072.562388:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787893072.562408:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493341440:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787893072.562487:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893072.562584:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493341440 00000100:00100000:2.0:1787893072.562592:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493341440 00000100:00100000:2.0:1787893072.562641:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787893072.562650:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7db0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493341440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787893072.562684:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787893072.562800:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7db0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493341440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 151us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893072.562808:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787893072.562865:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493341440:0@lo:41:osp-pre-1-0.0 10000000:01000000:0.0:1787893073.073940:0:6502:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787893073.073947:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc9e70bc000 from 7 10000000:01000000:0.0:1787893073.073953:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787893073.074012:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31a00/0x9232577658cf0d2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893073.074024:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31a00/0x9232577658cf0d2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893073.074035:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31a00/0x9232577658cf0d2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893073.074061:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f72a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493341568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787893073.074320:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893073.074373:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c67dc540 going to sleep for 11 seconds 00000100:00100000:2.0:1787893073.074437:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493341568 00000100:00100000:2.0:1787893073.074445:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493341568 00000100:00100000:2.0:1787893073.074544:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1787893073.074553:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ec8b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+20:6502:x1874741493341568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787893073.074579:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893073.074609:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c771ec00/0x9232577658cf0d33 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0d2c expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893073.074635:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c771ec00/0x9232577658cf0d33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0d2c expref: 21 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893073.074647:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c771ec00/0x9232577658cf0d33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0d2c expref: 21 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893073.074658:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c771ec00, rc 0) 00000100:00100000:3.0:1787893073.074887:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ec8b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+21:6502:x1874741493341568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 334us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893073.074894:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1787893073.075773:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f72a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493341568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787893073.075796:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31a00/0x9232577658cf0d2c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0d33 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893073.075808:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31a00/0x9232577658cf0d2c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0d33 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893073.075880:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493341696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787893073.075926:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893073.075964:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fd080a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787893073.076068:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493341696 00000100:00100000:3.0:1787893073.076074:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493341696 00000100:00100000:3.0:1787893073.076181:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1787893073.076191:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ec8b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+21:6502:x1874741493341696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787893073.076379:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ec8b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+21:6502:x1874741493341696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 188us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893073.076386:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1787893073.076452:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493341696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787893073.076553:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f72a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493341824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787893073.076594:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893073.076616:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c67dcf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787893073.076828:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493341824 00000100:00100000:3.0:1787893073.076833:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493341824 00000100:00100000:3.0:1787893073.076865:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1787893073.076874:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+21:6502:x1874741493341824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787893073.076957:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+21:6502:x1874741493341824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893073.076964:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1787893073.077185:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f72a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493341824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787893073.089437:0:13207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787893073.089996:0:6502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787893073.090034:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787893073.090046:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31a00/0x9232577658cf0d2c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0d33 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893073.090058:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31a00/0x9232577658cf0d2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0d33 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893073.090087:0:6502:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787893073.090089:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc9fe136000 from 7 10000000:01000000:2.0:1787893073.090092:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787893073.090130:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c771ee00/0x9232577658cf0d3a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893073.090138:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc8c771ee00/0x9232577658cf0d3a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893073.090149:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc8c771ee00/0x9232577658cf0d3a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893073.090177:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493341952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787893073.090243:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893073.090281:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fd080a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787893073.090300:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493341952 00000100:00100000:2.0:1787893073.090307:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493341952 00000100:00100000:2.0:1787893073.090358:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1787893073.090368:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+21:6502:x1874741493341952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787893073.090381:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893073.090393:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c771fe00/0x9232577658cf0d41 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0d3a expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893073.090416:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c771fe00/0x9232577658cf0d41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0d3a expref: 22 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893073.090428:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c771fe00/0x9232577658cf0d41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0d3a expref: 22 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893073.090447:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c771fe00, rc 0) 00000100:00100000:2.0:1787893073.090518:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+22:6502:x1874741493341952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893073.090525:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1787893073.091247:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493341952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787893073.091268:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc8c771ee00/0x9232577658cf0d3a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0d41 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893073.091289:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc8c771ee00/0x9232577658cf0d3a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0d41 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893073.091360:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7116a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493342080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787893073.091395:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893073.091429:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c73f9180 going to sleep for 11 seconds 00000100:00100000:1.0:1787893073.091823:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493342080 00000100:00100000:1.0:1787893073.091830:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493342080 00000100:00100000:1.0:1787893073.091877:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1787893073.091886:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+22:6502:x1874741493342080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787893073.096006:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+22:6502:x1874741493342080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 4111us (4600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893073.096021:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1787893073.097892:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7116a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493342080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787893073.097962:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493342208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787893073.098034:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893073.098068:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c5c9fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787893073.098091:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493342208 00000100:00100000:2.0:1787893073.098096:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493342208 00000100:00100000:2.0:1787893073.098139:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1787893073.098147:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+22:6502:x1874741493342208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787893073.098259:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+22:6502:x1874741493342208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 112us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893073.098266:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1787893073.098316:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493342208:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787893073.099262:0:13209:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787893073.099422:0:6502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787893073.099443:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787893073.099453:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c771ee00/0x9232577658cf0d3a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0d41 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893073.099464:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc8c771ee00/0x9232577658cf0d3a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0d41 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893073.099475:0:6502:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787893073.099477:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc9ed573800 from 7 10000000:01000000:1.0:1787893073.099480:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787893073.099551:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541a00/0x9232577658cf0d48 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893073.099559:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541a00/0x9232577658cf0d48 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893073.099579:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541a00/0x9232577658cf0d48 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893073.099607:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7114380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493342336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787893073.099650:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893073.099682:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c73f9480 going to sleep for 11 seconds 00000100:00100000:2.0:1787893073.100004:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493342336 00000100:00100000:2.0:1787893073.100010:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493342336 00000100:00100000:2.0:1787893073.100055:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1787893073.100064:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+22:6502:x1874741493342336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787893073.100075:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893073.100086:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c771e400/0x9232577658cf0d4f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0d48 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893073.100119:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c771e400/0x9232577658cf0d4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0d48 expref: 23 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893073.100129:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c771e400/0x9232577658cf0d4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0d48 expref: 23 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893073.100137:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c771e400, rc 0) 00000100:00100000:2.0:1787893073.100183:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+23:6502:x1874741493342336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893073.100189:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1787893073.100293:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7114380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493342336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787893073.100305:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541a00/0x9232577658cf0d48 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0d4f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893073.100313:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541a00/0x9232577658cf0d48 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0d4f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893073.100369:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7114380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493342464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787893073.100391:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893073.100417:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c73f9480 going to sleep for 11 seconds 00000100:00100000:2.0:1787893073.102297:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493342464 00000100:00100000:2.0:1787893073.102309:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493342464 00000100:00100000:2.0:1787893073.102376:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1787893073.102387:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+23:6502:x1874741493342464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787893073.102746:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7114380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493342464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787893073.102788:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7114380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493342592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787893073.102847:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893073.102873:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c73f9480 going to sleep for 11 seconds 00000100:00100000:1.0:1787893073.102888:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493342592 00000100:00100000:1.0:1787893073.102892:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493342592 00000100:00100000:1.0:1787893073.102916:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1787893073.102923:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+24:6502:x1874741493342592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787893073.103001:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+24:6502:x1874741493342592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893073.103015:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1787893073.103072:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7114380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493342592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787893073.103784:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+23:6502:x1874741493342464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 206us (2199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893073.103796:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000040:00080000:1.0:1787893073.103980:0:13210:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787893073.105746:0:6502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787893073.105779:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787893073.105792:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541a00/0x9232577658cf0d48 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0d4f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893073.105805:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541a00/0x9232577658cf0d48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0d4f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893073.105815:0:6502:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787893073.105818:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc9d909c800 from 7 10000000:01000000:2.0:1787893073.105826:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787893073.105861:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c771fa00/0x9232577658cf0d56 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893073.105869:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc8c771fa00/0x9232577658cf0d56 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893073.105879:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc8c771fa00/0x9232577658cf0d56 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893073.105901:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493342720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787893073.105958:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893073.105994:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e72b36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787893073.106779:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493342720 00000100:00100000:1.0:1787893073.106791:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493342720 00000100:00100000:1.0:1787893073.106850:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1787893073.106859:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+23:6502:x1874741493342720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787893073.106873:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893073.106885:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9fe540a00/0x9232577658cf0d5d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0d56 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893073.106909:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9fe540a00/0x9232577658cf0d5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0d56 expref: 24 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893073.106919:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9fe540a00/0x9232577658cf0d5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0d56 expref: 24 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893073.106927:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe540a00, rc 0) 00000100:00100000:1.0:1787893073.106976:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+24:6502:x1874741493342720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893073.106983:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1787893073.114980:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493342720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787893073.115010:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc8c771fa00/0x9232577658cf0d56 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0d5d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893073.115024:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc8c771fa00/0x9232577658cf0d56 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0d5d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893073.115119:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493342848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787893073.115197:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893073.115247:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e72b36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787893073.116000:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493342848 00000100:00100000:3.0:1787893073.116009:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493342848 00000100:00100000:3.0:1787893073.116070:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1787893073.116080:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+24:6502:x1874741493342848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787893073.116228:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+24:6502:x1874741493342848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 149us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893073.116235:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1787893073.116312:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493342848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787893073.116346:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493342976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787893073.116386:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893073.116418:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e72b36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787893073.123428:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493342976 00000100:00100000:3.0:1787893073.123444:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493342976 00000100:00100000:3.0:1787893073.123541:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1787893073.123553:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+24:6502:x1874741493342976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787893073.123731:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+24:6502:x1874741493342976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 180us (7343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893073.123738:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1787893073.123912:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493342976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787893073.124726:0:13211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787893073.124925:0:6502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787893073.124952:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787893073.124963:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c771fa00/0x9232577658cf0d56 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0d5d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893073.124974:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc8c771fa00/0x9232577658cf0d56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0d5d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893073.435643:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893073.436085:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481721856 00000100:00100000:2.0:1787893073.436096:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481721856 00000100:00100000:2.0:1787893073.436166:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 330 00000100:00100000:2.0:1787893073.436177:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+11:6165:x1874741481721856:12345-192.168.202.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787893073.436205:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893073.436226:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c771f600/0x9232577658cf0d64 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa6c3 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893073.436257:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c771f600/0x9232577658cf0d64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa6c3 expref: 12 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893073.436269:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c771f600/0x9232577658cf0d64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa6c3 expref: 12 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893073.436278:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c771f600, rc 0) 00000100:00100000:2.0:1787893073.436343:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+12:6165:x1874741481721856:12345-192.168.202.35@tcp:101:ll_cfg_requeue.0 Request processed in 167us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893073.436349:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 330 00000100:00100000:2.0:1787893073.439475:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893073.442118:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481721984 00000100:00100000:1.0:1787893073.442132:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481721984 00000100:00100000:1.0:1787893073.442219:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 331 00000100:00100000:1.0:1787893073.442231:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+12:6165:x1874741481721984:12345-192.168.202.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787893073.442396:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+12:6165:x1874741481721984:12345-192.168.202.35@tcp:501:ll_cfg_requeue.0 Request processed in 167us (2929us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893073.442418:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 331 00000100:00100000:1.0:1787893073.451389:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893073.451520:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481722112 00000100:00100000:3.0:1787893073.451541:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481722112 00000100:00100000:3.0:1787893073.451605:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 332 00000100:00100000:3.0:1787893073.451616:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+12:6165:x1874741481722112:12345-192.168.202.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787893073.451762:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+12:6165:x1874741481722112:12345-192.168.202.35@tcp:503:ll_cfg_requeue.0 Request processed in 147us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893073.451769:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 332 00000100:00100000:3.0:1787893073.457161:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893073.457228:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481722240 00000100:00100000:1.0:1787893073.457239:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481722240 00000100:00100000:1.0:1787893073.457295:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 333 00000100:00100000:1.0:1787893073.457307:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+12:6165:x1874741481722240:12345-192.168.202.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787893073.457325:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893073.457343:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9fe541600/0x9232577658cf0d6b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa6ca expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893073.457376:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9fe541600/0x9232577658cf0d6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa6ca expref: 13 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893073.457388:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9fe541600/0x9232577658cf0d6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa6ca expref: 13 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893073.457397:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe541600, rc 0) 00000100:00100000:1.0:1787893073.457466:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:6165:x1874741481722240:12345-192.168.202.35@tcp:101:ll_cfg_requeue.0 Request processed in 161us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893073.457473:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 333 00000100:00100000:1.0:1787893073.459144:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893073.465724:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481722368 00000100:00100000:2.0:1787893073.465741:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481722368 00000100:00100000:3.0:1787893073.465911:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 334 00000100:00100000:3.0:1787893073.465920:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:6165:x1874741481722368:12345-192.168.202.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787893073.466063:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:6165:x1874741481722368:12345-192.168.202.35@tcp:501:ll_cfg_requeue.0 Request processed in 144us (6928us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893073.466069:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 334 00000100:00100000:2.0:1787893073.472230:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893073.472360:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481722496 00000100:00100000:3.0:1787893073.472371:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481722496 00000100:00100000:3.0:1787893073.472453:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 335 00000100:00100000:3.0:1787893073.472464:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:6165:x1874741481722496:12345-192.168.202.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787893073.472625:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:6165:x1874741481722496:12345-192.168.202.35@tcp:503:ll_cfg_requeue.0 Request processed in 162us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893073.472633:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 335 00010000:00010000:2.0:1787893073.585631:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893073.585727:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493343104:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787893073.585796:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893073.585957:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493343104 00000100:00100000:3.0:1787893073.585967:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493343104 00000100:00100000:3.0:1787893073.586052:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787893073.586062:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7db1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493343104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787893073.586100:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787893073.586161:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7db1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493343104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893073.586168:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787893073.586195:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493343104:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787893074.098008:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493343232:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787893074.098128:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893074.099371:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787893074.099388:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493343360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787893074.099433:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893074.099471:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493343232 00000100:00100000:1.0:1787893074.099478:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493343232 00000100:00100000:1.0:1787893074.099554:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493343360 00000100:00100000:1.0:1787893074.099564:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493343360 00000100:00100000:1.0:1787893074.099588:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787893074.099597:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493343232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787893074.099626:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787893074.099672:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493343232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (1545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893074.099680:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787893074.099697:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787893074.099703:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7115500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493343360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787893074.099712:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787893074.099740:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7115500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493343360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893074.099746:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:1.0:1787893074.099762:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787893074.100940:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffbdf800 x1874741493343232/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893090 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893074.100963:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493343232:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1787893074.101004:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e7114380 x1874741493343360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893090 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893074.101016:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493343360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787893074.102345:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787893074.102373:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493343488:0@lo:400:kworker.0 00000100:00100000:0.0:1787893074.102435:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893074.102502:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493343488 00000100:00100000:0.0:1787893074.102508:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493343488 00000100:00100000:0.0:1787893074.102562:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1787893074.102571:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+24:3632:x1874741493343488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893074.102616:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+24:3632:x1874741493343488:12345-0@lo:400:kworker.0 Request processed in 45us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893074.102623:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1787893074.102666:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493343488:0@lo:400:kworker.0 00000100:00100000:0.0:1787893074.102702:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493343616:0@lo:400:kworker.0 00000100:00100000:0.0:1787893074.102730:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893074.102759:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493343616 00000100:00100000:0.0:1787893074.102762:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493343616 00000100:00100000:0.0:1787893074.102806:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1787893074.102813:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493343616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893074.102855:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493343616:12345-0@lo:400:kworker.0 Request processed in 43us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893074.102861:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1787893074.102887:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493343616:0@lo:400:kworker.0 00000100:00100000:0.0:1787893074.102921:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1874741493343744:0@lo:400:kworker.0 00000100:00100000:0.0:1787893074.102944:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893074.102973:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493343744 00000100:00100000:0.0:1787893074.102977:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493343744 00000100:00100000:0.0:1787893074.103001:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1787893074.103006:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1874741493343744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893074.103050:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1874741493343744:12345-0@lo:400:kworker.0 Request processed in 43us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893074.103057:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1787893074.103085:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1874741493343744:0@lo:400:kworker.0 00000100:00100000:0.0:1787893074.103123:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493343872:0@lo:400:kworker.0 00000100:00100000:0.0:1787893074.103147:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893074.103175:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493343872 00000100:00100000:0.0:1787893074.103179:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493343872 00000100:00100000:0.0:1787893074.103203:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787893074.103209:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493343872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893074.103244:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493343872:12345-0@lo:400:kworker.0 Request processed in 35us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893074.103250:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787893074.103274:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493343872:0@lo:400:kworker.0 00000100:00100000:0.0:1787893074.103303:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787893074.103310:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493344000:0@lo:400:kworker.0 00000100:00100000:0.0:1787893074.103333:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893074.103355:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493344000 00000100:00100000:0.0:1787893074.103359:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493344000 00000100:00100000:0.0:1787893074.103392:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1787893074.103398:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493344000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893074.103429:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493344000:12345-0@lo:400:kworker.0 Request processed in 32us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893074.103435:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1787893074.103459:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493344000:0@lo:400:kworker.0 00000100:00080000:0.0:1787893074.103483:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787893074.103538:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493344128:0@lo:400:kworker.0 00000100:00100000:0.0:1787893074.103562:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893074.103585:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493344128 00000100:00100000:0.0:1787893074.103589:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493344128 00000100:00100000:0.0:1787893074.103612:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1787893074.103618:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493344128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893074.103652:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493344128:12345-0@lo:400:kworker.0 Request processed in 33us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893074.103658:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00010000:00080000:0.0:1787893074.103682:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c76f4380 x1874741493344128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893074.103692:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493344128:0@lo:400:kworker.0 00000100:00080000:0.0:1787893074.103706:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787893074.103729:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493344256:0@lo:400:kworker.0 00000100:00100000:0.0:1787893074.103753:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893074.103783:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493344256 00000100:00100000:0.0:1787893074.103786:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493344256 00000100:00100000:0.0:1787893074.103817:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787893074.103823:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493344256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893074.103856:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493344256:12345-0@lo:400:kworker.0 Request processed in 33us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893074.103863:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1787893074.103879:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787893074.103893:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c76f4380 x1874741493344256/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893074.103914:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493344256:0@lo:400:kworker.0 00000100:00100000:0.0:1787893074.103948:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493344384:0@lo:400:kworker.0 00000100:00100000:0.0:1787893074.103971:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893074.103997:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493344384 00000100:00100000:0.0:1787893074.104000:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493344384 00000100:00100000:0.0:1787893074.104026:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787893074.104032:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7200380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493344384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893074.104065:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7200380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493344384:12345-0@lo:400:kworker.0 Request processed in 34us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893074.104071:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:0.0:1787893074.104098:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c76f4380 x1874741493344384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893074.104107:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493344384:0@lo:400:kworker.0 00000100:00080000:0.0:1787893074.104121:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787893074.104139:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787893074.104145:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1874741493344512:0@lo:400:kworker.0 00000100:00100000:0.0:1787893074.104167:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893074.104191:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493344512 00000100:00100000:0.0:1787893074.104194:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493344512 00000100:00100000:0.0:1787893074.104219:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1787893074.104224:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1874741493344512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893074.104254:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1874741493344512:12345-0@lo:400:kworker.0 Request processed in 30us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893074.104259:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1787893074.104292:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1874741493344512:0@lo:400:kworker.0 00000100:00080000:0.0:1787893074.104305:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787893074.104328:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1874741493344640:0@lo:400:kworker.0 00000100:00100000:0.0:1787893074.104352:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893074.104380:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493344640 00000100:00100000:0.0:1787893074.104385:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493344640 00000100:00100000:0.0:1787893074.104409:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1787893074.104414:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1874741493344640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893074.104445:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1874741493344640:12345-0@lo:400:kworker.0 Request processed in 31us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893074.104451:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00010000:00080000:0.0:1787893074.104474:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e7202a00 x1874741493344640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893074.104483:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1874741493344640:0@lo:400:kworker.0 00000100:00080000:0.0:1787893074.104519:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787893074.611683:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893074.974153:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893074.974196:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893074.974270:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481722752 00000100:00100000:0.0:1787893074.974280:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481722752 00000100:00100000:0.0:1787893074.974357:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 217 00000100:00100000:0.0:1787893074.974369:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+6:2393:x1874741481722752:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893074.974444:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+6:2393:x1874741481722752:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 77us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893074.974453:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 217 00000100:00100000:3.0:1787893074.974697:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481722624 00000100:00100000:3.0:1787893074.974703:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481722624 00000100:00100000:3.0:1787893074.974764:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 337 00000100:00100000:3.0:1787893074.974771:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2393:x1874741481722624:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893074.974807:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2393:x1874741481722624:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 37us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893074.974814:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 337 00000100:00080000:1.0:1787893074.975308:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787893074.983873:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893074.983920:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893074.983965:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893074.983995:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481722880 00000100:00100000:1.0:1787893074.984005:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481722880 00000100:00100000:1.0:1787893074.984060:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481723008 00000100:00100000:1.0:1787893074.984063:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481723008 00000100:00100000:1.0:1787893074.984082:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481723136 00000100:00100000:1.0:1787893074.984085:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481723136 00000100:00100000:1.0:1787893074.984101:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 218 00000100:00100000:1.0:1787893074.984111:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+5:2392:x1874741481722880:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893074.984192:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+5:2392:x1874741481722880:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 83us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893074.984200:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 218 00000100:00100000:1.0:1787893074.984218:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 219 00000100:00100000:1.0:1787893074.984223:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7116a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2392:x1874741481723008:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893074.984250:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7116a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2392:x1874741481723008:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 27us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893074.984255:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 219 00000100:00100000:1.0:1787893074.984267:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 220 00000100:00100000:1.0:1787893074.984273:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2392:x1874741481723136:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893074.984296:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2392:x1874741481723136:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 24us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893074.984302:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 220 00000100:00080000:1.0:1787893074.984324:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787893074.984328:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787893075.633793:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893076.152540:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787893076.152565:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493344896:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787893076.152645:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893076.152719:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493344768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787893076.152744:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893076.152777:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493344896 00000100:00100000:1.0:1787893076.152784:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493344896 00000100:00100000:1.0:1787893076.152834:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493344768 00000100:00100000:1.0:1787893076.152837:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493344768 00000100:00100000:1.0:1787893076.152855:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787893076.152863:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c772df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493344896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787893076.152892:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787893076.152934:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c772df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493344896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893076.152941:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787893076.152957:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787893076.152963:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c772ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493344768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787893076.152973:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787893076.153000:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c772ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493344768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893076.153006:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:1.0:1787893076.153024:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787893076.153049:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7db1880 x1874741493344896/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893092 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893076.153066:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493344896:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1787893076.153091:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e711d180 x1874741493344768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893092 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893076.153102:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493344768:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1787893076.271054:0:13372:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg235-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787893076.657625:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893077.682611:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493345024:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787893077.682677:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893077.682686:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893077.682709:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493345024 00000100:00100000:3.0:1787893077.682717:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493345024 00000100:00100000:3.0:1787893077.682768:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787893077.682777:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c772dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493345024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787893077.682812:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787893077.682865:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c772dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493345024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893077.682872:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787893077.682950:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493345024:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787893078.706607:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893078.707521:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493345152:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787893078.707597:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893078.707805:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493345152 00000100:00100000:0.0:1787893078.707815:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493345152 00000100:00100000:0.0:1787893078.707870:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787893078.707880:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493345152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787893078.707933:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787893078.708005:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493345152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893078.708013:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787893078.708154:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493345152:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787893079.222604:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493345408:0@lo:400:kworker.0 00000100:00100000:3.0:1787893079.222675:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893079.222729:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493345920:0@lo:400:kworker.0 00000100:00100000:3.0:1787893079.222753:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893079.222777:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1874741493346432:0@lo:400:kworker.0 00000100:00100000:3.0:1787893079.222798:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893079.222825:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787893079.222830:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493345536:0@lo:400:kworker.0 00000100:00100000:3.0:1787893079.222853:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893079.222882:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493346048:0@lo:400:kworker.0 00000100:00100000:3.0:1787893079.222904:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893079.222922:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493346560:0@lo:400:kworker.0 00000100:00100000:3.0:1787893079.222942:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893079.222972:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493345408 00000100:00100000:3.0:1787893079.222979:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493345408 00000100:00100000:3.0:1787893079.223016:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493345920 00000100:00100000:3.0:1787893079.223019:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493345920 00000100:00100000:3.0:1787893079.223041:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493346432 00000100:00100000:3.0:1787893079.223044:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493346432 00000100:00100000:3.0:1787893079.223055:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493346048 00000100:00100000:3.0:1787893079.223058:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493346048 00000100:00100000:3.0:1787893079.223067:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493346560 00000100:00100000:3.0:1787893079.223069:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493346560 00000100:00100000:3.0:1787893079.223082:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787893079.223090:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493345408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893079.223140:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493345408:12345-0@lo:400:kworker.0 Request processed in 50us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893079.223146:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787893079.223161:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1787893079.223167:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493345920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893079.223192:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493345920:12345-0@lo:400:kworker.0 Request processed in 25us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893079.223197:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1787893079.223207:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787893079.223213:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1874741493346432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893079.223235:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1874741493346432:12345-0@lo:400:kworker.0 Request processed in 22us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893079.223250:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787893079.223262:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787893079.223267:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493346048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893079.223291:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493346048:12345-0@lo:400:kworker.0 Request processed in 25us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893079.223297:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787893079.223305:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787893079.223311:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493346560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893079.223331:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493346560:12345-0@lo:400:kworker.0 Request processed in 21us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893079.223336:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00080000:3.0:1787893079.223357:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787893079.223361:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787893079.223382:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffbde680 x1874741493346048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893079.223396:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493346048:0@lo:400:kworker.0 00010000:00080000:3.0:1787893079.223405:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb69500 x1874741493346560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893079.223412:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493346560:0@lo:400:kworker.0 00000100:00100000:3.0:1787893079.223420:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493345408:0@lo:400:kworker.0 00000100:00100000:3.0:1787893079.223429:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493345920:0@lo:400:kworker.0 00000100:00100000:3.0:1787893079.223437:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1874741493346432:0@lo:400:kworker.0 00000100:00100000:0.0:1787893079.223671:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493345280:0@lo:400:kworker.0 00000100:00100000:0.0:1787893079.223708:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893079.223731:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493345792:0@lo:400:kworker.0 00000100:00100000:0.0:1787893079.223752:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893079.223767:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493346304:0@lo:400:kworker.0 00000100:00100000:0.0:1787893079.223787:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893079.223804:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493346816:0@lo:400:kworker.0 00000100:00100000:0.0:1787893079.223821:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893079.223836:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787893079.223842:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1874741493345664:0@lo:400:kworker.0 00000100:00100000:0.0:1787893079.223862:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893079.223873:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493346176:0@lo:400:kworker.0 00000100:00100000:0.0:1787893079.223904:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893079.223919:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493346688:0@lo:400:kworker.0 00000100:00100000:0.0:1787893079.223938:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893079.223960:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493345536 00000100:00100000:0.0:1787893079.223964:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493345536 00000100:00100000:0.0:1787893079.223989:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493345792 00000100:00100000:0.0:1787893079.223992:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493345792 00000100:00100000:0.0:1787893079.224004:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787893079.224011:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493345536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893079.224056:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493345536:12345-0@lo:400:kworker.0 Request processed in 45us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893079.224063:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787893079.224076:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787893079.224081:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493345792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893079.224109:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493345792:12345-0@lo:400:kworker.0 Request processed in 27us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893079.224114:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787893079.224129:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493346304 00000100:00100000:0.0:1787893079.224132:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493346304 00000100:00100000:0.0:1787893079.224151:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493346816 00000100:00100000:0.0:1787893079.224154:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493346816 00000100:00100000:0.0:1787893079.224163:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493346176 00000100:00100000:0.0:1787893079.224165:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493346176 00000100:00100000:0.0:1787893079.224174:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493346688 00000100:00100000:0.0:1787893079.224176:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493346688 00000100:00100000:0.0:1787893079.224187:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787893079.224192:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493346304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893079.224218:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493346304:12345-0@lo:400:kworker.0 Request processed in 26us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893079.224223:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787893079.224233:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787893079.224237:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493346816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893079.224259:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493346816:12345-0@lo:400:kworker.0 Request processed in 21us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893079.224264:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787893079.224273:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787893079.224285:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493346176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893079.224309:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493346176:12345-0@lo:400:kworker.0 Request processed in 26us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893079.224315:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787893079.224324:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787893079.224329:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493346688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893079.224353:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493346688:12345-0@lo:400:kworker.0 Request processed in 23us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893079.224358:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:0.0:1787893079.224388:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb69880 x1874741493346176/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893079.224398:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493346176:0@lo:400:kworker.0 00010000:00080000:0.0:1787893079.224407:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb6d180 x1874741493346688/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893079.224416:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493346688:0@lo:400:kworker.0 00000100:00100000:0.0:1787893079.224424:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493345792:0@lo:400:kworker.0 00010000:00080000:0.0:1787893079.224432:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb68700 x1874741493346304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893079.224440:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493346304:0@lo:400:kworker.0 00010000:00080000:0.0:1787893079.224447:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb6ed80 x1874741493346816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893079.224455:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493346816:0@lo:400:kworker.0 00000100:00100000:0.0:1787893079.224531:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493345664 00000100:00100000:0.0:1787893079.224541:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493345664 00000100:00100000:0.0:1787893079.224563:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787893079.224569:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1874741493345664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893079.224601:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1874741493345664:12345-0@lo:400:kworker.0 Request processed in 31us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893079.224606:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787893079.224628:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1874741493345664:0@lo:400:kworker.0 00000100:00100000:3.0:1787893079.228668:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493345280 00000100:00100000:3.0:1787893079.228701:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493345280 00000100:00100000:3.0:1787893079.228778:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1787893079.228788:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+24:3631:x1874741493345280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893079.228891:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+24:3631:x1874741493345280:12345-0@lo:400:kworker.0 Request processed in 105us (5182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893079.228898:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1787893079.228970:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493345536:0@lo:400:kworker.0 00000100:00080000:3.0:1787893079.228997:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787893079.229002:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787893079.229023:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493345280:0@lo:400:kworker.0 00000100:00100000:3.0:1787893079.238362:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493346944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787893079.238433:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893079.238528:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493346944 00000100:00100000:3.0:1787893079.238535:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493346944 00000100:00100000:3.0:1787893079.238583:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787893079.238592:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493346944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787893079.238633:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787893079.238677:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493346944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893079.238683:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:3.0:1787893079.238727:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb6ed80 x1874741493346944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893095 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893079.238743:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493346944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787893079.238911:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787893079.238920:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493347072:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787893079.238949:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893079.238975:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493347072 00000100:00100000:0.0:1787893079.238978:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493347072 00000100:00100000:0.0:1787893079.239002:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787893079.239008:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493347072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787893079.239019:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787893079.239048:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493347072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893079.239054:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:0.0:1787893079.239080:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e711fb80 x1874741493347072/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893095 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893079.239092:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493347072:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787893079.729976:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893080.098953:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893080.099149:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481723264 00000100:00100000:0.0:1787893080.099159:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481723264 00000100:00100000:0.0:1787893080.099211:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 339 00000100:00100000:0.0:1787893080.099221:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2391:x1874741481723264:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893080.099301:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2391:x1874741481723264:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 81us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893080.099321:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 339 00000100:00100000:1.0:1787893080.108487:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893080.108557:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893080.108606:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893080.108651:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893080.108683:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481723392 00000100:00100000:1.0:1787893080.108694:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481723392 00000100:00100000:2.0:1787893080.108739:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481723648 00000100:00100000:2.0:1787893080.108746:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481723648 00000100:00100000:1.0:1787893080.108751:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481723520 00000100:00100000:1.0:1787893080.108757:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481723520 00000100:00100000:2.0:1787893080.108778:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481723776 00000100:00100000:2.0:1787893080.108783:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481723776 00000100:00100000:1.0:1787893080.108784:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 227 00000100:00100000:1.0:1787893080.108797:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c772c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+6:2390:x1874741481723392:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893080.108809:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 228 00000100:00100000:2.0:1787893080.108819:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c772ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481723648:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893080.108898:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 229 00000100:00100000:0.0:1787893080.108920:0:6505:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:3.0:1787893080.108930:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c71b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481723520:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893080.108931:0:6505:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_005' 00000100:00100000:0.0:1787893080.109057:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 230 00000100:00100000:0.0:1787893080.109066:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c71b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481723776:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893080.109142:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c772c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+6:2390:x1874741481723392:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 346us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893080.109151:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 227 00000100:00080000:1.0:1787893080.109173:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787893080.109177:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787893080.112859:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c772ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481723648:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 4029us (4289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893080.112875:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 228 00000100:00100000:3.0:1787893080.114065:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c71b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481723520:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 5136us (5448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893080.114080:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 229 00000100:00100000:0.0:1787893080.117172:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c71b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481723776:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 8092us (8504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893080.117188:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 230 00010000:00010000:3.0:1787893080.753669:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893081.266075:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787893081.266098:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c71b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493347200:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787893081.266161:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893081.266202:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493347200 00000100:00100000:3.0:1787893081.266211:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493347200 00000100:00100000:3.0:1787893081.266305:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787893081.266317:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c71b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493347200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787893081.266346:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787893081.266388:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c71b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493347200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (225us total) trans 0 rc 0/0 00000100:00080000:1.0:1787893081.266413:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787893081.266426:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493347328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787893081.266479:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787893081.266535:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c71b2680 x1874741493347200/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893097 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893081.266583:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c71b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493347200:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787893081.266757:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493347328 00000100:00100000:2.0:1787893081.266763:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493347328 00000100:00080000:1.0:1787893081.266814:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787893081.268249:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787893081.270112:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787893081.270132:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c71b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493347328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787893081.270158:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787893081.270335:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c71b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493347328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 209us (3853us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893081.270343:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:1.0:1787893081.270414:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e711fb80 x1874741493347328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893097 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893081.270437:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493347328:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787893081.777662:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893082.802851:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893082.803626:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787893082.803663:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493347456:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787893082.803743:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893082.804036:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493347456 00000100:00100000:1.0:1787893082.804044:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493347456 00000100:00100000:1.0:1787893082.804098:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787893082.804107:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493347456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787893082.804139:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787893082.804198:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493347456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893082.804205:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787893082.804293:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493347456:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1787893083.483058:0:13522:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 00:58:01 (1787893081) === 00010000:00010000:3.0:1787893083.825865:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893083.826050:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787893083.826076:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493347584:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787893083.826146:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893083.826288:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493347584 00000100:00100000:3.0:1787893083.826296:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493347584 00000100:00100000:3.0:1787893083.826355:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787893083.826365:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c71b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493347584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787893083.826398:0:7865:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787893083.826467:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c71b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493347584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893083.826475:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787893083.826833:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493347584:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787893083.936857:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893083.936902:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893083.937624:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481723904 00000100:00100000:3.0:1787893083.937659:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481723904 00000100:00100000:2.0:1787893083.937837:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481724032 00000100:00100000:2.0:1787893083.937847:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481724032 00000100:00100000:2.0:1787893083.937884:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 2 00000100:00100000:2.0:1787893083.937894:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c71b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:58232959-285a-4954-a3ac-571a2b817017+7:10493:x1874741481724032:12345-192.168.202.35@tcp:700:mkdir.0 00000100:00100000:2.0:1787893083.937973:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c71b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:58232959-285a-4954-a3ac-571a2b817017+7:10493:x1874741481724032:12345-192.168.202.35@tcp:700:mkdir.0 Request processed in 80us (1069us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893083.937982:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 2 00000100:00080000:1.0:1787893083.938103:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787893083.938351:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 22 00000100:00100000:3.0:1787893083.938362:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c71b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+6:2390:x1874741481723904:12345-192.168.202.35@tcp:41:mkdir.0 00000004:00000024:3.0:1787893083.938380:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787893083.938445:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c71b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+6:2390:x1874741481723904:12345-192.168.202.35@tcp:41:mkdir.0 Request processed in 85us (1597us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893083.938451:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 22 00000100:00100000:1.0:1787893083.942356:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893083.942542:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481724288 00000100:00100000:3.0:1787893083.942555:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481724288 00000100:00100000:3.0:1787893083.942617:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 23 00000100:00100000:3.0:1787893083.942628:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+6:10493:x1874741481724288:12345-192.168.202.35@tcp:36:mkdir.0 00010000:00010000:3.0:1787893083.942687:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893083.942773:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf0c14 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa63e expref: 6 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893083.942793:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc8c6616f00) 00010000:00010000:3.0:1787893083.942803:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787893083.942922:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147dc00/0x9232577658cf0d72 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893083.942935:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147dc00/0x9232577658cf0d72 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893083.942945:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147dc00/0x9232577658cf0d72 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893083.942972:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147ca00/0x9232577658cf0d79 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893083.942991:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147ca00/0x9232577658cf0d79 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893083.942997:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147ca00/0x9232577658cf0d79 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893083.943579:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf0d80 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893083.943590:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf0d80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893083.943597:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf0d80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787893083.943611:0:6506:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009d31f441 reply state 00000000555ab67e transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf0d80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893083.943621:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf0d80 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893083.943627:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fc9d5c29500) 00010000:00010000:3.0:1787893083.943629:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787893083.943632:0:6506:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787893083.943637:0:6506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787893083.943644:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147dc00/0x9232577658cf0d72 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893083.943651:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147dc00/0x9232577658cf0d72 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893083.943657:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147dc00/0x9232577658cf0d72 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893083.943670:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c147dc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893083.943674:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147dc00/0x9232577658cf0d72 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893083.943681:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147dc00/0x9232577658cf0d72 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893083.943691:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9d5c29d00) 00010000:00010000:3.0:1787893083.943694:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893083.943697:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147dc00/0x9232577658cf0d72 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893083.943702:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147dc00/0x9232577658cf0d72 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787893083.943717:0:6506:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009d31f441 reply state 00000000555ab67e transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147ca00/0x9232577658cf0d79 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893083.943725:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147ca00/0x9232577658cf0d79 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893083.943731:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9fc9d5c29a00) 00010000:00010000:3.0:1787893083.943733:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787893083.943735:0:6506:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787893083.943823:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+7:10493:x1874741481724288:12345-192.168.202.35@tcp:36:mkdir.0 Request processed in 1194us (1473us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787893083.943830:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 23 00000100:00100000:1.0:1787893083.955258:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893083.955412:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481724416 00000100:00100000:3.0:1787893083.955423:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481724416 00000100:00100000:3.0:1787893083.955557:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 24 00000100:00100000:3.0:1787893083.955594:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+7:10494:x1874741481724416:12345-192.168.202.35@tcp:101:chmod.0 00010000:00010000:3.0:1787893083.955615:0:9515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893083.955637:0:9515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147dc00/0x9232577658cf0d87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa6d1 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893083.955704:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147d400/0x9232577658cf0d8e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893083.955716:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147d400/0x9232577658cf0d8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893083.955727:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147d400/0x9232577658cf0d8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893083.955766:0:9515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787893083.955769:0:9515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787893083.955804:0:9515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147d400/0x9232577658cf0d8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893083.955845:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147dc00/0x9232577658cf0d87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa6d1 expref: 9 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893083.955863:0:9515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147d400/0x9232577658cf0d8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa6d1 expref: 8 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893083.955870:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9d5c29d00) 00010000:00010000:3.0:1787893083.955873:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787893083.955876:0:9515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9c147d400, rc 0) 00000100:00100000:3.0:1787893083.955927:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+8:10494:x1874741481724416:12345-192.168.202.35@tcp:101:chmod.0 Request processed in 336us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893083.955943:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 24 00000100:00100000:1.0:1787893083.959364:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893083.959477:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481724672 00000100:00100000:0.0:1787893083.959487:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481724672 00000100:00100000:0.0:1787893083.959606:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 25 00000100:00100000:0.0:1787893083.959617:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+8:10494:x1874741481724672:12345-192.168.202.35@tcp:36:chmod.0 00010000:00010000:0.0:1787893083.959678:0:10086:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893083.959708:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147d400/0x9232577658cf0d8e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa6d1 expref: 8 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893083.959728:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9d5c29d00) 00010000:00010000:0.0:1787893083.959738:0:10086:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787893083.959764:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf0d95 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893083.959778:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf0d95 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893083.959787:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf0d95 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787893083.960007:0:10086:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002fb9f92e reply state 00000000abf4c722 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf0d95 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893083.960020:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf0d95 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893083.960026:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc8c751ab00) 00010000:00010000:0.0:1787893083.960029:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787893083.960032:0:10086:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787893083.960040:0:10086:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787893083.960124:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+9:10494:x1874741481724672:12345-192.168.202.35@tcp:36:chmod.0 Request processed in 509us (771us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787893083.960131:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 25 00000100:00100000:1.0:1787893083.988893:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893083.989130:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481724800 00000100:00100000:3.0:1787893083.989141:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481724800 00000100:00100000:3.0:1787893083.989207:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 26 00000100:00100000:3.0:1787893083.989219:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+9:10495:x1874741481724800:12345-192.168.202.35@tcp:101:chown.0 00010000:00010000:3.0:1787893083.989245:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893083.989267:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147dc00/0x9232577658cf0d9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa6d8 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893083.989330:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147d600/0x9232577658cf0da3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893083.989343:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147d600/0x9232577658cf0da3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893083.989355:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147d600/0x9232577658cf0da3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893083.989395:0:6506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787893083.989399:0:6506:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787893083.989447:0:6506:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147d600/0x9232577658cf0da3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893083.989472:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147dc00/0x9232577658cf0d9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa6d8 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893083.989539:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147d600/0x9232577658cf0da3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa6d8 expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893083.989566:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc8c751ab00) 00010000:00010000:3.0:1787893083.989570:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787893083.989573:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9c147d600, rc 0) 00000100:00100000:3.0:1787893083.989772:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+10:10495:x1874741481724800:12345-192.168.202.35@tcp:101:chown.0 Request processed in 554us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893083.989780:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 26 00000100:00100000:1.0:1787893083.994542:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893083.995016:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481724928 00000100:00100000:0.0:1787893083.995026:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481724928 00000100:00100000:0.0:1787893083.995083:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 27 00000100:00100000:0.0:1787893083.995093:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+10:10495:x1874741481724928:12345-192.168.202.35@tcp:101:chown.0 00010000:00010000:0.0:1787893083.995114:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893083.995136:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30e00/0x9232577658cf0daa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa6df expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893083.995203:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf0db1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893083.995217:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf0db1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893083.995228:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf0db1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893083.995257:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf0db8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893083.995265:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf0db8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893083.995272:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf0db8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893083.995349:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf0dbf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893083.995358:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf0dbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893083.995364:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf0dbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893083.995404:0:6505:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787893083.995408:0:6505:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787893083.995443:0:6505:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf0dbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893083.995455:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf0db1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893083.995461:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf0db1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893083.995467:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf0db1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893083.995481:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893083.995485:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf0db1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893083.995539:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf0db1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893083.995552:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc8c751ab00) 00010000:00010000:0.0:1787893083.995555:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893083.995559:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf0db1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893083.995565:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf0db1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893083.995577:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf0db8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893083.995582:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf0db8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893083.996132:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf0db8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893083.996142:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893083.996145:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf0db8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893083.996151:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf0db8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893083.996173:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9fc9d5c29a00) 00010000:00010000:0.0:1787893083.996176:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893083.996179:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf0db8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893083.996184:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf0db8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893083.996220:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30e00/0x9232577658cf0daa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa6df expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893083.996234:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf0dbf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa6df expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893083.996242:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fc9d5c29500) 00010000:00010000:0.0:1787893083.996245:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787893083.996247:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb31000, rc 0) 00000100:00100000:0.0:1787893083.996350:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+11:10495:x1874741481724928:12345-192.168.202.35@tcp:101:chown.0 Request processed in 1258us (1864us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893083.996358:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 27 00000100:00100000:0.0:1787893084.002535:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893084.002631:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481725056 00000100:00100000:1.0:1787893084.002659:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481725056 00000100:00100000:1.0:1787893084.002713:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 6 00000100:00100000:1.0:1787893084.002723:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:58232959-285a-4954-a3ac-571a2b817017+11:10495:x1874741481725056:12345-192.168.202.35@tcp:900:chown.0 00000100:00100000:1.0:1787893084.002804:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:58232959-285a-4954-a3ac-571a2b817017+11:10495:x1874741481725056:12345-192.168.202.35@tcp:900:chown.0 Request processed in 81us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893084.002811:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 6 00000100:00100000:1.0:1787893084.008858:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893084.009070:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481725312 00000100:00100000:3.0:1787893084.009081:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481725312 00000100:00100000:3.0:1787893084.009140:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 28 00000100:00100000:3.0:1787893084.009150:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+11:10495:x1874741481725312:12345-192.168.202.35@tcp:36:chown.0 00010000:00010000:3.0:1787893084.009205:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893084.009233:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf0dbf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa6df expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893084.009253:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fc9d5c29500) 00010000:00010000:3.0:1787893084.009259:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787893084.009281:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147dc00/0x9232577658cf0dc6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893084.009296:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147dc00/0x9232577658cf0dc6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893084.009306:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147dc00/0x9232577658cf0dc6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787893084.012756:0:6484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:0.0:1787893084.012945:0:6504:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ff231b86 reply state 000000006fc6e38a transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147dc00/0x9232577658cf0dc6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.012969:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147dc00/0x9232577658cf0dc6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.012979:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fc9d5c29500) 00010000:00010000:0.0:1787893084.012992:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787893084.012996:0:6504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787893084.013009:0:6504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:0.0:1787893084.013109:0:6504:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1787893084.013131:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+9:10495:x1874741481725312:12345-192.168.202.35@tcp:36:chown.0 Request processed in 3979us (4279us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787893084.013141:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 28 00010000:00010000:2.0:1787893084.013257:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147dc00/0x9232577658cf0dc6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.013264:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147dc00/0x9232577658cf0dc6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.013270:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147dc00/0x9232577658cf0dc6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.013282:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c147dc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893084.013285:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147dc00/0x9232577658cf0dc6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.013290:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147dc00/0x9232577658cf0dc6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.013299:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fc9d5c29500) 00010000:00010000:2.0:1787893084.013301:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787893084.013303:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147dc00/0x9232577658cf0dc6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.013307:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147dc00/0x9232577658cf0dc6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893084.013868:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147ca00/0x9232577658cf0d79 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893084.013889:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147ca00/0x9232577658cf0d79 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893084.013896:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147ca00/0x9232577658cf0d79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893084.013901:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c147ca00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893084.013904:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147ca00/0x9232577658cf0d79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893084.013910:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147ca00/0x9232577658cf0d79 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893084.013919:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9fc9d5c29a00) 00010000:00010000:3.0:1787893084.013921:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893084.013925:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147ca00/0x9232577658cf0d79 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893084.013931:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147ca00/0x9232577658cf0d79 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893084.013945:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf0d80 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893084.013951:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf0d80 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893084.013957:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf0d80 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893084.013962:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c147cc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893084.013971:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf0d80 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893084.013978:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf0d80 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893084.013987:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fc9d5c29500) 00010000:00010000:3.0:1787893084.013990:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893084.013993:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf0d80 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893084.014000:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf0d80 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893084.014019:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf0d95 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893084.014026:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf0d95 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893084.014032:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf0d95 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893084.014037:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893084.014040:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf0d95 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893084.014046:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf0d95 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893084.014052:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc8c751ab00) 00010000:00010000:3.0:1787893084.014054:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787893084.014063:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf0d95 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893084.014069:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf0d95 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893084.033470:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893084.033846:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481725440 00000100:00100000:0.0:1787893084.033857:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481725440 00000100:00100000:3.0:1787893084.033998:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 29 00000100:00100000:3.0:1787893084.034010:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+6:10496:x1874741481725440:12345-192.168.202.35@tcp:101:touch.500 00010000:00010000:3.0:1787893084.034034:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893084.034083:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf0dcd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa6e6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787893084.038733:0:6506:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4583us 00010000:00010000:2.0:1787893084.048312:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf0dd4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.048335:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf0dd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.048346:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf0dd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.048363:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ec00/0x9232577658cf0ddb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.048370:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ec00/0x9232577658cf0ddb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.048378:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ec00/0x9232577658cf0ddb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.048534:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f600/0x9232577658cf0de2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.048543:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f600/0x9232577658cf0de2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.048550:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f600/0x9232577658cf0de2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893084.048580:0:6506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787893084.048585:0:6506:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787893084.053030:0:6506:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f600/0x9232577658cf0de2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.053052:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf0dd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.053060:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf0dd4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.053066:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf0dd4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.053072:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7e000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893084.053076:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf0dd4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.053084:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf0dd4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.053100:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc8c751ab00) 00010000:00010000:2.0:1787893084.053103:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893084.053107:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf0dd4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.053114:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf0dd4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.053125:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ec00/0x9232577658cf0ddb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.053132:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ec00/0x9232577658cf0ddb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.053138:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ec00/0x9232577658cf0ddb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.053167:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7ec00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893084.053170:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ec00/0x9232577658cf0ddb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.053176:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ec00/0x9232577658cf0ddb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.053185:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9fc8c6614c00) 00010000:00010000:2.0:1787893084.053187:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893084.053190:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ec00/0x9232577658cf0ddb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.053195:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ec00/0x9232577658cf0ddb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.053238:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf0dcd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa6e6 expref: 8 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.053253:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f600/0x9232577658cf0de2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa6e6 expref: 7 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.053262:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:2.0:1787893084.053264:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787893084.053267:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7f600, rc 0) 00000100:00100000:2.0:1787893084.053342:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+7:10496:x1874741481725440:12345-192.168.202.35@tcp:101:touch.500 Request processed in 19334us (19918us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893084.053351:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 29 00000100:00100000:2.0:1787893084.056007:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893084.056147:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481725696 00000100:00100000:3.0:1787893084.056159:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481725696 00000100:00100000:3.0:1787893084.056222:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 30 00000100:00100000:3.0:1787893084.056232:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7db2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+7:10496:x1874741481725696:12345-192.168.202.35@tcp:101:touch.500 00010000:00010000:3.0:1787893084.056252:0:9515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893084.056273:0:9515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf0de9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa6ed expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893084.056380:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147ca00/0x9232577658cf0df0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893084.056395:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147ca00/0x9232577658cf0df0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893084.056407:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147ca00/0x9232577658cf0df0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893084.056465:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf0df7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893084.056474:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf0df7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893084.056581:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf0df7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787893084.057443:0:9515:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:2.0:1787893084.057751:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f200/0x9232577658cf0dfe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.057762:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f200/0x9232577658cf0dfe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.057771:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f200/0x9232577658cf0dfe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.057803:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147ca00/0x9232577658cf0df0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.057810:0:9515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147ca00/0x9232577658cf0df0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.057816:0:9515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147ca00/0x9232577658cf0df0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.057822:0:9515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c147ca00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893084.057826:0:9515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147ca00/0x9232577658cf0df0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.057833:0:9515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147ca00/0x9232577658cf0df0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.057844:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:2.0:1787893084.057847:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893084.057851:0:9515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147ca00/0x9232577658cf0df0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.057857:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147ca00/0x9232577658cf0df0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787893084.057880:0:9515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d158fd4d reply state 00000000f4a889d5 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf0df7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.057892:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf0df7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.057898:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x476db67c (ffff9fc9d5c29500) 00010000:00010000:2.0:1787893084.057900:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787893084.057903:0:9515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787893084.057934:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf0de9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa6ed expref: 10 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.057948:0:9515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f200/0x9232577658cf0dfe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa6ed expref: 9 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.057955:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9fc8c6614000) 00010000:00010000:2.0:1787893084.057958:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787893084.057960:0:9515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7f200, rc 0) 00000100:00100000:2.0:1787893084.058066:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7db2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+10:10496:x1874741481725696:12345-192.168.202.35@tcp:101:touch.500 Request processed in 1834us (2064us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787893084.058074:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 30 00000100:00100000:2.0:1787893084.063980:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893084.064022:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481725952 00000100:00100000:0.0:1787893084.064032:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481725952 00000100:00100000:0.0:1787893084.064161:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 31 00000100:00100000:0.0:1787893084.064172:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7db1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+10:10496:x1874741481725952:12345-192.168.202.35@tcp:36:touch.500 00010000:00010000:0.0:1787893084.064227:0:10086:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893084.064256:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f200/0x9232577658cf0dfe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa6ed expref: 10 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.064275:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9fc8c6614000) 00010000:00010000:0.0:1787893084.064288:0:10086:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787893084.064373:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30e00/0x9232577658cf0e0c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.064387:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30e00/0x9232577658cf0e0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.064397:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30e00/0x9232577658cf0e0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787893084.064541:0:10086:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005db7da0a reply state 000000002b19f36c transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30e00/0x9232577658cf0e0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.064566:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30e00/0x9232577658cf0e0c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.064572:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9fc8c751a000) 00010000:00010000:0.0:1787893084.064574:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787893084.064577:0:10086:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787893084.064688:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7db1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+11:10496:x1874741481725952:12345-192.168.202.35@tcp:36:touch.500 Request processed in 517us (714us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787893084.064695:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 31 00000100:00100000:2.0:1787893084.071772:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893084.073381:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481726080 00000100:00100000:0.0:1787893084.073393:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481726080 00000100:00100000:1.0:1787893084.073670:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 32 00000100:00100000:1.0:1787893084.073683:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7db1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+11:10496:x1874741481726080:12345-192.168.202.35@tcp:101:touch.500 00010000:00010000:1.0:1787893084.073708:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893084.073730:0:13436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540400/0x9232577658cf0e13 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa6f4 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893084.073797:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540400/0x9232577658cf0e13 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa6f4 expref: 12 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893084.073813:0:13436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540400/0x9232577658cf0e13 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa6f4 expref: 12 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893084.073834:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9fc8c751a000) 00010000:00010000:1.0:1787893084.073837:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787893084.073841:0:13436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe540400, rc 0) 00000100:00100000:1.0:1787893084.073911:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7db1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+12:10496:x1874741481726080:12345-192.168.202.35@tcp:101:touch.500 Request processed in 231us (2150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893084.073918:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 32 00000100:00100000:2.0:1787893084.077855:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893084.078047:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481726208 00000100:00100000:0.0:1787893084.078057:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481726208 00000100:00100000:0.0:1787893084.078157:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 24 00000100:00100000:0.0:1787893084.078165:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2389:x1874741481726208:12345-192.168.202.35@tcp:8:touch.500 00010000:00080000:0.0:1787893084.078199:0:8535:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 58232959-285a-4954-a3ac-571a2b817017@192.168.202.35@tcp t0 exp 0000000000000000 cur 327 last 0 00000020:00000080:0.0:1787893084.078228:0:8535:0:(genops.c:1385:class_connect()) connect: client 58232959-285a-4954-a3ac-571a2b817017, cookie 0x9232577658cf0e1a 00002000:00100000:0.0:1787893084.078239:0:8535:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 58232959-285a-4954-a3ac-571a2b817017/ffff9fc9ffb40000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787893084.078256:0:8535:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787893084.078326:0:8535:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787893084.078353:0:8535:0:(import.c:65:import_set_state_nolock()) ffff9fc9ffa86800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787893084.078438:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58232959-285a-4954-a3ac-571a2b817017+6:2389:x1874741481726208:12345-192.168.202.35@tcp:8:touch.500 Request processed in 263us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893084.078447:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 24 00000100:00100000:2.0:1787893084.080862:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893084.081328:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481726336 00000100:00100000:0.0:1787893084.081338:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481726336 00000100:00100000:0.0:1787893084.081520:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 25 00000100:00100000:0.0:1787893084.081533:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58232959-285a-4954-a3ac-571a2b817017+6:0:x1874741481726336:12345-192.168.202.35@tcp:2:touch.500 00000100:00080000:1.0:1787893084.082377:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1787893084.092291:0:9497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:1.0:1787893084.092305:0:9497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 58232959-285a-4954-a3ac-571a2b817017 00000100:00100000:0.0:1787893084.092590:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58232959-285a-4954-a3ac-571a2b817017+5:0:x1874741481726336:12345-192.168.202.35@tcp:2:touch.500 Request processed in 11054us (11730us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787893084.092609:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 25 00000100:00100000:1.0:1787893084.097745:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893084.097892:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481726592 00000100:00100000:0.0:1787893084.097901:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481726592 00000100:00100000:0.0:1787893084.097960:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 2 00000100:00100000:0.0:1787893084.097970:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+12:10496:x1874741481726592:12345-192.168.202.35@tcp:35:touch.500 00000100:00100000:0.0:1787893084.098254:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+13:10496:x1874741481726592:12345-192.168.202.35@tcp:35:touch.500 Request processed in 284us (518us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787893084.098261:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 2 00000100:00100000:2.0:1787893084.116764:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893084.116925:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481726720 00000100:00100000:0.0:1787893084.116936:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481726720 00000100:00100000:0.0:1787893084.116997:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 33 00000100:00100000:0.0:1787893084.117007:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+13:10497:x1874741481726720:12345-192.168.202.35@tcp:101:rm.0 00010000:00010000:0.0:1787893084.117030:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893084.117051:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf0e21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa6fb expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.117117:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf0e28 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.117131:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf0e28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.117143:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf0e28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893084.117199:0:6505:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787893084.117203:0:6505:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787893084.117238:0:6505:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf0e28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.117265:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf0e21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa6fb expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.117283:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf0e28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa6fb expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.117292:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:0.0:1787893084.117295:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787893084.117299:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb31e00, rc 0) 00000100:00100000:0.0:1787893084.117411:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+14:10497:x1874741481726720:12345-192.168.202.35@tcp:101:rm.0 Request processed in 406us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893084.117419:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 33 00000100:00100000:3.0:1787893084.123985:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893084.124139:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481726976 00000100:00100000:1.0:1787893084.124150:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481726976 00000100:00100000:1.0:1787893084.124249:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 34 00000100:00100000:1.0:1787893084.124261:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+14:10497:x1874741481726976:12345-192.168.202.35@tcp:101:rm.0 00010000:00010000:1.0:1787893084.124293:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893084.124315:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf0e2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa702 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893084.124416:0:6504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787893084.124596:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf0e2f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa702 expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893084.124611:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc8c751ab00) 00010000:00010000:1.0:1787893084.124613:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787893084.124618:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf0e2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa702 expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893084.124631:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe540e00, rc 0) 00000100:00100000:1.0:1787893084.124696:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+15:10497:x1874741481726976:12345-192.168.202.35@tcp:101:rm.0 Request processed in 438us (824us total) trans 4294967305 rc 301/301 00000100:00100000:1.0:1787893084.124702:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 34 00000100:00100000:1.0:1787893084.132219:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893084.132328:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481727104 00000100:00100000:0.0:1787893084.132339:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481727104 00000100:00100000:0.0:1787893084.132400:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 3 00000100:00100000:0.0:1787893084.132412:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+15:10497:x1874741481727104:12345-192.168.202.35@tcp:37:rm.0 00000100:00100000:0.0:1787893084.138277:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+15:10497:x1874741481727104:12345-192.168.202.35@tcp:37:rm.0 Request processed in 5856us (6054us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893084.138290:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 3 00000100:00100000:3.0:1787893084.149095:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893084.149171:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481727360 00000100:00100000:2.0:1787893084.149194:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481727360 00000100:00100000:2.0:1787893084.149258:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 4 00000100:00100000:2.0:1787893084.149270:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fef850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+15:10497:x1874741481727360:12345-192.168.202.35@tcp:35:rm.0 00000100:00100000:2.0:1787893084.149571:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fef850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+16:10497:x1874741481727360:12345-192.168.202.35@tcp:35:rm.0 Request processed in 302us (485us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787893084.149579:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 4 00000100:00100000:1.0:1787893084.152475:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893084.152666:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481727616 00000100:00100000:2.0:1787893084.152677:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481727616 00000100:00100000:2.0:1787893084.152728:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 35 00000100:00100000:2.0:1787893084.152737:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+16:10497:x1874741481727616:12345-192.168.202.35@tcp:101:rm.0 00010000:00010000:2.0:1787893084.152760:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893084.152782:0:13436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf0e3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa709 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.152884:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf0e44 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.152898:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf0e44 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.152909:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf0e44 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893084.152919:0:13436:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787893084.153055:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf0e3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa709 expref: 19 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.153072:0:13436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf0e44 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa709 expref: 18 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.153092:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:2.0:1787893084.153095:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787893084.153099:0:13436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7e200, rc 0) 00000100:00100000:2.0:1787893084.153159:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+18:10497:x1874741481727616:12345-192.168.202.35@tcp:101:rm.0 Request processed in 423us (701us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787893084.153167:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 35 00000100:00100000:3.0:1787893084.156851:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893084.156938:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481727744 00000100:00100000:0.0:1787893084.156947:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481727744 00000100:00100000:0.0:1787893084.157018:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 36 00000100:00100000:0.0:1787893084.157028:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+18:10497:x1874741481727744:12345-192.168.202.35@tcp:41:rm.0 00000004:00000024:0.0:1787893084.157080:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:0.0:1787893084.157150:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+18:10497:x1874741481727744:12345-192.168.202.35@tcp:41:rm.0 Request processed in 122us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893084.157157:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 36 00000100:00100000:3.0:1787893084.161047:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893084.162540:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481727872 00000100:00100000:0.0:1787893084.162554:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481727872 00000100:00100000:0.0:1787893084.162611:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 37 00000100:00100000:0.0:1787893084.162622:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+18:10497:x1874741481727872:12345-192.168.202.35@tcp:101:rm.0 00010000:00010000:0.0:1787893084.162642:0:10086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893084.162665:0:10086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf0e52 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa710 expref: -99 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.162728:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf0e59 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.162742:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf0e59 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.162752:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf0e59 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.162762:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30c00/0x9232577658cf0e60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.162769:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30c00/0x9232577658cf0e60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.162775:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30c00/0x9232577658cf0e60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.162869:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf0e67 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.162878:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf0e67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.162951:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf0e67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893084.162987:0:10086:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787893084.162991:0:10086:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787893084.163006:0:10086:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf0e67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.163016:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf0e67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.163024:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf0e59 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.163029:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf0e59 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.163036:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf0e59 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.163041:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893084.163045:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf0e59 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.163053:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf0e59 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.163070:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:0.0:1787893084.163072:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893084.163076:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf0e59 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.163082:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf0e59 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.163095:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30c00/0x9232577658cf0e60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.163101:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30c00/0x9232577658cf0e60 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.163107:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30c00/0x9232577658cf0e60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.163113:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893084.163116:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30c00/0x9232577658cf0e60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.163121:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30c00/0x9232577658cf0e60 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.163127:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x476db67c (ffff9fc9d5c29500) 00010000:00010000:0.0:1787893084.163129:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893084.163132:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30c00/0x9232577658cf0e60 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.163137:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30c00/0x9232577658cf0e60 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.163171:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf0e52 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa710 expref: 20 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.163183:0:10086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf0e67 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa710 expref: 19 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.163190:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9fc8c751a000) 00010000:00010000:0.0:1787893084.163191:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787893084.163194:0:10086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb30800, rc 0) 00000100:00100000:0.0:1787893084.163265:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+19:10497:x1874741481727872:12345-192.168.202.35@tcp:101:rm.0 Request processed in 644us (2228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893084.163271:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 37 00000100:00100000:1.0:1787893084.175582:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893084.175804:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481728128 00000100:00100000:2.0:1787893084.175815:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481728128 00000100:00100000:2.0:1787893084.175872:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 38 00000100:00100000:2.0:1787893084.175882:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+19:10497:x1874741481728128:12345-192.168.202.35@tcp:36:rm.0 00010000:00010000:2.0:1787893084.175934:0:13436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787893084.175960:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf0e67 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa710 expref: 19 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.175981:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540400/0x9232577658cf0e13 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa6f4 expref: 18 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.175991:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9fc8c751a000) 00010000:00010000:2.0:1787893084.176001:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf0e28 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa6fb expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.176009:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:2.0:1787893084.176012:0:13436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787893084.176032:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf0e6e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.176060:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf0e6e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.176069:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf0e6e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.176080:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f000/0x9232577658cf0e75 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.176087:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f000/0x9232577658cf0e75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.176093:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f000/0x9232577658cf0e75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.176171:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf0e7c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.176179:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf0e7c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.176186:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf0e7c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787893084.176400:0:13436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1787893084.176409:0:13436:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 327997917289ns, next at 328997915320ns, rc = 0 00010000:00010000:2.0:1787893084.176462:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f800/0x9232577658cf0e83 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.176471:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f800/0x9232577658cf0e83 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.176488:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f800/0x9232577658cf0e83 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.176531:0:13436:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f800/0x9232577658cf0e83 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.176537:0:13436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f800/0x9232577658cf0e83 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.176543:0:13436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f800/0x9232577658cf0e83 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.176567:0:13436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787893084.176584:0:13436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf0e7c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.176590:0:13436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf0e7c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.176597:0:13436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf0e7c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.176604:0:13436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7e800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893084.176608:0:13436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf0e7c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.176615:0:13436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf0e7c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893084.176617:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893084.176628:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9fc8c751a000) 00010000:00010000:3.0:1787893084.176629:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f800/0x9232577658cf0e83 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.176634:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787893084.176646:0:13436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf0e7c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893084.176653:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7f800 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787893084.176653:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf0e7c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893084.176661:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f800/0x9232577658cf0e83 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893084.176671:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f800/0x9232577658cf0e83 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.176672:0:13436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf0e6e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.176688:0:13436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf0e6e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893084.176692:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9fc8c751a000) 00010000:00010000:2.0:1787893084.176693:0:13436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf0e6e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893084.176700:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787893084.176704:0:13436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7ea00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893084.176706:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f800/0x9232577658cf0e83 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.176708:0:13436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf0e6e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893084.176725:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f800/0x9232577658cf0e83 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.176726:0:13436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf0e6e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.176746:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:3.0:1787893084.176749:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893084.176750:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893084.176755:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893084.176755:0:13436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf0e6e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893084.176759:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893084.176764:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf0e6e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787893084.176773:0:13436:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000011e05e0c reply state 00000000342e0ead transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f000/0x9232577658cf0e75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.176793:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f000/0x9232577658cf0e75 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893084.176800:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x476db67c (ffff9fc9d5c29500) 00010000:00010000:2.0:1787893084.176803:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787893084.176805:0:13436:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787893084.176875:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+18:10497:x1874741481728128:12345-192.168.202.35@tcp:36:rm.0 Request processed in 993us (1301us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787893084.176883:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 38 00000100:00100000:3.0:1787893084.181714:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893084.184040:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481728384 00000100:00100000:2.0:1787893084.184057:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481728384 00000100:00100000:2.0:1787893084.184123:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 5 00000100:00100000:2.0:1787893084.184134:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+18:10497:x1874741481728384:12345-192.168.202.35@tcp:35:rm.0 00000100:00100000:2.0:1787893084.184364:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+19:10497:x1874741481728384:12345-192.168.202.35@tcp:35:rm.0 Request processed in 231us (2660us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787893084.184373:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 5 00000100:00100000:3.0:1787893084.189974:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893084.190104:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481728640 00000100:00100000:0.0:1787893084.190114:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481728640 00000100:00100000:0.0:1787893084.190182:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 39 00000100:00100000:0.0:1787893084.190192:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+19:10497:x1874741481728640:12345-192.168.202.35@tcp:36:rm.0 00010000:00010000:0.0:1787893084.190249:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787893084.190279:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf0e44 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa709 expref: 19 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.190300:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f600/0x9232577658cf0de2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa6e6 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.190311:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:0.0:1787893084.190328:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147d600/0x9232577658cf0da3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa6d8 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.190355:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc8c751ab00) 00010000:00010000:0.0:1787893084.190361:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787893084.190384:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf0e8a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.190396:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf0e8a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.190405:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf0e8a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.190419:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30c00/0x9232577658cf0e91 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.190425:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30c00/0x9232577658cf0e91 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.190441:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30c00/0x9232577658cf0e91 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.190560:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf0e98 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.190568:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf0e98 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.190576:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf0e98 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893084.190795:0:6505:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787893084.190810:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf0e98 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.190824:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf0e98 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.190831:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf0e98 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.190837:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893084.190841:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf0e98 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.190849:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf0e98 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.190858:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fc8c751a800) 00010000:00010000:0.0:1787893084.190861:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787893084.190865:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf0e98 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.190870:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf0e98 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.190886:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf0e8a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.190892:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf0e8a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.190898:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf0e8a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.190902:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893084.190935:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf0e8a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.190942:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf0e8a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.190950:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc8c751ac00) 00010000:00010000:0.0:1787893084.190953:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893084.190956:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf0e8a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.190966:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf0e8a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787893084.190978:0:6505:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a8d9d98a reply state 00000000f1053189 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30c00/0x9232577658cf0e91 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.190988:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30c00/0x9232577658cf0e91 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893084.190994:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9fc8c751aa00) 00010000:00010000:0.0:1787893084.190996:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787893084.190998:0:6505:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787893084.191075:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+18:10497:x1874741481728640:12345-192.168.202.35@tcp:36:rm.0 Request processed in 883us (1109us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787893084.191082:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 39 00000100:00100000:1.0:1787893084.337801:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787893084.337837:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493347712:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787893084.338007:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893084.338862:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493347968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787893084.338917:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874741493348096:0@lo:400:kworker.0 00000100:00100000:2.0:1787893084.338953:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893084.338984:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493348224:0@lo:400:kworker.0 00000100:00100000:3.0:1787893084.339022:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893084.339028:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1874741493348608:0@lo:400:kworker.0 00000100:00100000:3.0:1787893084.339053:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493348736:0@lo:400:kworker.0 00000100:00100000:2.0:1787893084.339062:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893084.339086:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893084.339105:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1874741493349120:0@lo:400:kworker.0 00000100:00100000:3.0:1787893084.339113:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1874741493349248:0@lo:400:kworker.0 00000100:00100000:2.0:1787893084.339139:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893084.339157:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493348224 00000100:00100000:3.0:1787893084.339164:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493348224 00000100:00100000:2.0:1787893084.339175:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787893084.339192:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493348480:0@lo:400:kworker.0 00000100:00100000:3.0:1787893084.339215:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787893084.339222:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893084.339229:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493348224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893084.339244:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493348992:0@lo:400:kworker.0 00000100:00100000:2.0:1787893084.339273:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893084.339296:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493349504:0@lo:400:kworker.0 00000100:00100000:3.0:1787893084.339302:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493348224:12345-0@lo:400:kworker.0 Request processed in 76us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893084.339311:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787893084.339326:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893084.339327:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493348480 00000100:00100000:3.0:1787893084.339332:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493348480 00000100:00100000:3.0:1787893084.339357:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787893084.339364:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493348480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893084.339377:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493348992 00000100:00100000:2.0:1787893084.339382:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493348992 00000100:00100000:3.0:1787893084.339404:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493348480:12345-0@lo:400:kworker.0 Request processed in 41us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893084.339411:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787893084.339418:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493349504 00000100:00100000:2.0:1787893084.339422:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493349504 00000100:00100000:2.0:1787893084.339462:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787893084.339481:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493348992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893084.339517:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893084.339617:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493348992:12345-0@lo:400:kworker.0 Request processed in 136us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893084.339623:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787893084.339639:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787893084.339645:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493349504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893084.339673:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493349504:12345-0@lo:400:kworker.0 Request processed in 29us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893084.339679:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:2.0:1787893084.339700:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787893084.339704:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787893084.339727:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493348480:0@lo:400:kworker.0 00010000:00080000:2.0:1787893084.339739:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffc5ea00 x1874741493348992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893084.339750:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493348992:0@lo:400:kworker.0 00010000:00080000:2.0:1787893084.339768:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffc5dc00 x1874741493349504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893084.339777:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493349504:0@lo:400:kworker.0 00000100:00100000:2.0:1787893084.339809:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493348096 00000100:00100000:2.0:1787893084.339811:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493348096 00000100:00100000:2.0:1787893084.339835:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493348608 00000100:00100000:2.0:1787893084.339839:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493348608 00000100:00100000:2.0:1787893084.339854:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493348736 00000100:00100000:2.0:1787893084.339856:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493348736 00000100:00100000:2.0:1787893084.339866:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493349120 00000100:00100000:2.0:1787893084.339868:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493349120 00000100:00100000:2.0:1787893084.339878:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493349248 00000100:00100000:2.0:1787893084.339880:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493349248 00000100:00100000:2.0:1787893084.339891:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787893084.339897:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1874741493348096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893084.339933:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1874741493348096:12345-0@lo:400:kworker.0 Request processed in 36us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893084.339945:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787893084.339959:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787893084.339966:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1874741493348608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893084.339992:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1874741493348608:12345-0@lo:400:kworker.0 Request processed in 28us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893084.339997:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787893084.340008:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1787893084.340013:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493348736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893084.340038:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493348736:12345-0@lo:400:kworker.0 Request processed in 25us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893084.340054:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1787893084.340066:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1787893084.340071:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1874741493349120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893084.340098:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1874741493349120:12345-0@lo:400:kworker.0 Request processed in 26us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893084.340102:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1787893084.340112:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787893084.340118:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1874741493349248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893084.340143:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1874741493349248:12345-0@lo:400:kworker.0 Request processed in 26us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893084.340148:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00080000:2.0:1787893084.340163:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787893084.340166:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787893084.340182:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1874741493349120:0@lo:400:kworker.0 00000100:00100000:2.0:1787893084.340195:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874741493348096:0@lo:400:kworker.0 00000100:00100000:2.0:1787893084.340205:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1874741493348608:0@lo:400:kworker.0 00000100:00100000:2.0:1787893084.340251:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893084.342223:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493347712 00000100:00100000:2.0:1787893084.342234:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493347712 00000100:00100000:2.0:1787893084.342296:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493347968 00000100:00100000:2.0:1787893084.342299:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493347968 00000100:00100000:2.0:1787893084.342317:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787893084.342326:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493347712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787893084.342347:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787893084.342401:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493347712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (4394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893084.342419:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787893084.342446:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787893084.342453:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493347968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787893084.342463:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787893084.342513:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493347968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (2260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893084.342518:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:2.0:1787893084.342538:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787893084.342783:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb9b800 x1874741493347968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893100 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893084.342801:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493347968:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787893084.343088:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffc5fb80 x1874741493349248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893084.343098:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1874741493349248:0@lo:400:kworker.0 00000100:00100000:3.0:1787893084.343119:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493348224:0@lo:400:kworker.0 00010000:00080000:3.0:1787893084.343141:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffc5d180 x1874741493348736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893084.343149:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493348736:0@lo:400:kworker.0 00000100:00100000:3.0:1787893084.343161:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1787893084.343169:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493347840:0@lo:400:kworker.0 00000100:00100000:3.0:1787893084.343206:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893084.343254:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874741493348352:0@lo:400:kworker.0 00000100:00100000:3.0:1787893084.343281:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893084.343303:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493348864:0@lo:400:kworker.0 00000100:00100000:3.0:1787893084.343324:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893084.343341:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493349376:0@lo:400:kworker.0 00000100:00100000:3.0:1787893084.343361:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893084.343388:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493348864 00000100:00100000:3.0:1787893084.343392:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493348864 00000100:00100000:3.0:1787893084.343437:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493349376 00000100:00100000:3.0:1787893084.343440:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493349376 00000100:00100000:3.0:1787893084.343459:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787893084.343466:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493348864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893084.343524:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493348864:12345-0@lo:400:kworker.0 Request processed in 57us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893084.343530:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787893084.343551:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787893084.343559:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe551850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493349376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893084.343595:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe551850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493349376:12345-0@lo:400:kworker.0 Request processed in 39us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893084.343609:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:3.0:1787893084.343770:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787893084.343785:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493348352 00000100:00100000:3.0:1787893084.343788:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493348352 00000100:00100000:3.0:1787893084.343810:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787893084.343816:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874741493348352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893084.343842:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874741493348352:12345-0@lo:400:kworker.0 Request processed in 26us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893084.343847:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787893084.343871:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874741493348352:0@lo:400:kworker.0 00010000:00080000:3.0:1787893084.343880:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffc5c700 x1874741493348864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893084.344217:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493348864:0@lo:400:kworker.0 00010000:00080000:3.0:1787893084.344231:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffc5f800 x1874741493349376/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893084.344239:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493349376:0@lo:400:kworker.0 00000100:00100000:2.0:1787893084.344527:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493347840 00000100:00100000:2.0:1787893084.344532:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493347840 00000100:00100000:2.0:1787893084.344574:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1787893084.344591:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+24:3630:x1874741493347840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893084.344630:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+24:3630:x1874741493347840:12345-0@lo:400:kworker.0 Request processed in 41us (1424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893084.344637:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1787893084.344878:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493347840:0@lo:400:kworker.0 00010000:00080000:1.0:1787893084.345346:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e711fb80 x1874741493347712/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893100 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893084.345362:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493347712:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787893084.849694:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893085.220862:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893085.221052:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893085.221086:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893085.221118:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893085.221134:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893085.221152:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893085.221258:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481728896 00000100:00100000:2.0:1787893085.221267:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481728896 00000100:00100000:2.0:1787893085.221326:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481729408 00000100:00100000:2.0:1787893085.221330:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481729408 00000100:00100000:2.0:1787893085.221347:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481729024 00000100:00100000:2.0:1787893085.221350:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481729024 00000100:00100000:2.0:1787893085.221360:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481729280 00000100:00100000:2.0:1787893085.221373:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481729280 00000100:00100000:2.0:1787893085.221393:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 237 00000100:00100000:2.0:1787893085.221413:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+18:2390:x1874741481728896:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893085.221525:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+18:2390:x1874741481728896:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 124us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893085.221533:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 237 00000100:00100000:2.0:1787893085.221551:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 238 00000100:00100000:2.0:1787893085.221558:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481729408:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893085.221583:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481729408:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 26us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893085.221589:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 238 00000100:00100000:2.0:1787893085.221601:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 239 00000100:00100000:2.0:1787893085.221606:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+5:2391:x1874741481729024:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893085.221630:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+5:2391:x1874741481729024:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 24us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893085.221636:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 239 00000100:00100000:2.0:1787893085.221646:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 240 00000100:00100000:2.0:1787893085.221652:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2391:x1874741481729280:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893085.221673:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2391:x1874741481729280:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 21us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893085.221678:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 240 00000100:00080000:2.0:1787893085.221719:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787893085.221723:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787893085.221990:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481729152 00000100:00100000:0.0:1787893085.221996:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481729152 00000100:00100000:0.0:1787893085.222041:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 91 00000100:00100000:0.0:1787893085.222048:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481729152:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893085.222088:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481729152:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 40us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893085.222103:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 91 00000100:00100000:3.0:1787893085.222695:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481728768 00000100:00100000:3.0:1787893085.222702:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481728768 00000100:00100000:2.0:1787893085.222870:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 341 00000100:00100000:2.0:1787893085.222886:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2391:x1874741481728768:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893085.222939:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2391:x1874741481728768:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 54us (2088us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893085.222946:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 341 00010000:00010000:1.0:1787893085.873789:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893086.388173:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787893086.388194:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493349632:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787893086.388258:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893086.388322:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493349632 00000100:00100000:3.0:1787893086.388331:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493349632 00000100:00100000:3.0:1787893086.388395:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787893086.388404:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493349632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787893086.388444:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787893086.388486:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493349632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893086.388536:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:3.0:1787893086.388557:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787893086.388661:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffc5f800 x1874741493349632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893102 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893086.388680:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493349632:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787893086.390054:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787893086.395037:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493349760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787893086.395113:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893086.398364:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493349760 00000100:00100000:0.0:1787893086.398379:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493349760 00000100:00100000:0.0:1787893086.398467:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787893086.398476:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493349760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787893086.398521:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787893086.398623:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493349760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 148us (3509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893086.398630:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:0.0:1787893086.398672:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e711fb80 x1874741493349760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893102 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893086.398693:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493349760:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787893086.399002:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787893086.897859:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893087.921731:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1787893087.921737:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893087.921758:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493349888:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787893087.922218:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893087.922347:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493349888 00000100:00100000:1.0:1787893087.922355:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493349888 00000100:00100000:1.0:1787893087.922424:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787893087.922435:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493349888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787893087.922470:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787893087.922542:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493349888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893087.922550:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787893087.924538:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493349888:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1787893088.490011:0:13669:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:1.0:1787893088.946224:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787893088.946247:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493350016:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787893088.946311:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893088.946341:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493350016 00000100:00100000:3.0:1787893088.946350:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493350016 00000100:00100000:3.0:1787893088.946403:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787893088.946412:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493350016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787893088.946446:0:7865:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787893088.946533:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493350016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893088.946541:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787893088.946748:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493350016:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787893088.948242:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893089.457884:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493350144:0@lo:400:kworker.0 00000100:00100000:3.0:1787893089.457958:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893089.458008:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493350656:0@lo:400:kworker.0 00000100:00100000:3.0:1787893089.458038:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893089.458080:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493351168:0@lo:400:kworker.0 00000100:00100000:3.0:1787893089.458105:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893089.458121:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493351680:0@lo:400:kworker.0 00000100:00100000:3.0:1787893089.458140:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893089.458164:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787893089.458171:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874741493350528:0@lo:400:kworker.0 00000100:00100000:3.0:1787893089.458197:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893089.458213:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493351040:0@lo:400:kworker.0 00000100:00100000:3.0:1787893089.458230:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893089.458243:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493351552:0@lo:400:kworker.0 00000100:00100000:3.0:1787893089.458262:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893089.458288:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493350400:0@lo:400:kworker.0 00000100:00100000:3.0:1787893089.458310:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893089.458328:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1874741493350912:0@lo:400:kworker.0 00000100:00100000:3.0:1787893089.458351:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893089.458368:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1874741493351424:0@lo:400:kworker.0 00000100:00100000:3.0:1787893089.458403:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893089.458422:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787893089.458428:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1874741493350272:0@lo:400:kworker.0 00000100:00100000:3.0:1787893089.458449:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893089.458466:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1874741493350784:0@lo:400:kworker.0 00000100:00100000:3.0:1787893089.459971:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893089.460008:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1874741493351296:0@lo:400:kworker.0 00000100:00100000:3.0:1787893089.460038:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893089.460099:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493350144 00000100:00100000:3.0:1787893089.460108:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493350144 00000100:00100000:3.0:1787893089.460170:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1787893089.460179:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+24:3633:x1874741493350144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893089.460235:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+24:3633:x1874741493350144:12345-0@lo:400:kworker.0 Request processed in 57us (2277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893089.460242:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1787893089.460277:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493350656 00000100:00100000:3.0:1787893089.460281:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493350656 00000100:00100000:3.0:1787893089.460303:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493350400 00000100:00100000:3.0:1787893089.460306:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493350400 00000100:00100000:3.0:1787893089.460317:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787893089.460323:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c772f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493350656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893089.460354:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c772f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493350656:12345-0@lo:400:kworker.0 Request processed in 31us (2315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893089.460359:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787893089.460369:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787893089.460374:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493350400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893089.460419:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493350400:12345-0@lo:400:kworker.0 Request processed in 45us (2108us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893089.460425:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787893089.460444:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493351168 00000100:00100000:3.0:1787893089.460448:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493351168 00000100:00100000:3.0:1787893089.460474:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493351680 00000100:00100000:3.0:1787893089.460478:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493351680 00000100:00100000:3.0:1787893089.460510:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493351040 00000100:00100000:3.0:1787893089.460513:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493351040 00000100:00100000:3.0:1787893089.460526:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493351552 00000100:00100000:3.0:1787893089.460528:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493351552 00000100:00100000:3.0:1787893089.460553:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787893089.460558:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c772c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493351168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893089.460591:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c772c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493351168:12345-0@lo:400:kworker.0 Request processed in 33us (2484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893089.460597:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787893089.460609:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787893089.460615:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c772e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493351680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893089.460643:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c772e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493351680:12345-0@lo:400:kworker.0 Request processed in 28us (2501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893089.460648:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787893089.460659:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787893089.460665:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493351040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893089.460688:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493351040:12345-0@lo:400:kworker.0 Request processed in 25us (2458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893089.460693:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787893089.460703:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787893089.460708:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493351552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893089.460732:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493351552:12345-0@lo:400:kworker.0 Request processed in 24us (2470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893089.460737:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787893089.460759:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493350528 00000100:00100000:3.0:1787893089.460763:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493350528 00000100:00100000:3.0:1787893089.460781:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493350912 00000100:00100000:3.0:1787893089.460783:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493350912 00000100:00100000:3.0:1787893089.460794:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493351424 00000100:00100000:3.0:1787893089.460797:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493351424 00000100:00100000:3.0:1787893089.460808:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493350272 00000100:00100000:3.0:1787893089.460816:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493350272 00000100:00100000:3.0:1787893089.460830:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493350784 00000100:00100000:3.0:1787893089.460832:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493350784 00000100:00100000:3.0:1787893089.460842:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493351296 00000100:00100000:3.0:1787893089.460844:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493351296 00000100:00100000:3.0:1787893089.460857:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787893089.460862:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c772e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1874741493350528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893089.460893:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c772e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1874741493350528:12345-0@lo:400:kworker.0 Request processed in 31us (2696us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893089.460899:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787893089.460910:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787893089.460916:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7115180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1874741493350912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893089.460943:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7115180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1874741493350912:12345-0@lo:400:kworker.0 Request processed in 28us (2592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893089.460949:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787893089.460959:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787893089.460965:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7114700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1874741493351424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893089.460991:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7114700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1874741493351424:12345-0@lo:400:kworker.0 Request processed in 27us (2588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893089.460997:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787893089.461007:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787893089.461012:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7117b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1874741493350272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893089.461038:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7117b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1874741493350272:12345-0@lo:400:kworker.0 Request processed in 26us (2588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893089.461044:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787893089.461055:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787893089.461060:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3631:x1874741493350784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893089.461096:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3631:x1874741493350784:12345-0@lo:400:kworker.0 Request processed in 36us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893089.461102:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787893089.461113:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787893089.461120:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1874741493351296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893089.461145:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1874741493351296:12345-0@lo:400:kworker.0 Request processed in 27us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893089.461150:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:3.0:1787893089.461193:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787893089.461197:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787893089.461199:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787893089.461201:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787893089.461309:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874741493350528:0@lo:400:kworker.0 00010000:00080000:3.0:1787893089.461325:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffc5ca80 x1874741493351040/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893089.461335:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493351040:0@lo:400:kworker.0 00010000:00080000:3.0:1787893089.461346:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffc5dc00 x1874741493351552/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893089.461354:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493351552:0@lo:400:kworker.0 00000100:00100000:3.0:1787893089.461362:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493350144:0@lo:400:kworker.0 00000100:00100000:3.0:1787893089.461372:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493350656:0@lo:400:kworker.0 00000004:00080000:1.0:1787893089.463001:0:10004:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 333284506924ns, next at 334284503757ns, rc = 0 00010000:00080000:3.0:1787893089.465371:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffc5c380 x1874741493351168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893089.465415:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493351168:0@lo:400:kworker.0 00010000:00080000:3.0:1787893089.465446:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffc5ea00 x1874741493351680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893089.465454:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493351680:0@lo:400:kworker.0 00000100:00100000:2.0:1787893089.465788:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493351808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787893089.465850:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893089.465895:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787893089.465901:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493351936:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787893089.465924:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893089.465956:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493351808 00000100:00100000:2.0:1787893089.465963:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493351808 00000100:00100000:2.0:1787893089.466002:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493351936 00000100:00100000:2.0:1787893089.466004:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493351936 00000100:00100000:2.0:1787893089.466018:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787893089.466027:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493351808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787893089.466056:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787893089.466068:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787893089.466076:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493351936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787893089.466087:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787893089.466097:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493351808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893089.466105:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787893089.466110:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493351936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893089.466115:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:2.0:1787893089.466138:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e711fb80 x1874741493351936/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893105 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893089.466166:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493351936:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1787893089.466179:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb7e680 x1874741493351808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893105 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893089.466189:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493351808:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1787893089.466371:0:6484:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:1.0:1787893089.466412:0:6484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:1.0:1787893089.466515:0:6484:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1787893089.466844:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1874741493350272:0@lo:400:kworker.0 00000100:00100000:3.0:1787893089.466860:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1874741493350784:0@lo:400:kworker.0 00000100:00100000:3.0:1787893089.466871:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1874741493351296:0@lo:400:kworker.0 00000100:00100000:3.0:1787893089.466883:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493350400:0@lo:400:kworker.0 00010000:00080000:3.0:1787893089.466894:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffc5f480 x1874741493350912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893089.466903:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1874741493350912:0@lo:400:kworker.0 00010000:00080000:3.0:1787893089.466913:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffc5d500 x1874741493351424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893089.466920:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1874741493351424:0@lo:400:kworker.0 00010000:00010000:2.0:1787893089.468530:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf0df7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.468545:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf0df7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.468552:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf0df7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.468559:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c147c200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893089.468564:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf0df7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.468572:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf0df7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.468594:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x476db67c (ffff9fc9d5c29500) 00010000:00010000:2.0:1787893089.468597:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893089.468603:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf0df7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.468608:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf0df7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.468626:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30e00/0x9232577658cf0e0c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.468637:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30e00/0x9232577658cf0e0c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.468644:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30e00/0x9232577658cf0e0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.468649:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893089.468652:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30e00/0x9232577658cf0e0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.468657:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30e00/0x9232577658cf0e0c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.468667:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9fc8c751a000) 00010000:00010000:2.0:1787893089.468669:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893089.468672:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30e00/0x9232577658cf0e0c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.468678:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30e00/0x9232577658cf0e0c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.468696:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f000/0x9232577658cf0e75 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.468703:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f000/0x9232577658cf0e75 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.468709:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f000/0x9232577658cf0e75 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.468715:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7f000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893089.468723:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f000/0x9232577658cf0e75 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.468729:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f000/0x9232577658cf0e75 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.468738:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x476db67c (ffff9fc9d5c29500) 00010000:00010000:2.0:1787893089.468740:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893089.468743:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f000/0x9232577658cf0e75 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.468749:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f000/0x9232577658cf0e75 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.468778:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30c00/0x9232577658cf0e91 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.468784:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30c00/0x9232577658cf0e91 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.468790:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30c00/0x9232577658cf0e91 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.468796:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893089.468799:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30c00/0x9232577658cf0e91 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.468805:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30c00/0x9232577658cf0e91 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.468812:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9fc8c751aa00) 00010000:00010000:2.0:1787893089.468814:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893089.468825:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30c00/0x9232577658cf0e91 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.468830:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30c00/0x9232577658cf0e91 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893089.468851:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787893089.468867:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493352064:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787893089.468925:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893089.468974:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493352064 00000100:00100000:2.0:1787893089.468980:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493352064 00000100:00100000:2.0:1787893089.469024:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787893089.469032:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493352064:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787893089.469061:0:8421:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:2.0:1787893089.469091:0:8421:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a91155c, atime: 0x6a91155c, ctime: 0x6a91155c, blocks: 0x0 00010000:00010000:2.0:1787893089.469099:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cbd5d59/0x9232577658cf0e9f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.469112:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=333s v=(0 0) 00010000:00010000:2.0:1787893089.469117:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893089.469124:0:8421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cbd5d59/0x9232577658cf0e9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.469138:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cbd5d59/0x9232577658cf0e9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.469146:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cbd5d59/0x9232577658cf0e9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.469164:0:8421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005cbd5d59/0x9232577658cf0e9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.469180:0:8421:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787893089.469325:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3633:x1874741493352064:12345-0@lo:6:osp-syn-1-0.0 Request processed in 293us (398us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787893089.469332:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1787893089.469354:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893089.469360:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005cbd5d59/0x9232577658cf0e9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.469367:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7e000 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787893089.469371:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005cbd5d59/0x9232577658cf0e9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.469377:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005cbd5d59/0x9232577658cf0e9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.469405:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005cbd5d59/0x9232577658cf0e9f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.469411:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cbd5d59/0x9232577658cf0e9f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.469427:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893089.469434:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893089.469436:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787893089.469467:0:3633:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fc9ffbdca80/2, rc 0, transno 4294967301 00000100:00100000:2.0:1787893089.469473:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493352064:0@lo:6:osp-syn-1-0.0 00000020:00000080:3.0:1787893089.880244:0:13718:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdaab80ae0 20000000:00000080:3.0:1787893089.880264:0:13718:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fc8c74fa400 uarg=0000000000000000 20000000:01000000:3.0:1787893089.880313:0:13718:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1787893089.880319:0:13718:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1787893089.880324:0:13718:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1787893089.888311:0:13719:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1787893089.888482:0:13718:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1787893089.897541:0:13718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1787893089.897575:0:13718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1787893089.897590:0:13718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1787893089.897604:0:13718:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787893089.897622:0:13718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fc8c7c7f000/0x9232577658cf0ea6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.897640:0:13718:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc8c771ec00/0x9232577658cf0d33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0d2c expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.897649:0:13718:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc8c771fe00/0x9232577658cf0d41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0d3a expref: 23 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.897656:0:13718:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc8c771e400/0x9232577658cf0d4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0d48 expref: 23 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.897664:0:13718:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9fe540a00/0x9232577658cf0d5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0d56 expref: 23 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.897673:0:13718:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc8c771f600/0x9232577658cf0d64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa6c3 expref: 12 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.897681:0:13718:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9fe541600/0x9232577658cf0d6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa6ca expref: 12 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.897689:0:13718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fc8c7c7f000/0x9232577658cf0ea6 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.898243:0:13718:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9fe541600/0x9232577658cf0d6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa6ca expref: 12 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.898263:0:13718:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc9fe541600/0x9232577658cf0d6b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa6ca expref: 12 pid: 6499 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893089.898281:0:13718:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13718:1874741493352192:192.168.202.35@tcp:104: 00010000:00010000:2.0:1787893089.898515:0:13718:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc8c771f600/0x9232577658cf0d64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa6c3 expref: 12 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.898524:0:13718:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc8c771f600/0x9232577658cf0d64 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa6c3 expref: 12 pid: 6500 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893089.898533:0:13718:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb99500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13718:1874741493352320:192.168.202.35@tcp:104: 00010000:00010000:2.0:1787893089.904848:0:13718:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9fe540a00/0x9232577658cf0d5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf0d56 expref: 23 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.904868:0:13718:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc9fe540a00/0x9232577658cf0d5d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf0d56 expref: 23 pid: 6499 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893089.904885:0:13718:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb99c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13718:1874741493352448:0@lo:104: 00000100:00100000:2.0:1787893089.904973:0:13718:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787893089.905026:0:13718:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc8c771e400/0x9232577658cf0d4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf0d48 expref: 23 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.905036:0:13718:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc8c771e400/0x9232577658cf0d4f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf0d48 expref: 23 pid: 6497 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893089.905063:0:13718:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13718:1874741493352576:0@lo:104: 00010000:00010000:2.0:1787893089.905092:0:13718:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc8c771fe00/0x9232577658cf0d41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf0d3a expref: 23 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.905100:0:13718:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc8c771fe00/0x9232577658cf0d41 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf0d3a expref: 23 pid: 6499 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893089.905108:0:13718:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7e04000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13718:1874741493352704:0@lo:104: 00010000:00010000:2.0:1787893089.905135:0:13718:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc8c771ec00/0x9232577658cf0d33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf0d2c expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893089.905143:0:13718:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc8c771ec00/0x9232577658cf0d33 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf0d2c expref: 23 pid: 6500 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893089.905165:0:13718:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb75180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13718:1874741493352832:0@lo:104: 00000100:00100000:2.0:1787893089.905185:0:13718:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7135900 going to sleep for 11 seconds 00000100:00100000:1.0:1787893089.905277:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787893089.905297:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893089.905319:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893089.905327:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893089.905336:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493352448 00000100:00100000:1.0:1787893089.905342:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493352448 00000100:00100000:1.0:1787893089.905397:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493352576 00000100:00100000:1.0:1787893089.905401:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493352576 00000100:00100000:1.0:1787893089.905425:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493352704 00000100:00100000:1.0:1787893089.905428:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493352704 00000100:00100000:1.0:1787893089.905440:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493352832 00000100:00100000:1.0:1787893089.905442:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493352832 00000100:00100000:1.0:1787893089.905455:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787893089.905465:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77e3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ad7764-cf95-4087-88aa-57e4229a8397+6:13718:x1874741493352448:12345-0@lo:104: 00010000:00010000:1.0:1787893089.905480:0:6488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc8c771fa00/0x9232577658cf0d56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0d5d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893089.905572:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787893089.905583:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77e3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ad7764-cf95-4087-88aa-57e4229a8397+6:13718:x1874741493352448:12345-0@lo:104: Request processed in 120us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893089.905591:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787893089.905662:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787893089.905668:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ad7764-cf95-4087-88aa-57e4229a8397+5:13718:x1874741493352576:12345-0@lo:104: 00010000:00010000:1.0:1787893089.905676:0:6488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541a00/0x9232577658cf0d48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0d4f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893089.905711:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787893089.905716:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ad7764-cf95-4087-88aa-57e4229a8397+5:13718:x1874741493352576:12345-0@lo:104: Request processed in 49us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893089.905722:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787893089.905735:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787893089.905741:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ad7764-cf95-4087-88aa-57e4229a8397+4:13718:x1874741493352704:12345-0@lo:104: 00010000:00010000:1.0:1787893089.905748:0:6488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc8c771ee00/0x9232577658cf0d3a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0d41 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893089.905779:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787893089.905784:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ad7764-cf95-4087-88aa-57e4229a8397+4:13718:x1874741493352704:12345-0@lo:104: Request processed in 44us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893089.905790:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787893089.905802:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787893089.905807:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ad7764-cf95-4087-88aa-57e4229a8397+3:13718:x1874741493352832:12345-0@lo:104: 00010000:00010000:1.0:1787893089.905814:0:6488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31a00/0x9232577658cf0d2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0d33 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893089.905841:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787893089.905852:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ad7764-cf95-4087-88aa-57e4229a8397+3:13718:x1874741493352832:12345-0@lo:104: Request processed in 45us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893089.905858:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:1.0:1787893089.905874:0:8435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787893089.905880:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc8c771fa00/0x9232577658cf0d56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0d5d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893089.905888:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c771fa00 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:1.0:1787893089.905893:0:8435:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc8c771fa00/0x9232577658cf0d56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf0d5d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893089.905902:0:8435:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc8c771fa00/0x9232577658cf0d56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf0d5d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787893089.905909:0:8435:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc8c771fa00/0x9232577658cf0d56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf0d5d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893089.905930:0:8435:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787893089.905960:0:8435:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc8c771fa00/0x9232577658cf0d56 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0d5d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893089.905966:0:8435:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787893089.905985:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc8c771fa00/0x9232577658cf0d56 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0d5d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893089.905991:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc8c771fa00/0x9232577658cf0d56 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0d5d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893089.906005:0:8435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787893089.906008:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541a00/0x9232577658cf0d48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0d4f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893089.906025:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe541a00 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:1.0:1787893089.906029:0:8435:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541a00/0x9232577658cf0d48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf0d4f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893089.906036:0:8435:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541a00/0x9232577658cf0d48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf0d4f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787893089.906042:0:8435:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541a00/0x9232577658cf0d48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf0d4f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893089.906047:0:8435:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787893089.906060:0:8435:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541a00/0x9232577658cf0d48 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0d4f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893089.906065:0:8435:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787893089.906078:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541a00/0x9232577658cf0d48 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0d4f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893089.906084:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541a00/0x9232577658cf0d48 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0d4f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893089.906092:0:8435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787893089.906095:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc8c771ee00/0x9232577658cf0d3a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0d41 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893089.906101:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c771ee00 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:1.0:1787893089.906104:0:8435:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc8c771ee00/0x9232577658cf0d3a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf0d41 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893089.906121:0:8435:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc8c771ee00/0x9232577658cf0d3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf0d41 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787893089.906128:0:8435:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc8c771ee00/0x9232577658cf0d3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf0d41 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893089.906133:0:8435:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787893089.906146:0:8435:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc8c771ee00/0x9232577658cf0d3a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0d41 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893089.906152:0:8435:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787893089.906158:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc8c771ee00/0x9232577658cf0d3a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0d41 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893089.906163:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc8c771ee00/0x9232577658cf0d3a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0d41 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893089.906172:0:8435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893089.906175:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31a00/0x9232577658cf0d2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf0d33 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893089.906180:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31a00 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:1.0:1787893089.906183:0:8435:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31a00/0x9232577658cf0d2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf0d33 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893089.906189:0:8435:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31a00/0x9232577658cf0d2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf0d33 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787893089.906196:0:8435:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31a00/0x9232577658cf0d2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf0d33 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893089.906207:0:8435:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787893089.906221:0:8435:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31a00/0x9232577658cf0d2c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0d33 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893089.906227:0:8435:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787893089.906233:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31a00/0x9232577658cf0d2c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0d33 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893089.906239:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31a00/0x9232577658cf0d2c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf0d33 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893089.906253:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893089.906254:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893089.906256:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893089.906262:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893089.906273:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493352960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787893089.906305:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893089.906329:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787893089.906335:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493353344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787893089.906358:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893089.906399:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493353088:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787893089.906422:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893089.906440:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787893089.906444:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493353216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787893089.906464:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893089.906486:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493352960 00000100:00100000:1.0:1787893089.906519:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493352960 00010000:00010000:1.0:1787893089.906550:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9fe540a00/0x9232577658cf0d5d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0d56 expref: 24 pid: 6499 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893089.906566:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493353344 00000100:00100000:1.0:1787893089.906568:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493353344 00010000:00010000:1.0:1787893089.906577:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc8c771ec00/0x9232577658cf0d33 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0d2c expref: 25 pid: 6500 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893089.906585:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493353088 00000100:00100000:1.0:1787893089.906588:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493353088 00010000:00010000:1.0:1787893089.906597:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc8c771e400/0x9232577658cf0d4f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0d48 expref: 26 pid: 6497 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893089.906606:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493353216 00000100:00100000:1.0:1787893089.906608:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493353216 00010000:00010000:1.0:1787893089.906617:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc8c771fe00/0x9232577658cf0d41 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0d3a expref: 27 pid: 6499 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893089.906627:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787893089.906633:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ad7764-cf95-4087-88aa-57e4229a8397+27:3633:x1874741493352960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787893089.906642:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893089.906648:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9fe540a00/0x9232577658cf0d5d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0d56 expref: 27 pid: 6499 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893089.906657:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9fe540a00/0x9232577658cf0d5d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf0d56 expref: 27 pid: 6499 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893089.906673:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893089.906703:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ad7764-cf95-4087-88aa-57e4229a8397+27:3633:x1874741493352960:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893089.906709:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787893089.906731:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787893089.906737:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c772f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ad7764-cf95-4087-88aa-57e4229a8397+26:3633:x1874741493353344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787893089.906745:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893089.906750:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc8c771ec00/0x9232577658cf0d33 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0d2c expref: 26 pid: 6500 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893089.906758:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc8c771ec00/0x9232577658cf0d33 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf0d2c expref: 26 pid: 6500 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893089.906768:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893089.906790:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c772f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ad7764-cf95-4087-88aa-57e4229a8397+26:3633:x1874741493353344:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893089.906796:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787893089.906807:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787893089.906813:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c772d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ad7764-cf95-4087-88aa-57e4229a8397+25:3630:x1874741493353088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787893089.906816:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893089.906820:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893089.906824:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc8c771e400/0x9232577658cf0d4f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0d48 expref: 25 pid: 6497 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893089.906828:0:10383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00010000:00010000:1.0:1787893089.906832:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc8c771e400/0x9232577658cf0d4f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf0d48 expref: 25 pid: 6497 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893089.906841:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893089.906847:0:10383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:19ad7764-cf95-4087-88aa-57e4229a8397+25:3630:x1874741493353216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787893089.906856:0:10383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893089.906861:0:10383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc8c771fe00/0x9232577658cf0d41 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf0d3a expref: 25 pid: 6499 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893089.906864:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c772d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ad7764-cf95-4087-88aa-57e4229a8397+25:3630:x1874741493353088:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (441us total) trans 0 rc 0/0 00010000:00010000:0.0:1787893089.906869:0:10383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc8c771fe00/0x9232577658cf0d41 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf0d3a expref: 25 pid: 6499 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893089.906870:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:0.0:1787893089.906879:0:10383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893089.906903:0:10383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:19ad7764-cf95-4087-88aa-57e4229a8397+24:3630:x1874741493353216:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893089.906905:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493353088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787893089.906909:0:10383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787893089.906923:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493353216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787893089.906947:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493353344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787893089.906954:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493352960:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787893089.907881:0:13718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9fe540a00/0x9232577658cf0d5d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf0d56 expref: 23 pid: 6499 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893089.907894:0:13718:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb99c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13718:1874741493352448:0@lo:104: 00010000:00010000:2.0:1787893089.907903:0:13718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c771e400/0x9232577658cf0d4f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf0d48 expref: 22 pid: 6497 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893089.907911:0:13718:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13718:1874741493352576:0@lo:104: 00010000:00010000:2.0:1787893089.907919:0:13718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c771fe00/0x9232577658cf0d41 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf0d3a expref: 21 pid: 6499 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893089.907926:0:13718:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7e04000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13718:1874741493352704:0@lo:104: 00010000:00010000:2.0:1787893089.907943:0:13718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c771ec00/0x9232577658cf0d33 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf0d2c expref: 20 pid: 6500 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893089.907962:0:13718:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb75180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13718:1874741493352832:0@lo:104: 00000100:00100000:2.0:1787893089.911984:0:13718:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13718:1874741493352192:192.168.202.35@tcp:104: 00000100:00100000:0.0:1787893089.911984:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893089.912097:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481729536 00000100:00100000:1.0:1787893089.912104:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481729536 00010000:00010000:1.0:1787893089.912170:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9fe541600/0x9232577658cf0d6b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa6ca expref: 13 pid: 6499 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893089.912211:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 50 00000100:00100000:1.0:1787893089.912220:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2390:x1874741481729536:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893089.912233:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893089.912239:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9fe541600/0x9232577658cf0d6b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa6ca expref: 13 pid: 6499 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893089.912250:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9fe541600/0x9232577658cf0d6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa6ca expref: 13 pid: 6499 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893089.912267:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9fe541600/0x9232577658cf0d6b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa6ca expref: 13 pid: 6499 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893089.912284:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893089.912344:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+12:2390:x1874741481729536:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 124us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893089.912351:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 50 00000100:00100000:3.0:1787893089.914217:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893089.914251:0:13718:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb99500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13718:1874741493352320:192.168.202.35@tcp:104: 00010000:00010000:2.0:1787893089.914294:0:13718:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fc8c7c7f000/0x9232577658cf0ea6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893089.914360:0:10383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481729664 00000100:00100000:0.0:1787893089.914367:0:10383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481729664 00010000:00010000:0.0:1787893089.914410:0:10383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc8c771f600/0x9232577658cf0d64 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa6c3 expref: 12 pid: 6500 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893089.914456:0:10383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 51 00000100:00100000:0.0:1787893089.914465:0:10383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+12:2390:x1874741481729664:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893089.914476:0:10383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893089.914482:0:10383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc8c771f600/0x9232577658cf0d64 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa6c3 expref: 12 pid: 6500 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893089.914530:0:10383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc8c771f600/0x9232577658cf0d64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa6c3 expref: 12 pid: 6500 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893089.914546:0:10383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c771f600/0x9232577658cf0d64 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa6c3 expref: 12 pid: 6500 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893089.914561:0:10383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fc8c7c7f000/0x9232577658cf0ea6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893089.914569:0:10383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c7c7f000/0x9232577658cf0ea6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893089.914583:0:10383:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc8c7c7f000/0x9232577658cf0ea6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893089.914589:0:10383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc8c7c7f000/0x9232577658cf0ea6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893089.914595:0:10383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fc8c7c7f000/0x9232577658cf0ea6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893089.914610:0:10383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fc8c7c7f000/0x9232577658cf0ea6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893089.914616:0:10383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7f000 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893089.914619:0:10383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fc8c7c7f000/0x9232577658cf0ea6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893089.914626:0:10383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fc8c7c7f000/0x9232577658cf0ea6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893089.914656:0:10383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fc8c7c7f000/0x9232577658cf0ea6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893089.914665:0:10383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893089.914708:0:10383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+11:2390:x1874741481729664:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 244us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893089.914716:0:10383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 51 00010000:00010000:3.0:1787893089.915195:0:13718:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fc8c7c7f000/0x9232577658cf0ea6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893089.915204:0:13718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fc8c7c7f000/0x9232577658cf0ea6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893089.915209:0:13718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c7c7f000/0x9232577658cf0ea6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893089.975023:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893090.335326:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893090.335382:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893090.335415:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893090.335454:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893090.335478:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893090.335541:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893090.335566:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481729792 00000100:00100000:3.0:1787893090.335575:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481729792 00000100:00100000:3.0:1787893090.335624:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 343 00000100:00100000:3.0:1787893090.335635:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+11:2390:x1874741481729792:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893090.335701:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+11:2390:x1874741481729792:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 69us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893090.335709:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 343 00000100:00100000:3.0:1787893090.335756:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481729920 00000100:00100000:3.0:1787893090.335760:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481729920 00000100:00100000:3.0:1787893090.335794:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481730432 00000100:00100000:3.0:1787893090.335798:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481730432 00000100:00100000:3.0:1787893090.335816:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481730048 00000100:00100000:3.0:1787893090.335818:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481730048 00000100:00100000:3.0:1787893090.335842:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481730304 00000100:00100000:3.0:1787893090.335846:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481730304 00000100:00100000:3.0:1787893090.335878:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 247 00000100:00100000:3.0:1787893090.335884:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481729920:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893090.335917:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481729920:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 32us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893090.335923:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 247 00000100:00100000:3.0:1787893090.335933:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 248 00000100:00100000:3.0:1787893090.335938:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481730432:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893090.335961:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481730432:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 23us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893090.335966:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 248 00000100:00100000:3.0:1787893090.335977:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 249 00000100:00100000:3.0:1787893090.335983:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481730048:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893090.336002:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481730048:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 21us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893090.336007:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 249 00000100:00100000:3.0:1787893090.336018:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 250 00000100:00100000:3.0:1787893090.336024:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481730304:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893090.336043:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481730304:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 20us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893090.336048:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 250 00000100:00080000:3.0:1787893090.336197:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787893090.336201:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787893090.336298:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481730176 00000100:00100000:0.0:1787893090.336304:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481730176 00000100:00100000:0.0:1787893090.336347:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 96 00000100:00100000:0.0:1787893090.336355:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481730176:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893090.336404:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481730176:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 50us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893090.336410:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 96 00000100:00080000:2.0:1787893090.336871:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:2.0:1787893090.903416:0:13767:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd0d937ab0 20000000:00000080:2.0:1787893090.903433:0:13767:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fc9fe556800 uarg=0000000000000000 20000000:01000000:2.0:1787893090.903477:0:13767:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1787893090.903484:0:13767:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1787893090.903647:0:13767:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:1.0:1787893090.904256:0:13768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:2.0:1787893090.904436:0:13767:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:2.0:1787893090.905081:0:13767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:2.0:1787893090.905113:0:13767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:2.0:1787893090.905130:0:13767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:2.0:1787893090.905142:0:13767:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787893090.905161:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fc8c7c7f200/0x9232577658cf0ead lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893090.905175:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c7c7f200/0x9232577658cf0ead lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893090.905184:0:13767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc8c7c7f200/0x9232577658cf0ead lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893090.905191:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc8c7c7f200/0x9232577658cf0ead lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893090.905208:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fc8c7c7f200/0x9232577658cf0ead lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893090.905215:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fc8c7c7f200/0x9232577658cf0ead lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893090.905221:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7f200 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787893090.905225:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fc8c7c7f200/0x9232577658cf0ead lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893090.905232:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fc8c7c7f200/0x9232577658cf0ead lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893090.905245:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fc8c7c7f200/0x9232577658cf0ead lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893090.905252:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fc8c7c7f200/0x9232577658cf0ead lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893090.905258:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c7c7f200/0x9232577658cf0ead lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893090.994681:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893091.161964:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893091.162952:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481730560 00000100:00100000:0.0:1787893091.162963:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481730560 00000100:00100000:0.0:1787893091.163020:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 344 00000100:00100000:0.0:1787893091.163029:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+11:6165:x1874741481730560:12345-192.168.202.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787893091.163154:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893091.163174:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9edb31a00/0x9232577658cf0eb4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa717 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893091.163203:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9edb31a00/0x9232577658cf0eb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa717 expref: 12 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893091.163214:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9edb31a00/0x9232577658cf0eb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa717 expref: 12 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893091.163223:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb31a00, rc 0) 00000100:00100000:0.0:1787893091.163931:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+12:6165:x1874741481730560:12345-192.168.202.35@tcp:101:ll_cfg_requeue.0 Request processed in 899us (1973us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893091.163941:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 344 00000100:00100000:0.0:1787893091.171519:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893091.171632:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481730688 00000100:00100000:3.0:1787893091.171642:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481730688 00000100:00100000:3.0:1787893091.171709:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 345 00000100:00100000:3.0:1787893091.171719:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+12:6165:x1874741481730688:12345-192.168.202.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787893091.171873:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+12:6165:x1874741481730688:12345-192.168.202.35@tcp:501:ll_cfg_requeue.0 Request processed in 155us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893091.171882:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 345 00000100:00100000:1.0:1787893091.176448:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893091.176544:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481730816 00000100:00100000:0.0:1787893091.176555:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481730816 00000100:00100000:0.0:1787893091.176616:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 346 00000100:00100000:0.0:1787893091.176626:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+12:6165:x1874741481730816:12345-192.168.202.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787893091.176793:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+12:6165:x1874741481730816:12345-192.168.202.35@tcp:503:ll_cfg_requeue.0 Request processed in 168us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893091.176802:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 346 00000100:00100000:1.0:1787893091.182617:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893091.182738:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481730944 00000100:00100000:2.0:1787893091.182749:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481730944 00000100:00100000:2.0:1787893091.182803:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 347 00000100:00100000:2.0:1787893091.182812:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+12:10781:x1874741481730944:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787893091.182964:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+12:10781:x1874741481730944:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 152us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893091.182972:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 347 00000100:00100000:1.0:1787893091.191000:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893091.191086:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481731072 00000100:00100000:0.0:1787893091.191095:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481731072 00000100:00100000:0.0:1787893091.191161:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 348 00000100:00100000:0.0:1787893091.191171:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+12:10781:x1874741481731072:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787893091.191346:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+12:10781:x1874741481731072:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 175us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893091.191354:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 348 00000100:00100000:1.0:1787893091.210473:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893091.210677:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481731200 00000100:00100000:2.0:1787893091.210688:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481731200 00000100:00100000:2.0:1787893091.210756:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 349 00000100:00100000:2.0:1787893091.210766:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+12:6165:x1874741481731200:12345-192.168.202.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787893091.210784:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893091.210801:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c7c7f000/0x9232577658cf0ebb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa71e expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893091.210827:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c7c7f000/0x9232577658cf0ebb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa71e expref: 13 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893091.210837:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c7c7f000/0x9232577658cf0ebb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa71e expref: 13 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893091.210846:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7f000, rc 0) 00000100:00100000:2.0:1787893091.210905:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:6165:x1874741481731200:12345-192.168.202.35@tcp:101:ll_cfg_requeue.0 Request processed in 140us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893091.210912:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 349 00000100:00100000:1.0:1787893091.229809:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893091.229899:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481731328 00000100:00100000:3.0:1787893091.229910:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481731328 00000100:00100000:3.0:1787893091.229972:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 350 00000100:00100000:3.0:1787893091.229982:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:6165:x1874741481731328:12345-192.168.202.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787893091.230127:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:6165:x1874741481731328:12345-192.168.202.35@tcp:501:ll_cfg_requeue.0 Request processed in 146us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893091.230136:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 350 00000100:00100000:1.0:1787893091.236201:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893091.236761:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481731456 00000100:00100000:0.0:1787893091.236772:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481731456 00000100:00100000:0.0:1787893091.236834:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 351 00000100:00100000:0.0:1787893091.236845:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:6165:x1874741481731456:12345-192.168.202.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787893091.237003:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:6165:x1874741481731456:12345-192.168.202.35@tcp:503:ll_cfg_requeue.0 Request processed in 159us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893091.237012:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 351 00000100:00100000:1.0:1787893091.245698:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893091.246909:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481731584 00000100:00100000:2.0:1787893091.246921:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481731584 00000100:00100000:2.0:1787893091.246991:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 352 00000100:00100000:2.0:1787893091.247002:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:10785:x1874741481731584:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787893091.247179:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:10785:x1874741481731584:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 177us (1491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893091.247187:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 352 00000100:00100000:1.0:1787893091.259680:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893091.259815:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481731712 00000100:00100000:0.0:1787893091.259828:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481731712 00000100:00100000:0.0:1787893091.259897:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 353 00000100:00100000:0.0:1787893091.259908:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:10785:x1874741481731712:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787893091.260090:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:10785:x1874741481731712:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 183us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893091.260099:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 353 00000100:00100000:0.0:1787893091.509985:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787893091.510008:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493353472:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787893091.510079:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893091.510255:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493353472 00000100:00100000:3.0:1787893091.510264:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493353472 00000100:00100000:3.0:1787893091.510326:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787893091.510337:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493353472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787893091.510398:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787893091.510444:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493353472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893091.510452:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787893091.510561:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787893091.510572:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493353600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787893091.510618:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893091.512579:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493353600 00000100:00100000:1.0:1787893091.512592:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493353600 00000100:00100000:1.0:1787893091.512657:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787893091.512668:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493353600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787893091.512692:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787893091.512784:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493353600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (2158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893091.512790:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:2.0:1787893091.512932:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb75180 x1874741493353600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893107 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893091.512963:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493353600:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787893091.513228:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787893091.513257:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffc5c000 x1874741493353472/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893107 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893091.513271:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493353472:0@lo:13:osp-pre-0-1.0 10000000:01000000:3.0:1787893091.827754:0:6502:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787893091.827766:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc9e70bc000 from 7 10000000:01000000:3.0:1787893091.827771:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787893091.827820:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d400/0x9232577658cf0ec2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893091.827849:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d400/0x9232577658cf0ec2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893091.827861:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d400/0x9232577658cf0ec2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893091.827886:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493353728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787893091.827957:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893091.828043:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c6696240 going to sleep for 11 seconds 00000100:00100000:0.0:1787893091.828433:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493353728 00000100:00100000:0.0:1787893091.828442:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493353728 00000100:00100000:0.0:1787893091.828534:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1787893091.828544:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+20:6502:x1874741493353728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787893091.828558:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893091.828571:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0ec9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0ec2 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893091.828595:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0ec9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0ec2 expref: 21 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893091.828605:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0ec9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0ec2 expref: 21 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893091.828614:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb30c00, rc 0) 00000100:00100000:0.0:1787893091.828671:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+21:6502:x1874741493353728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893091.828678:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1787893091.828884:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493353728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787893091.828900:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d400/0x9232577658cf0ec2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0ec9 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893091.828909:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d400/0x9232577658cf0ec2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0ec9 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893091.828987:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493353856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787893091.829019:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893091.829050:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c6696240 going to sleep for 11 seconds 00000100:00100000:2.0:1787893091.829116:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493353856 00000100:00100000:2.0:1787893091.829121:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493353856 00000100:00100000:2.0:1787893091.829157:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1787893091.829166:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+21:6502:x1874741493353856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787893091.829284:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+21:6502:x1874741493353856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893091.829291:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1787893091.829615:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493353856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787893091.829643:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493353984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787893091.829683:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893091.829708:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c6696240 going to sleep for 11 seconds 00000100:00100000:2.0:1787893091.829758:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493353984 00000100:00100000:2.0:1787893091.829762:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493353984 00000100:00100000:2.0:1787893091.829792:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1787893091.829798:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+21:6502:x1874741493353984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787893091.829972:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+21:6502:x1874741493353984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 172us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893091.829979:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1787893091.830783:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493353984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787893091.831196:0:13781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb75180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:13781:1874741493354112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787893091.831247:0:13781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893091.831288:0:13781:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c71350c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787893091.831486:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493354112 00000100:00100000:0.0:1787893091.831508:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493354112 00000100:00100000:0.0:1787893091.831551:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1787893091.831561:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+21:13781:x1874741493354112:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787893091.831678:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+21:13781:x1874741493354112:12345-0@lo:502:llog_process_th.0 Request processed in 117us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893091.831687:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1787893091.831985:0:13781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb75180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:13781:1874741493354112:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787893091.832013:0:13781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787893091.832023:0:13781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893091.832025:0:13781:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787893091.832036:0:13781:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc9e70bc000 00000020:00000080:2.0:1787893091.832038:0:13781:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787893091.832112:0:13781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787893091.832117:0:13781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893091.832119:0:13781:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787893091.832121:0:13781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787893091.832124:0:13781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893091.832125:0:13781:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787893091.832129:0:13781:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc9e70bc000 00000020:00000080:2.0:1787893091.832131:0:13781:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787893091.832168:0:13781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb75180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:13781:1874741493354240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787893091.832202:0:13781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893091.832235:0:13781:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c71350c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787893091.836402:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493354240 00000100:00100000:0.0:1787893091.836420:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493354240 00000100:00100000:0.0:1787893091.836485:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1787893091.836526:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+21:13781:x1874741493354240:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787893091.836683:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+21:13781:x1874741493354240:12345-0@lo:502:llog_process_th.0 Request processed in 159us (4479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893091.836691:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1787893091.836869:0:13781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb75180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:13781:1874741493354240:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787893091.836906:0:13781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787893091.836915:0:13781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893091.836918:0:13781:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787893091.836922:0:13781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1787893091.837771:0:6502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1787893091.837804:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787893091.837814:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d400/0x9232577658cf0ec2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0ec9 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893091.837826:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d400/0x9232577658cf0ec2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0ec9 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787893091.837837:0:6502:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787893091.837840:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc9fe136000 from 7 10000000:01000000:0.0:1787893091.837842:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787893091.837877:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30e00/0x9232577658cf0ed0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893091.837886:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30e00/0x9232577658cf0ed0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893091.837895:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30e00/0x9232577658cf0ed0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893091.837915:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493354368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787893091.837974:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893091.838005:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c67dc840 going to sleep for 11 seconds 00000100:00100000:3.0:1787893091.838719:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493354368 00000100:00100000:3.0:1787893091.838728:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493354368 00000100:00100000:3.0:1787893091.838779:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1787893091.838788:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+21:6502:x1874741493354368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787893091.838801:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893091.838815:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9c147dc00/0x9232577658cf0ed7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0ed0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893091.838838:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9c147dc00/0x9232577658cf0ed7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0ed0 expref: 22 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893091.838849:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9c147dc00/0x9232577658cf0ed7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0ed0 expref: 22 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893091.838857:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9c147dc00, rc 0) 00000100:00100000:3.0:1787893091.838910:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+22:6502:x1874741493354368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893091.838917:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1787893091.839208:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493354368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787893091.839227:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30e00/0x9232577658cf0ed0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0ed7 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893091.839236:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30e00/0x9232577658cf0ed0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0ed7 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893091.839316:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493354496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787893091.839357:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893091.839388:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c73f96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787893091.839420:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493354496 00000100:00100000:1.0:1787893091.839424:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493354496 00000100:00100000:1.0:1787893091.839447:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1787893091.839453:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+22:6502:x1874741493354496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787893091.839588:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+22:6502:x1874741493354496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893091.839595:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1787893091.839627:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493354496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787893091.839665:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493354624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787893091.839704:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893091.839718:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c73f96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787893091.839729:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493354624 00000100:00100000:1.0:1787893091.839732:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493354624 00000100:00100000:1.0:1787893091.839749:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1787893091.839754:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+22:6502:x1874741493354624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787893091.839831:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+22:6502:x1874741493354624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893091.839838:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1787893091.839875:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493354624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787893091.850016:0:13783:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:13783:1874741493354752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787893091.850114:0:13783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893091.850164:0:13783:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c73f9780 going to sleep for 11 seconds 00000100:00100000:0.0:1787893091.850448:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493354752 00000100:00100000:0.0:1787893091.850464:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493354752 00000100:00100000:0.0:1787893091.850550:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1787893091.850560:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+22:13783:x1874741493354752:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787893091.850688:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+22:13783:x1874741493354752:12345-0@lo:502:llog_process_th.0 Request processed in 129us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893091.850696:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1787893091.851030:0:13783:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:13783:1874741493354752:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787893091.851077:0:13783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787893091.851087:0:13783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893091.851090:0:13783:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787893091.851096:0:13783:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc9fe136000 00000020:00000080:1.0:1787893091.851099:0:13783:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787893091.851182:0:13783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787893091.851186:0:13783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893091.851187:0:13783:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787893091.851190:0:13783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787893091.851193:0:13783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893091.851195:0:13783:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787893091.851199:0:13783:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc9fe136000 00000020:00000080:1.0:1787893091.851201:0:13783:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787893091.851241:0:13783:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:13783:1874741493354880:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787893091.851292:0:13783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893091.851318:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493354880 00000100:00100000:1.0:1787893091.851322:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493354880 00000100:00100000:1.0:1787893091.851348:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1787893091.851355:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+22:13783:x1874741493354880:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787893091.851443:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+22:13783:x1874741493354880:12345-0@lo:502:llog_process_th.0 Request processed in 88us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893091.851451:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1787893091.851509:0:13783:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c73f9780 going to sleep for 11 seconds 00000100:00100000:1.0:1787893091.851523:0:13783:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:13783:1874741493354880:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787893091.851544:0:13783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787893091.851548:0:13783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893091.851550:0:13783:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787893091.851553:0:13783:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1787893091.851619:0:6502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1787893091.851637:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787893091.851647:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30e00/0x9232577658cf0ed0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0ed7 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893091.851658:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30e00/0x9232577658cf0ed0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0ed7 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893091.851669:0:6502:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787893091.851672:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc9ed573800 from 7 10000000:01000000:1.0:1787893091.851674:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787893091.851698:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541e00/0x9232577658cf0ede lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893091.851706:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541e00/0x9232577658cf0ede lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893091.851715:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541e00/0x9232577658cf0ede lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893091.851727:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493355008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787893091.851755:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893091.851769:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c1254e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787893091.851783:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493355008 00000100:00100000:1.0:1787893091.851787:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493355008 00000100:00100000:1.0:1787893091.851810:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1787893091.851816:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+22:6502:x1874741493355008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787893091.851824:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893091.851836:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9fe541400/0x9232577658cf0ee5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0ede expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893091.851867:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9fe541400/0x9232577658cf0ee5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0ede expref: 23 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893091.851877:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9fe541400/0x9232577658cf0ee5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0ede expref: 23 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893091.851886:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe541400, rc 0) 00000100:00100000:1.0:1787893091.855444:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+23:6502:x1874741493355008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3616us (3676us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893091.855457:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1787893091.861580:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493355008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787893091.861609:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541e00/0x9232577658cf0ede lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0ee5 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893091.861621:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541e00/0x9232577658cf0ede lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0ee5 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893091.861721:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493355136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787893091.861796:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893091.861841:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7135b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787893091.862306:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493355136 00000100:00100000:1.0:1787893091.862314:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493355136 00000100:00100000:1.0:1787893091.862368:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1787893091.862379:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+23:6502:x1874741493355136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787893091.862531:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+23:6502:x1874741493355136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 153us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893091.862539:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1787893091.862738:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493355136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787893091.862786:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493355264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787893091.862830:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893091.862861:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7135b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787893091.862911:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493355264 00000100:00100000:1.0:1787893091.862916:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493355264 00000100:00100000:1.0:1787893091.862956:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1787893091.862964:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+23:6502:x1874741493355264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787893091.863042:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+23:6502:x1874741493355264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893091.863048:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1787893091.863088:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493355264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787893091.863667:0:13785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:13785:1874741493355392:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787893091.863705:0:13785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893091.863732:0:13785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9f3e75000 going to sleep for 11 seconds 00000100:00100000:0.0:1787893091.863872:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493355392 00000100:00100000:0.0:1787893091.863878:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493355392 00000100:00100000:0.0:1787893091.863925:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1787893091.863942:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+23:13785:x1874741493355392:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787893091.864025:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+23:13785:x1874741493355392:12345-0@lo:502:llog_process_th.0 Request processed in 92us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893091.864032:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1787893091.864262:0:13785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:13785:1874741493355392:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787893091.864305:0:13785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787893091.864315:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893091.864317:0:13785:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787893091.864324:0:13785:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc9ed573800 00000020:00000080:1.0:1787893091.864327:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787893091.864396:0:13785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787893091.864400:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893091.864401:0:13785:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787893091.864404:0:13785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787893091.864406:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893091.864407:0:13785:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787893091.864410:0:13785:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc9ed573800 00000020:00000080:1.0:1787893091.864412:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787893091.864444:0:13785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:13785:1874741493355520:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787893091.864514:0:13785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893091.864539:0:13785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c2f53f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787893091.864656:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493355520 00000100:00100000:2.0:1787893091.864668:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493355520 00000100:00100000:2.0:1787893091.864703:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1787893091.864711:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+23:13785:x1874741493355520:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787893091.864790:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+23:13785:x1874741493355520:12345-0@lo:502:llog_process_th.0 Request processed in 80us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893091.864797:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1787893091.865079:0:13785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:13785:1874741493355520:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787893091.865115:0:13785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787893091.865121:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893091.865123:0:13785:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787893091.865126:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1787893091.865395:0:6502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1787893091.865417:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787893091.865426:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541e00/0x9232577658cf0ede lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0ee5 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893091.865437:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541e00/0x9232577658cf0ede lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0ee5 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893091.865447:0:6502:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787893091.865449:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc9d909c800 from 7 10000000:01000000:2.0:1787893091.865452:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787893091.865515:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7ec00/0x9232577658cf0eec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893091.865524:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7ec00/0x9232577658cf0eec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893091.865533:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7ec00/0x9232577658cf0eec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893091.865549:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493355648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787893091.865585:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893091.865605:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7135840 going to sleep for 11 seconds 00000100:00100000:1.0:1787893091.865721:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493355648 00000100:00100000:1.0:1787893091.865727:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493355648 00000100:00100000:1.0:1787893091.865860:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1787893091.865876:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+23:6502:x1874741493355648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787893091.865888:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893091.865910:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9fe540400/0x9232577658cf0ef3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf0eec expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893091.865932:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9fe540400/0x9232577658cf0ef3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf0eec expref: 24 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893091.865951:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9fe540400/0x9232577658cf0ef3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf0eec expref: 24 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893091.865959:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe540400, rc 0) 00000100:00100000:1.0:1787893091.865994:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+24:6502:x1874741493355648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893091.868734:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493355648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787893091.868762:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7ec00/0x9232577658cf0eec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0ef3 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893091.868775:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7ec00/0x9232577658cf0eec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0ef3 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893091.868851:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493355776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787893091.868909:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893091.868948:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c6696600 going to sleep for 11 seconds 00000040:00080000:3.0:1787893091.870609:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787893091.872040:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493355776 00000100:00100000:0.0:1787893091.872053:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493355776 00000100:00100000:1.0:1787893091.872371:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1787893091.883962:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1787893091.883988:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+24:6502:x1874741493355776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787893091.884180:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+24:6502:x1874741493355776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 204us (15270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893091.884188:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1787893091.884203:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493355776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787893091.884277:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493355904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787893091.884326:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893091.894164:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c6696600 going to sleep for 11 seconds 00000100:00100000:2.0:1787893091.894176:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493355904 00000100:00100000:2.0:1787893091.894199:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493355904 00000100:00100000:3.0:1787893091.894262:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1787893091.894271:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+24:6502:x1874741493355904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787893091.894427:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+24:6502:x1874741493355904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (10101us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893091.894434:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1787893091.896043:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ad7764-cf95-4087-88aa-57e4229a8397:6502:1874741493355904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787893091.904337:0:13788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:13788:1874741493356032:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787893091.904428:0:13788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893091.904480:0:13788:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c70b8840 going to sleep for 11 seconds 00000100:00100000:3.0:1787893091.904556:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493356032 00000100:00100000:3.0:1787893091.904563:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493356032 00000100:00100000:3.0:1787893091.904611:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1787893091.904621:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+24:13788:x1874741493356032:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787893091.904730:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+24:13788:x1874741493356032:12345-0@lo:502:llog_process_th.0 Request processed in 111us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893091.904737:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1787893091.904934:0:13788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:13788:1874741493356032:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787893091.904959:0:13788:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787893091.904972:0:13788:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893091.904974:0:13788:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787893091.904981:0:13788:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc9d909c800 00000020:00000080:0.0:1787893091.904983:0:13788:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787893091.905041:0:13788:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787893091.905044:0:13788:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893091.905045:0:13788:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787893091.905047:0:13788:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787893091.905049:0:13788:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893091.905051:0:13788:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787893091.905054:0:13788:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc9d909c800 00000020:00000080:0.0:1787893091.905055:0:13788:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787893091.905083:0:13788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:13788:1874741493356160:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787893091.905123:0:13788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893091.905147:0:13788:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c70b8840 going to sleep for 11 seconds 00000100:00100000:0.0:1787893091.906377:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493356160 00000100:00100000:0.0:1787893091.906386:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493356160 00000100:00100000:0.0:1787893091.906430:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1787893091.906438:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+24:13788:x1874741493356160:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787893091.906569:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+24:13788:x1874741493356160:12345-0@lo:502:llog_process_th.0 Request processed in 131us (1445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893091.906576:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1787893091.906623:0:13788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ad7764-cf95-4087-88aa-57e4229a8397:13788:1874741493356160:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787893091.906645:0:13788:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787893091.906650:0:13788:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893091.906653:0:13788:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787893091.906656:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1787893091.906948:0:6502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1787893091.906970:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787893091.906979:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7ec00/0x9232577658cf0eec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0ef3 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893091.906991:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7ec00/0x9232577658cf0eec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0ef3 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787893091.928334:0:13789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787893092.018203:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787893092.914378:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1787893092.980710:0:13789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787893093.042112:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1787893093.042126:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893093.042137:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493356288:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787893093.042238:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893093.042363:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493356288 00000100:00100000:3.0:1787893093.042371:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493356288 00000100:00100000:3.0:1787893093.042436:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787893093.042446:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493356288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787893093.042479:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787893093.042559:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493356288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893093.042566:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787893093.042657:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493356288:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787893094.066148:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893094.067902:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787893094.067932:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493356416:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787893094.068080:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893094.068243:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493356416 00000100:00100000:3.0:1787893094.068251:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493356416 00000100:00100000:3.0:1787893094.068302:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787893094.068312:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493356416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787893094.068356:0:7865:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787893094.068413:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493356416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893094.068420:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787893094.068878:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493356416:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787893094.577966:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493356544:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787893094.578059:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893094.578154:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493356544 00000100:00100000:2.0:1787893094.578161:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493356544 00000100:00100000:2.0:1787893094.578210:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787893094.578221:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493356544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787893094.578252:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787893094.578298:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493356544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893094.578306:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787893094.578367:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493356544:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787893094.578624:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787893094.578655:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493356672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787893094.578689:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893094.578854:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493356672 00000100:00100000:1.0:1787893094.578859:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493356672 00000100:00100000:1.0:1787893094.578897:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787893094.578904:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3631:x1874741493356672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787893094.578916:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787893094.578949:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3631:x1874741493356672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893094.578955:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787893094.579077:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493356672:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787893094.579242:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787893094.579580:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493356800:0@lo:400:kworker.0 00000100:00100000:1.0:1787893094.579619:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893094.579648:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7200a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493357312:0@lo:400:kworker.0 00000100:00100000:1.0:1787893094.579673:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893094.579691:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe34ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493357824:0@lo:400:kworker.0 00000100:00100000:1.0:1787893094.579714:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893094.579732:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787893094.579737:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7201500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1874741493357184:0@lo:400:kworker.0 00000100:00100000:1.0:1787893094.579761:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893094.579777:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493357696:0@lo:400:kworker.0 00000100:00100000:1.0:1787893094.579799:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893094.579826:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493357312 00000100:00100000:1.0:1787893094.579830:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493357312 00000100:00100000:1.0:1787893094.579858:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787893094.579867:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493357312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893094.579906:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493357312:12345-0@lo:400:kworker.0 Request processed in 41us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893094.579912:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787893094.579940:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7200a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493357312:0@lo:400:kworker.0 00000100:00100000:1.0:1787893094.579973:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493356928:0@lo:400:kworker.0 00000100:00100000:1.0:1787893094.579998:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893094.580015:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7203b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493357440:0@lo:400:kworker.0 00000100:00100000:1.0:1787893094.580050:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893094.580065:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe348700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1874741493357952:0@lo:400:kworker.0 00000100:00100000:1.0:1787893094.580098:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893094.580113:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787893094.580118:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493357056:0@lo:400:kworker.0 00000100:00100000:1.0:1787893094.580135:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893094.580149:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7200380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493357568:0@lo:400:kworker.0 00000100:00100000:1.0:1787893094.580165:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893094.580179:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe349c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493358080:0@lo:400:kworker.0 00000100:00100000:1.0:1787893094.580197:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893094.580219:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493357184 00000100:00100000:1.0:1787893094.580222:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493357184 00000100:00100000:1.0:1787893094.580244:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493356928 00000100:00100000:1.0:1787893094.580246:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493356928 00000100:00100000:1.0:1787893094.580256:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493357440 00000100:00100000:1.0:1787893094.580258:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493357440 00000100:00100000:1.0:1787893094.580274:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493357952 00000100:00100000:1.0:1787893094.580277:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493357952 00000100:00100000:1.0:1787893094.580288:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493357568 00000100:00100000:1.0:1787893094.580290:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493357568 00000100:00100000:1.0:1787893094.580300:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493358080 00000100:00100000:1.0:1787893094.580302:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493358080 00000100:00100000:1.0:1787893094.580314:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1787893094.580320:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1874741493357184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893094.580367:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1874741493357184:12345-0@lo:400:kworker.0 Request processed in 47us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893094.580373:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1787893094.580385:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1787893094.580390:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493356928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893094.580416:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493356928:12345-0@lo:400:kworker.0 Request processed in 27us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893094.580428:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1787893094.580440:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1787893094.580445:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493357440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893094.580468:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493357440:12345-0@lo:400:kworker.0 Request processed in 24us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893094.580473:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1787893094.580481:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1787893094.580591:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1874741493357952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893094.580621:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1874741493357952:12345-0@lo:400:kworker.0 Request processed in 135us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893094.580628:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1787893094.580641:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1787893094.580648:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493357568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893094.580674:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493357568:12345-0@lo:400:kworker.0 Request processed in 27us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893094.580679:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1787893094.580690:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787893094.580696:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493358080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893094.580723:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493358080:12345-0@lo:400:kworker.0 Request processed in 27us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893094.580728:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00010000:00080000:1.0:1787893094.580758:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e7200380 x1874741493357568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893094.580770:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7200380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493357568:0@lo:400:kworker.0 00010000:00080000:1.0:1787893094.580788:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9fe349c00 x1874741493358080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893094.580797:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe349c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493358080:0@lo:400:kworker.0 00000100:00100000:1.0:1787893094.580806:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493356928:0@lo:400:kworker.0 00000100:00100000:1.0:1787893094.580814:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7203b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493357440:0@lo:400:kworker.0 00000100:00100000:1.0:1787893094.580823:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe348700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1874741493357952:0@lo:400:kworker.0 00000100:00100000:1.0:1787893094.580847:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493357056 00000100:00100000:1.0:1787893094.580851:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493357056 00000100:00100000:1.0:1787893094.580876:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787893094.580882:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7200a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493357056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893094.580917:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7200a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493357056:12345-0@lo:400:kworker.0 Request processed in 35us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893094.580923:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787893094.580950:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493357056:0@lo:400:kworker.0 00000100:00100000:1.0:1787893094.580972:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7201500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1874741493357184:0@lo:400:kworker.0 00000100:00100000:1.0:1787893094.581003:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493356800 00000100:00100000:1.0:1787893094.581007:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493356800 00000100:00100000:1.0:1787893094.581032:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1787893094.581038:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+24:3631:x1874741493356800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893094.581069:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+24:3631:x1874741493356800:12345-0@lo:400:kworker.0 Request processed in 32us (1450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893094.581075:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1787893094.581105:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493356800:0@lo:400:kworker.0 00000100:00080000:1.0:1787893094.581132:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787893094.581135:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787893094.582074:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493357824 00000100:00100000:2.0:1787893094.582082:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493357824 00000100:00100000:2.0:1787893094.582128:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493357696 00000100:00100000:2.0:1787893094.582132:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493357696 00000100:00100000:2.0:1787893094.582155:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787893094.582163:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493357824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893094.582222:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493357824:12345-0@lo:400:kworker.0 Request processed in 60us (2506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893094.582228:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787893094.582252:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787893094.582258:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493357696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893094.582291:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493357696:12345-0@lo:400:kworker.0 Request processed in 33us (2490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893094.582297:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:2.0:1787893094.582353:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e7202a00 x1874741493357696/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893094.582367:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493357696:0@lo:400:kworker.0 00010000:00080000:2.0:1787893094.582380:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9fe34ad80 x1874741493357824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893094.582387:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe34ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493357824:0@lo:400:kworker.0 00000100:00080000:1.0:1787893094.582751:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787893095.095465:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787893095.096203:0:9497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:1.0:1787893095.462004:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893095.462179:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481731840 00000100:00100000:3.0:1787893095.462189:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481731840 00000100:00100000:3.0:1787893095.462263:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 375 00000100:00100000:3.0:1787893095.462273:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2391:x1874741481731840:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893095.462396:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2391:x1874741481731840:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 123us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893095.462405:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 375 00000100:00100000:3.0:1787893095.463214:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893095.463285:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481731968 00000100:00100000:1.0:1787893095.463291:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481731968 00000100:00100000:1.0:1787893095.463363:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 257 00000100:00100000:1.0:1787893095.463372:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+5:2391:x1874741481731968:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893095.463431:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+5:2391:x1874741481731968:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 60us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893095.463438:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 257 00000100:00080000:0.0:1787893095.464731:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787893095.470130:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893095.470184:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893095.470280:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481732096 00000100:00100000:3.0:1787893095.470291:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481732096 00000100:00100000:3.0:1787893095.470373:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481732352 00000100:00100000:3.0:1787893095.470377:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481732352 00000100:00100000:3.0:1787893095.470411:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 258 00000100:00100000:3.0:1787893095.470421:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe34ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+5:2391:x1874741481732096:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893095.470527:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe34ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+5:2391:x1874741481732096:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 107us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893095.470535:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 258 00000100:00100000:3.0:1787893095.470552:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 259 00000100:00100000:3.0:1787893095.470559:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe348700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2391:x1874741481732352:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893095.470586:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe348700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2391:x1874741481732352:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 28us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893095.470592:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 259 00000100:00080000:0.0:1787893095.471848:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787893095.471857:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787893095.474885:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893095.474958:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893095.475128:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481732480 00000100:00100000:1.0:1787893095.475138:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481732480 00000100:00100000:1.0:1787893095.475214:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 260 00000100:00100000:1.0:1787893095.475224:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481732480:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893095.475292:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481732480:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 70us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893095.475299:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 260 00000100:00100000:0.0:1787893095.476187:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481732224 00000100:00100000:0.0:1787893095.476195:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481732224 00000100:00100000:0.0:1787893095.476243:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 99 00000100:00100000:0.0:1787893095.476253:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481732224:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893095.476293:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481732224:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 42us (1431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893095.476300:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 99 00000100:00080000:2.0:1787893095.476513:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787893095.476519:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787893096.114534:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893096.626559:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787893096.626590:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493358208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787893096.626688:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893096.627238:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493358336:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787893096.627273:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893096.627366:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493358208 00000100:00100000:1.0:1787893096.627375:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493358208 00000100:00100000:1.0:1787893096.627441:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493358336 00000100:00100000:1.0:1787893096.627445:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493358336 00000100:00100000:1.0:1787893096.627467:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787893096.627476:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493358208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787893096.627549:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787893096.627605:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493358208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893096.627612:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787893096.627645:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787893096.627652:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493358336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787893096.627665:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787893096.627689:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493358336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893096.627695:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:1.0:1787893096.627738:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e711d500 x1874741493358336/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893112 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893096.627766:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493358336:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1787893096.627900:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb99500 x1874741493358208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893112 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893096.627915:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493358208:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787893096.628034:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787893097.139644:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893098.161973:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893098.162417:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493358464:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787893098.162540:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893098.163071:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493358464 00000100:00100000:2.0:1787893098.163080:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493358464 00000100:00100000:2.0:1787893098.163154:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787893098.163164:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493358464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787893098.163211:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787893098.167073:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493358464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3902us (4525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893098.167086:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787893098.170527:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493358464:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787893099.186354:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893099.187304:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493358592:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787893099.187377:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893099.187525:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493358592 00000100:00100000:0.0:1787893099.187535:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493358592 00000100:00100000:0.0:1787893099.187585:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787893099.187594:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493358592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787893099.187631:0:7865:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787893099.187686:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493358592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893099.187693:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787893099.187881:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493358592:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787893099.697764:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787893099.697790:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493358720:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787893099.697901:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893099.698070:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493358720 00000100:00100000:2.0:1787893099.698079:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493358720 00000100:00100000:2.0:1787893099.698143:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787893099.698155:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493358720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787893099.698200:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787893099.698245:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493358720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893099.698252:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787893099.698363:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493358720:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787893099.698442:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787893099.698650:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874741493359104:0@lo:400:kworker.0 00000100:00100000:3.0:1787893099.698686:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893099.698707:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493359616:0@lo:400:kworker.0 00000100:00100000:3.0:1787893099.698731:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893099.698747:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493360128:0@lo:400:kworker.0 00000100:00100000:3.0:1787893099.698766:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893099.698793:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787893099.698799:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874741493358976:0@lo:400:kworker.0 00000100:00100000:3.0:1787893099.698819:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893099.698834:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1874741493359488:0@lo:400:kworker.0 00000100:00100000:3.0:1787893099.698852:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893099.698866:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1874741493360000:0@lo:400:kworker.0 00000100:00100000:3.0:1787893099.698885:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893099.698911:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493359104 00000100:00100000:3.0:1787893099.698915:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493359104 00000100:00100000:3.0:1787893099.698941:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493358976 00000100:00100000:3.0:1787893099.698944:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493358976 00000100:00100000:3.0:1787893099.698958:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493359488 00000100:00100000:3.0:1787893099.698961:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493359488 00000100:00100000:3.0:1787893099.698975:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493360000 00000100:00100000:3.0:1787893099.698977:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493360000 00000100:00100000:3.0:1787893099.698990:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1787893099.698996:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1874741493359104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893099.699037:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1874741493359104:12345-0@lo:400:kworker.0 Request processed in 40us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893099.699044:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1787893099.699057:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787893099.699062:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1874741493358976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893099.699088:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1874741493358976:12345-0@lo:400:kworker.0 Request processed in 27us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893099.699093:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787893099.699104:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1787893099.699111:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1874741493359488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893099.699148:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1874741493359488:12345-0@lo:400:kworker.0 Request processed in 38us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893099.699154:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1787893099.699165:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787893099.699171:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1874741493360000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893099.699195:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1874741493360000:12345-0@lo:400:kworker.0 Request processed in 25us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893099.699202:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787893099.699245:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493359616 00000100:00100000:3.0:1787893099.699250:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493359616 00000100:00100000:3.0:1787893099.699273:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493360128 00000100:00100000:3.0:1787893099.699276:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493360128 00000100:00100000:3.0:1787893099.699309:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787893099.699316:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493359616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893099.699346:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493359616:12345-0@lo:400:kworker.0 Request processed in 32us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893099.699352:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787893099.699362:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787893099.699368:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493360128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893099.699390:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493360128:12345-0@lo:400:kworker.0 Request processed in 23us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893099.699395:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787893099.699432:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874741493358976:0@lo:400:kworker.0 00010000:00080000:3.0:1787893099.699444:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffc5c000 x1874741493359488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893099.699466:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1874741493359488:0@lo:400:kworker.0 00010000:00080000:3.0:1787893099.699477:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7524700 x1874741493360000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893099.699484:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1874741493360000:0@lo:400:kworker.0 00000100:00100000:3.0:1787893099.699517:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874741493359104:0@lo:400:kworker.0 00010000:00080000:3.0:1787893099.699527:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c64b6300 x1874741493359616/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893099.699534:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493359616:0@lo:400:kworker.0 00000100:00100000:3.0:1787893099.699540:0:3633:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1787893099.699545:0:3633:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fc9ffbdca80, transno 4294967301 00000100:00100000:3.0:1787893099.699554:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493360128:0@lo:400:kworker.0 00000100:00100000:0.0:1787893099.699859:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493359232:0@lo:400:kworker.0 00000100:00100000:0.0:1787893099.699895:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893099.699926:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493359744:0@lo:400:kworker.0 00000100:00100000:0.0:1787893099.699949:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893099.699970:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493360256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787893099.699989:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893099.700005:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787893099.700011:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493358848:0@lo:400:kworker.0 00000100:00100000:0.0:1787893099.700036:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893099.700060:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493359360:0@lo:400:kworker.0 00000100:00100000:0.0:1787893099.700081:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893099.700095:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1874741493359872:0@lo:400:kworker.0 00000100:00100000:0.0:1787893099.700113:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787893099.700133:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787893099.700136:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787893099.700140:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787893099.700152:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493359744 00000100:00100000:0.0:1787893099.700156:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493359744 00000100:00100000:0.0:1787893099.700187:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787893099.700194:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493359744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893099.700230:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493359744:12345-0@lo:400:kworker.0 Request processed in 37us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893099.700236:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:0.0:1787893099.700250:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787893099.700266:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c64b4700 x1874741493359744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893099.700297:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493359744:0@lo:400:kworker.0 00000100:00100000:1.0:1787893099.700365:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493359232 00000100:00100000:1.0:1787893099.700369:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493359232 00000100:00100000:1.0:1787893099.700404:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787893099.700411:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe349c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493359232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893099.700453:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe349c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493359232:12345-0@lo:400:kworker.0 Request processed in 43us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893099.700460:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787893099.700479:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493358848 00000100:00100000:1.0:1787893099.700482:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493358848 00000100:00100000:1.0:1787893099.700530:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1787893099.700537:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+24:3630:x1874741493358848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893099.700567:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+24:3630:x1874741493358848:12345-0@lo:400:kworker.0 Request processed in 31us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893099.700573:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1787893099.700609:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493358848:0@lo:400:kworker.0 00000100:00100000:1.0:1787893099.700619:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493359232:0@lo:400:kworker.0 00000100:00100000:2.0:1787893099.700929:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493359360 00000100:00100000:2.0:1787893099.700934:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493359360 00000100:00100000:2.0:1787893099.700973:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493359872 00000100:00100000:2.0:1787893099.700976:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493359872 00000100:00100000:2.0:1787893099.700993:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787893099.700999:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493359360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893099.701037:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493359360:12345-0@lo:400:kworker.0 Request processed in 37us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893099.701043:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787893099.701055:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787893099.701060:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874741493359872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893099.701085:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874741493359872:12345-0@lo:400:kworker.0 Request processed in 25us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893099.701091:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:1.0:1787893099.701259:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787893099.701301:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493359360:0@lo:400:kworker.0 00000100:00100000:1.0:1787893099.701314:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1874741493359872:0@lo:400:kworker.0 00000100:00100000:3.0:1787893099.701594:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493360256 00000100:00100000:3.0:1787893099.701600:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493360256 00000100:00100000:3.0:1787893099.701664:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787893099.701672:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493360256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787893099.701688:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787893099.701741:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493360256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (1751us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893099.701748:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787893099.701806:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493360256:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787893100.209984:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893100.584549:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893100.584615:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893100.584651:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893100.584698:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893100.584718:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893100.584741:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893100.584794:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481732736 00000100:00100000:3.0:1787893100.584806:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481732736 00000100:00100000:0.0:1787893100.584829:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481732608 00000100:00100000:0.0:1787893100.584846:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481732608 00000100:00100000:3.0:1787893100.584887:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481733248 00000100:00100000:3.0:1787893100.584893:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481733248 00000100:00100000:3.0:1787893100.584926:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481732864 00000100:00100000:3.0:1787893100.584934:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481732864 00000100:00100000:0.0:1787893100.584934:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 377 00000100:00100000:0.0:1787893100.584958:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2393:x1874741481732608:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893100.584962:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481733120 00000100:00100000:3.0:1787893100.584967:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481733120 00000100:00100000:3.0:1787893100.584993:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 267 00000100:00100000:3.0:1787893100.585004:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+5:2392:x1874741481732736:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893100.585064:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2393:x1874741481732608:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 113us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893100.585072:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+5:2392:x1874741481732736:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 68us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893100.585080:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 377 00000100:00100000:3.0:1787893100.585092:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 267 00000100:00100000:3.0:1787893100.585117:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 268 00000100:00100000:3.0:1787893100.585126:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2392:x1874741481733248:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893100.585140:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481732992 00000100:00100000:0.0:1787893100.585148:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481732992 00000100:00100000:3.0:1787893100.585168:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2392:x1874741481733248:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 42us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893100.585177:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 268 00000100:00100000:0.0:1787893100.585194:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 103 00000100:00100000:3.0:1787893100.585200:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 269 00000100:00100000:0.0:1787893100.585213:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58232959-285a-4954-a3ac-571a2b817017+5:2392:x1874741481732992:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893100.585217:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+5:2393:x1874741481732864:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893100.585259:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+5:2393:x1874741481732864:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 49us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893100.585266:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 269 00000100:00100000:3.0:1787893100.585322:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 270 00000100:00100000:3.0:1787893100.585329:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2393:x1874741481733120:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893100.585361:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2393:x1874741481733120:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 34us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893100.585368:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 270 00000100:00080000:1.0:1787893100.585668:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787893100.585675:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787893100.585678:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787893100.585846:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58232959-285a-4954-a3ac-571a2b817017+5:2392:x1874741481732992:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 638us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893100.585855:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 103 00010000:00010000:0.0:1787893101.233938:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893101.746669:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493360384:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787893101.746779:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893101.747017:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493360384 00000100:00100000:1.0:1787893101.747026:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493360384 00000100:00100000:1.0:1787893101.747103:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787893101.747114:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493360384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787893101.747143:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787893101.747192:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493360384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893101.747199:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00010000:00080000:1.0:1787893101.747242:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e711fb80 x1874741493360384/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893117 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893101.747261:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493360384:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787893101.747400:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787893101.747637:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493360512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787893101.747676:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893101.747858:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493360512 00000100:00100000:2.0:1787893101.747864:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493360512 00000100:00100000:2.0:1787893101.747915:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787893101.747923:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493360512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787893101.747937:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787893101.747986:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493360512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893101.747993:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00010000:00080000:2.0:1787893101.748023:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb99500 x1874741493360512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893117 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893101.748036:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493360512:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787893101.748091:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1787893102.132084:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1787893102.198671:0:13789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787893102.257759:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893103.284247:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787893103.284282:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493360640:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787893103.284357:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893103.284514:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493360640 00000100:00100000:2.0:1787893103.284523:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493360640 00000100:00100000:2.0:1787893103.284582:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787893103.284592:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493360640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787893103.284626:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787893103.284673:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493360640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893103.284680:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787893103.285032:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493360640:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787893103.285992:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893104.306520:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893104.307354:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787893104.307379:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493360768:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787893104.307454:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893104.307657:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493360768 00000100:00100000:1.0:1787893104.307666:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493360768 00000100:00100000:1.0:1787893104.307718:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787893104.307726:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493360768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787893104.307760:0:7865:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787893104.307814:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493360768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893104.307822:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787893104.307945:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493360768:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787893104.817860:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787893104.817884:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493360896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787893104.817961:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893104.818051:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493360896 00000100:00100000:1.0:1787893104.818060:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493360896 00000100:00100000:1.0:1787893104.818114:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787893104.818125:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7202a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493360896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787893104.818153:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787893104.818213:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7202a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493360896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893104.818220:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787893104.818302:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493360896:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787893104.818758:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787893104.818774:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c6e6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493361024:0@lo:400:kworker.0 00000100:00100000:0.0:1787893104.818822:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893104.818847:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c6e6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493361536:0@lo:400:kworker.0 00000100:00100000:0.0:1787893104.818874:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893104.818894:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c6e6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1874741493362048:0@lo:400:kworker.0 00000100:00100000:0.0:1787893104.818916:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893104.818937:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787893104.818942:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c6e6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493361152:0@lo:400:kworker.0 00000100:00100000:0.0:1787893104.818963:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893104.818981:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c6e6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493361664:0@lo:400:kworker.0 00000100:00100000:0.0:1787893104.819000:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893104.819017:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c6e6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493362176:0@lo:400:kworker.0 00000100:00100000:0.0:1787893104.819054:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893104.819072:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c6e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493361408:0@lo:400:kworker.0 00000100:00100000:0.0:1787893104.819093:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493361536 00000100:00100000:0.0:1787893104.819099:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493361536 00000100:00100000:3.0:1787893104.819112:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893104.819141:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c6e6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493361920:0@lo:400:kworker.0 00000100:00100000:0.0:1787893104.819144:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493362048 00000100:00100000:0.0:1787893104.819148:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493362048 00000100:00100000:0.0:1787893104.819167:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493361152 00000100:00100000:3.0:1787893104.819173:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893104.819173:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493361152 00000100:00100000:3.0:1787893104.819199:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787893104.819201:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493361664 00000100:00100000:0.0:1787893104.819206:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493361664 00000100:00100000:3.0:1787893104.819208:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c6e6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1874741493361280:0@lo:400:kworker.0 00000100:00100000:0.0:1787893104.819227:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493362176 00000100:00100000:0.0:1787893104.819231:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493362176 00000100:00100000:3.0:1787893104.819249:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893104.819263:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493361280 00000100:00100000:3.0:1787893104.819267:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c6e6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493361792:0@lo:400:kworker.0 00000100:00100000:0.0:1787893104.819268:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493361280 00000100:00100000:0.0:1787893104.819291:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1787893104.819296:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893104.819302:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493361536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893104.819316:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c6e6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493362304:0@lo:400:kworker.0 00000100:00100000:3.0:1787893104.819347:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893104.819377:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493361536:12345-0@lo:400:kworker.0 Request processed in 78us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893104.819379:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493361920 00000100:00100000:3.0:1787893104.819384:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493361920 00000100:00100000:0.0:1787893104.819390:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1787893104.819410:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1787893104.819419:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1874741493362048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893104.819421:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493361792 00000100:00100000:3.0:1787893104.819427:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493361792 00000100:00100000:0.0:1787893104.819450:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1874741493362048:12345-0@lo:400:kworker.0 Request processed in 33us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893104.819458:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1787893104.819461:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493362304 00000100:00100000:3.0:1787893104.819466:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493362304 00000100:00100000:0.0:1787893104.819478:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1787893104.819508:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787893104.819515:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493361152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893104.819528:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493361920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893104.819551:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493361152:12345-0@lo:400:kworker.0 Request processed in 64us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893104.819558:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1787893104.819573:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1787893104.819581:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493361664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893104.819595:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493361920:12345-0@lo:400:kworker.0 Request processed in 70us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893104.819604:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787893104.819617:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493361664:12345-0@lo:400:kworker.0 Request processed in 35us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893104.819624:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787893104.819628:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1787893104.819635:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493361792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893104.819646:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1787893104.819661:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d1593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493362176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893104.819690:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d1593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493362176:12345-0@lo:400:kworker.0 Request processed in 32us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893104.819696:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1787893104.819709:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1787893104.819715:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1874741493361280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893104.819741:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1874741493361280:12345-0@lo:400:kworker.0 Request processed in 27us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893104.819747:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1787893104.819783:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493361408 00000100:00100000:0.0:1787893104.819787:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493361408 00000100:00100000:0.0:1787893104.819812:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787893104.819819:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493361408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893104.819837:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493361792:12345-0@lo:400:kworker.0 Request processed in 203us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893104.819845:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787893104.819863:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493361408:12345-0@lo:400:kworker.0 Request processed in 44us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893104.819864:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787893104.819875:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787893104.819878:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493362304:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787893104.819896:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787893104.819901:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787893104.819904:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787893104.819908:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787893104.819919:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493362304:12345-0@lo:400:kworker.0 Request processed in 45us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893104.819925:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787893104.819936:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c6e6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493361152:0@lo:400:kworker.0 00010000:00080000:0.0:1787893104.819952:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9c6e6ca80 x1874741493361664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893104.819963:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c6e6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493361664:0@lo:400:kworker.0 00000100:00100000:3.0:1787893104.819966:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c6e6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1874741493361280:0@lo:400:kworker.0 00010000:00080000:0.0:1787893104.819983:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9c6e6c700 x1874741493362176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1787893104.819988:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9c6e6c380 x1874741493361792/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893104.820003:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c6e6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493361792:0@lo:400:kworker.0 00000100:00100000:3.0:1787893104.820018:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c6e6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493362304:0@lo:400:kworker.0 00000100:00100000:0.0:1787893104.820021:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c6e6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493362176:0@lo:400:kworker.0 00000100:00100000:3.0:1787893104.820034:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c6e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493361408:0@lo:400:kworker.0 00000100:00100000:0.0:1787893104.820044:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c6e6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493361536:0@lo:400:kworker.0 00010000:00080000:3.0:1787893104.820052:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9c6e6ed80 x1874741493361920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893104.820061:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c6e6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1874741493362048:0@lo:400:kworker.0 00000100:00100000:3.0:1787893104.820063:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c6e6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493361920:0@lo:400:kworker.0 00000100:00100000:1.0:1787893104.820606:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493361024 00000100:00100000:1.0:1787893104.820612:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493361024 00000100:00100000:1.0:1787893104.820639:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1787893104.820646:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edfee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+24:3632:x1874741493361024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893104.820706:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edfee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+24:3632:x1874741493361024:12345-0@lo:400:kworker.0 Request processed in 61us (1884us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893104.820713:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1787893104.820757:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787893104.820766:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493362432:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787893104.820809:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893104.820839:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493362432 00000100:00100000:1.0:1787893104.820842:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493362432 00000100:00100000:1.0:1787893104.820866:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787893104.820872:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7201500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493362432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787893104.820886:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787893104.820919:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7201500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493362432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893104.820925:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787893104.820955:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493362432:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787893104.821133:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c6e6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493361024:0@lo:400:kworker.0 00010000:00010000:1.0:1787893105.330055:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893105.695430:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893105.695478:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893105.695547:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893105.695625:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481733632 00000100:00100000:3.0:1787893105.695635:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481733632 00000100:00100000:3.0:1787893105.695695:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481733504 00000100:00100000:3.0:1787893105.695698:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481733504 00000100:00100000:3.0:1787893105.695719:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 277 00000100:00100000:3.0:1787893105.695730:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d1593800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+5:2393:x1874741481733632:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893105.695809:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d1593800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+5:2393:x1874741481733632:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 81us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893105.695816:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 277 00000100:00100000:3.0:1787893105.695833:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 278 00000100:00100000:3.0:1787893105.695840:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d1591c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+5:2393:x1874741481733504:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893105.695871:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d1591c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+5:2393:x1874741481733504:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 32us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893105.695877:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 278 00000100:00100000:1.0:1787893105.696252:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481733376 00000100:00100000:1.0:1787893105.696257:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481733376 00000100:00100000:1.0:1787893105.696311:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 379 00000100:00100000:1.0:1787893105.696319:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ec8ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2393:x1874741481733376:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893105.696359:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ec8ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2393:x1874741481733376:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 41us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893105.696366:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 379 00000100:00080000:0.0:1787893105.696783:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787893105.696788:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787893105.714341:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893105.714404:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481733760 00000100:00100000:3.0:1787893105.714414:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481733760 00000100:00080000:0.0:1787893105.714573:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787893105.714700:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 27 00000100:00100000:3.0:1787893105.714712:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d1593100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58232959-285a-4954-a3ac-571a2b817017+5:2389:x1874741481733760:12345-192.168.202.35@tcp:9:kworker.0 00000020:00000080:3.0:1787893105.714752:0:8535:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf0e1a 00000100:00080000:3.0:1787893105.714761:0:8535:0:(import.c:65:import_set_state_nolock()) ffff9fc9ffa86800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787893105.714816:0:8535:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:3.0:1787893105.714974:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d1593100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58232959-285a-4954-a3ac-571a2b817017+2:2389:x1874741481733760:12345-192.168.202.35@tcp:9:kworker.0 Request processed in 265us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893105.714982:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 27 00010000:00010000:2.0:1787893105.715143:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893105.729067:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893105.729111:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893105.729263:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481733888 00000100:00100000:0.0:1787893105.729274:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481733888 00000100:00100000:0.0:1787893105.729351:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481734016 00000100:00100000:0.0:1787893105.729354:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481734016 00000100:00100000:0.0:1787893105.729377:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 279 00000100:00100000:0.0:1787893105.729387:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2392:x1874741481733888:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893105.729439:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 280 00000100:00100000:2.0:1787893105.729449:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2392:x1874741481734016:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893105.729462:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2392:x1874741481733888:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 77us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893105.729470:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 279 00000100:00100000:2.0:1787893105.729473:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2392:x1874741481734016:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 28us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893105.729478:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 280 00000100:00080000:2.0:1787893105.729516:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787893105.729520:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787893106.353897:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893106.871171:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493362560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787893106.871251:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893106.871323:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787893106.871330:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493362688:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787893106.871353:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893106.871455:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493362560 00000100:00100000:2.0:1787893106.871463:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493362560 00000100:00100000:2.0:1787893106.871538:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493362688 00000100:00100000:2.0:1787893106.871553:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493362688 00000100:00100000:2.0:1787893106.871575:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787893106.871584:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493362560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787893106.871963:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787893106.872010:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493362560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 426us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893106.872017:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787893106.872035:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787893106.872042:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493362688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787893106.872051:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787893106.872072:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493362688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 31us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893106.872078:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:3.0:1787893106.872155:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787893106.872182:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb99500 x1874741493362688/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893122 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893106.872200:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493362688:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1787893106.872211:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb99c00 x1874741493362560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893122 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893106.872232:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493362560:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787893107.377646:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893108.402271:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493362816:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787893108.402297:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893108.402343:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893108.402919:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493362816 00000100:00100000:2.0:1787893108.402928:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493362816 00000100:00100000:2.0:1787893108.402986:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787893108.402996:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7203b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493362816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787893108.403031:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787893108.403094:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7203b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493362816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893108.403102:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787893108.404670:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493362816:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787893109.426134:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893109.427416:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7200380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493362944:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787893109.427529:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893109.427871:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493362944 00000100:00100000:1.0:1787893109.427880:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493362944 00000100:00100000:1.0:1787893109.427934:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787893109.427943:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493362944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787893109.427978:0:7865:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787893109.428064:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493362944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893109.428072:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787893109.428244:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7200380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493362944:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787893109.937670:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787893109.937693:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7200380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493363072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787893109.937771:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893109.937801:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493363072 00000100:00100000:3.0:1787893109.937810:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493363072 00000100:00100000:3.0:1787893109.937870:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787893109.937881:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493363072:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787893109.937897:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1787893109.937912:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787893109.937983:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493363072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893109.937990:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787893109.938158:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7200380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493363072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787893109.938180:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493363200:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787893109.938227:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893109.938327:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d1592300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493363712:0@lo:400:kworker.0 00000100:00100000:1.0:1787893109.938393:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893109.938425:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d1590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493364224:0@lo:400:kworker.0 00000100:00100000:0.0:1787893109.938426:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493363712 00000100:00100000:0.0:1787893109.938432:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493363712 00000100:00100000:1.0:1787893109.938457:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893109.938467:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787893109.938477:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787893109.938477:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d0f50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493363712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893109.938487:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d1591880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874741493363584:0@lo:400:kworker.0 00000100:00100000:1.0:1787893109.938541:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893109.938557:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d0f50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493363712:12345-0@lo:400:kworker.0 Request processed in 81us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893109.938565:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d1593480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493364096:0@lo:400:kworker.0 00000100:00100000:0.0:1787893109.938568:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787893109.938595:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893109.938595:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493363584 00000100:00100000:0.0:1787893109.938600:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493363584 00000100:00100000:1.0:1787893109.938626:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d1592300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493363712:0@lo:400:kworker.0 00000100:00100000:0.0:1787893109.938652:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1787893109.938660:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d0f51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1874741493363584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893109.938693:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d0f51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1874741493363584:12345-0@lo:400:kworker.0 Request processed in 35us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893109.938699:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1787893109.938746:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493364224 00000100:00100000:0.0:1787893109.938749:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493364224 00000100:00100000:0.0:1787893109.938776:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493364096 00000100:00100000:0.0:1787893109.938778:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493364096 00000100:00100000:3.0:1787893109.938799:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d1591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1874741493363456:0@lo:400:kworker.0 00000100:00100000:0.0:1787893109.938801:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787893109.938820:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d0f52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493364224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893109.938849:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893109.938858:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d0f52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493364224:12345-0@lo:400:kworker.0 Request processed in 38us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893109.938864:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787893109.938875:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787893109.938882:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d0f53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493364096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893109.938888:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d1590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1874741493363968:0@lo:400:kworker.0 00000100:00100000:0.0:1787893109.938914:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d0f53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493364096:12345-0@lo:400:kworker.0 Request processed in 32us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893109.938923:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787893109.938927:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893109.938948:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d1592d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1874741493364480:0@lo:400:kworker.0 00000100:00080000:0.0:1787893109.938951:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787893109.938972:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893109.938981:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d1591880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874741493363584:0@lo:400:kworker.0 00010000:00080000:0.0:1787893109.939006:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9d1593480 x1874741493364096/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893109.939010:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787893109.939018:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d1590e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493363328:0@lo:400:kworker.0 00000100:00100000:3.0:1787893109.939044:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893109.939067:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d1592680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1874741493363840:0@lo:400:kworker.0 00000100:00100000:3.0:1787893109.939087:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893109.939105:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d1590380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1874741493364352:0@lo:400:kworker.0 00000100:00100000:3.0:1787893109.939125:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893109.939155:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493363456 00000100:00100000:3.0:1787893109.939158:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493363456 00000100:00100000:3.0:1787893109.939182:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493363968 00000100:00100000:3.0:1787893109.939185:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493363968 00000100:00100000:3.0:1787893109.939223:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493364480 00000100:00100000:3.0:1787893109.939226:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493364480 00000100:00100000:3.0:1787893109.939238:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493363840 00000100:00100000:3.0:1787893109.939240:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493363840 00000100:00100000:3.0:1787893109.939251:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493364352 00000100:00100000:3.0:1787893109.939253:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493364352 00000100:00100000:3.0:1787893109.939265:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1787893109.939271:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d017c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1874741493363456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893109.939309:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d017c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1874741493363456:12345-0@lo:400:kworker.0 Request processed in 37us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893109.939315:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1787893109.939333:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1787893109.939339:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d017ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1874741493363968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893109.939374:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d017ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1874741493363968:12345-0@lo:400:kworker.0 Request processed in 35us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893109.939380:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1787893109.939393:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1787893109.939400:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d017d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1874741493364480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893109.939419:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493363200 00000100:00100000:2.0:1787893109.939425:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493363200 00000100:00100000:3.0:1787893109.939430:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d017d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1874741493364480:12345-0@lo:400:kworker.0 Request processed in 31us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893109.939437:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1787893109.939453:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1787893109.939460:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787893109.939462:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d017fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3631:x1874741493363840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893109.939472:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7200380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493363200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787893109.939487:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787893109.939520:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d017fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3631:x1874741493363840:12345-0@lo:400:kworker.0 Request processed in 60us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893109.939526:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1787893109.939539:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1787893109.939547:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d017f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1874741493364352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893109.939553:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7200380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493363200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (1325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893109.939561:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787893109.939582:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d017f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1874741493364352:12345-0@lo:400:kworker.0 Request processed in 36us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893109.939589:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00080000:3.0:1787893109.939613:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787893109.939617:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787893109.939620:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787893109.939621:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493363328 00000100:00100000:2.0:1787893109.939626:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493363328 00000100:00100000:3.0:1787893109.939646:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d1592680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1874741493363840:0@lo:400:kworker.0 00000100:00100000:2.0:1787893109.939656:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1787893109.939663:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ec8bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+24:3631:x1874741493363328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893109.939692:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ec8bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+24:3631:x1874741493363328:12345-0@lo:400:kworker.0 Request processed in 29us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893109.939698:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1787893109.940264:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d1590380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1874741493364352:0@lo:400:kworker.0 00000100:00100000:3.0:1787893109.940288:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d1591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1874741493363456:0@lo:400:kworker.0 00010000:00080000:3.0:1787893109.940299:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9d1590000 x1874741493363968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893109.940308:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d1590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1874741493363968:0@lo:400:kworker.0 00010000:00080000:3.0:1787893109.940318:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9d1592d80 x1874741493364480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893109.940327:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d1592d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1874741493364480:0@lo:400:kworker.0 00000100:00100000:3.0:1787893109.940347:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d1590e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493363328:0@lo:400:kworker.0 00000100:00100000:0.0:1787893109.940571:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d1593480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493364096:0@lo:400:kworker.0 00010000:00080000:0.0:1787893109.940588:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9d1590a80 x1874741493364224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893109.940596:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d1590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493364224:0@lo:400:kworker.0 00000100:00100000:0.0:1787893109.940613:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493363200:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787893110.452223:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893110.814752:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893110.814842:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893110.814874:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893110.814908:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893110.814932:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893110.814991:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481734272 00000100:00100000:0.0:1787893110.815001:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481734272 00000100:00100000:0.0:1787893110.815053:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481734400 00000100:00100000:0.0:1787893110.815056:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481734400 00000100:00100000:0.0:1787893110.815075:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481734528 00000100:00100000:0.0:1787893110.815078:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481734528 00000100:00100000:0.0:1787893110.815091:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481734656 00000100:00100000:0.0:1787893110.815094:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481734656 00000100:00100000:0.0:1787893110.815109:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 287 00000100:00100000:0.0:1787893110.815117:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d1590a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481734272:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893110.815218:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d1590a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481734272:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 101us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893110.815226:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 287 00000100:00100000:0.0:1787893110.815244:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 288 00000100:00100000:0.0:1787893110.815265:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d1593480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481734400:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893110.815293:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d1593480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481734400:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 29us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893110.815300:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 288 00000100:00100000:0.0:1787893110.815312:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 289 00000100:00100000:0.0:1787893110.815319:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d1591880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481734528:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893110.815344:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d1591880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481734528:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 26us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893110.815349:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 289 00000100:00100000:0.0:1787893110.815360:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 290 00000100:00100000:0.0:1787893110.815367:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d1591180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481734656:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893110.815407:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d1591180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481734656:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 40us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893110.815413:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 290 00000100:00080000:3.0:1787893110.819298:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787893110.819309:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787893110.819937:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481734144 00000100:00100000:2.0:1787893110.819949:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481734144 00000100:00100000:2.0:1787893110.820150:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 381 00000100:00100000:2.0:1787893110.820161:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ec8b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2390:x1874741481734144:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893110.820577:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ec8b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2390:x1874741481734144:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 418us (5834us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893110.820586:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 381 00000001:00100000:0.0:1787893110.966634:0:9497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 58232959-285a-4954-a3ac-571a2b817017 00000020:00000080:0.0:1787893110.966654:0:9497:0:(genops.c:885:class_export_put()) final put ffff9fc9ffb40000/58232959-285a-4954-a3ac-571a2b817017 00000020:00000080:2.0:1787893110.966710:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9ffb40000/58232959-285a-4954-a3ac-571a2b817017 for lustre-OST0001 00000020:00000080:2.0:1787893110.966765:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc9ffa86800 for lustre-OST0001 00010000:00010000:0.0:1787893111.474144:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893111.989605:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d017dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493364608:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787893111.989689:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893111.989775:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493364608 00000100:00100000:3.0:1787893111.989784:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493364608 00000100:00100000:3.0:1787893111.989853:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787893111.989863:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d017f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493364608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787893111.989892:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787893111.989932:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d017f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493364608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893111.989939:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:3.0:1787893111.989959:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787893111.989984:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9d017dc00 x1874741493364608/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893127 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893111.990002:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d017dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493364608:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787893111.991588:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787893111.991610:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493364736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787893111.991919:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893111.992024:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493364736 00000100:00100000:2.0:1787893111.992032:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493364736 00000100:00100000:2.0:1787893111.992093:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787893111.992102:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d017dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493364736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787893111.992122:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787893111.992160:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d017dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493364736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893111.992167:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:3.0:1787893111.994915:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787893111.994977:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb99500 x1874741493364736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893127 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893111.995003:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493364736:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1787893112.370579:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1787893112.439257:0:13789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787893112.500566:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893113.522108:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787893113.522152:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d0f53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493364864:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787893113.522293:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893113.522477:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493364864 00000100:00100000:1.0:1787893113.522524:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493364864 00000100:00100000:1.0:1787893113.522590:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787893113.522603:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d1590700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493364864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787893113.522657:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787893113.522726:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d1590700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493364864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 124us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893113.522734:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787893113.522798:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d0f53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493364864:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787893113.533449:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893114.547022:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d0f51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493364992:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787893114.547280:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787893114.547395:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893114.547438:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493364992 00000100:00100000:1.0:1787893114.547448:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493364992 00000100:00100000:1.0:1787893114.547571:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787893114.547585:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d1592a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493364992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787893114.547636:0:7865:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787893114.547936:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d1592a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493364992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 353us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893114.547953:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787893114.552013:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d0f51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493364992:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787893115.060964:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d1592d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874741493365376:0@lo:400:kworker.0 00000100:00100000:0.0:1787893115.061032:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893115.061078:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d1592680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493365888:0@lo:400:kworker.0 00000100:00100000:0.0:1787893115.061097:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893115.061110:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c6e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493366400:0@lo:400:kworker.0 00000100:00100000:0.0:1787893115.061126:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893115.061163:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787893115.061170:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d1590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493365504:0@lo:400:kworker.0 00000100:00100000:0.0:1787893115.061227:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893115.061245:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d1592300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493366016:0@lo:400:kworker.0 00000100:00100000:0.0:1787893115.061266:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893115.061285:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c6e6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493366528:0@lo:400:kworker.0 00000100:00100000:0.0:1787893115.061302:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893115.061332:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493365376 00000100:00100000:0.0:1787893115.061339:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493365376 00000100:00100000:0.0:1787893115.061386:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1787893115.061394:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874741493365376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893115.061447:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874741493365376:12345-0@lo:400:kworker.0 Request processed in 53us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893115.061454:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1787893115.061479:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493365888 00000100:00100000:0.0:1787893115.061483:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493365888 00000100:00100000:0.0:1787893115.061551:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493366400 00000100:00100000:0.0:1787893115.061554:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493366400 00000100:00100000:0.0:1787893115.061566:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493366016 00000100:00100000:0.0:1787893115.061569:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493366016 00000100:00100000:0.0:1787893115.061580:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493366528 00000100:00100000:0.0:1787893115.061597:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493366528 00000100:00100000:1.0:1787893115.062014:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d1591500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493365120:0@lo:400:kworker.0 00000100:00100000:1.0:1787893115.062050:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893115.062075:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d1591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493365632:0@lo:400:kworker.0 00000100:00100000:1.0:1787893115.062100:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893115.062117:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c6e6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1874741493366144:0@lo:400:kworker.0 00000100:00100000:1.0:1787893115.062135:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893115.062161:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493366656:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787893115.062182:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893115.062203:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787893115.062208:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d1590e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493365248:0@lo:400:kworker.0 00000100:00100000:1.0:1787893115.062229:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893115.062246:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d1590380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493365760:0@lo:400:kworker.0 00000100:00100000:1.0:1787893115.062265:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893115.062280:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c6e6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493366272:0@lo:400:kworker.0 00000100:00100000:1.0:1787893115.062299:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893115.062352:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493365120 00000100:00100000:1.0:1787893115.062356:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493365120 00000100:00100000:1.0:1787893115.062388:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1787893115.062396:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ec8b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+24:3632:x1874741493365120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893115.062431:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ec8b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+24:3632:x1874741493365120:12345-0@lo:400:kworker.0 Request processed in 35us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893115.062438:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1787893115.062468:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493365632 00000100:00100000:1.0:1787893115.062478:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493365632 00000100:00100000:1.0:1787893115.062522:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493366144 00000100:00100000:1.0:1787893115.062526:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493366144 00000100:00100000:1.0:1787893115.062539:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493365248 00000100:00100000:1.0:1787893115.062541:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493365248 00000100:00100000:1.0:1787893115.062551:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493365760 00000100:00100000:1.0:1787893115.062553:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493365760 00000100:00100000:1.0:1787893115.062563:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493366272 00000100:00100000:1.0:1787893115.062565:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493366272 00000100:00100000:1.0:1787893115.062579:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787893115.062584:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d0f53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493365632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893115.062688:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d0f53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493365632:12345-0@lo:400:kworker.0 Request processed in 103us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893115.062694:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787893115.062708:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1787893115.062714:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d0f50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1874741493366144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893115.062742:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d0f50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1874741493366144:12345-0@lo:400:kworker.0 Request processed in 29us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893115.062748:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1787893115.062761:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1787893115.062767:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d0f51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493365248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893115.062795:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d0f51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493365248:12345-0@lo:400:kworker.0 Request processed in 28us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893115.062800:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1787893115.062811:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1787893115.062817:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d0f52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493365760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893115.062845:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d0f52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493365760:12345-0@lo:400:kworker.0 Request processed in 28us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893115.062861:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1787893115.062873:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1787893115.062878:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d0f52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493366272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893115.062921:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d0f52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493366272:12345-0@lo:400:kworker.0 Request processed in 43us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893115.062928:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1787893115.062951:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493366656 00000100:00100000:1.0:1787893115.062956:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493366656 00000100:00100000:0.0:1787893115.064696:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787893115.064711:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493365888:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787893115.064782:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787893115.064789:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787893115.064793:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787893115.064797:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493365888:12345-0@lo:400:kworker.0 Request processed in 88us (3696us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893115.064810:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787893115.064827:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787893115.070243:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787893115.071475:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d0f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3632:x1874741493366656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787893115.071535:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787893115.071631:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d0f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3632:x1874741493366656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1377us (9446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893115.071639:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787893115.071697:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d0f50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493366784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787893115.071737:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893115.071825:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d1590e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493365248:0@lo:400:kworker.0 00010000:00080000:1.0:1787893115.071843:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9d1590380 x1874741493365760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893115.071854:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d1590380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493365760:0@lo:400:kworker.0 00010000:00080000:1.0:1787893115.071866:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9c6e6ed80 x1874741493366272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893115.071874:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c6e6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493366272:0@lo:400:kworker.0 00000100:00100000:1.0:1787893115.071897:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d1591500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493365120:0@lo:400:kworker.0 00000100:00100000:1.0:1787893115.071911:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d1591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493365632:0@lo:400:kworker.0 00000100:00100000:1.0:1787893115.071921:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c6e6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1874741493366144:0@lo:400:kworker.0 00000100:00100000:1.0:1787893115.071937:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493366656:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787893115.072202:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493366784 00000100:00100000:3.0:1787893115.072209:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493366784 00000100:00100000:3.0:1787893115.072257:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787893115.072277:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d0f53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3633:x1874741493366784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787893115.072290:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787893115.072336:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d0f53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3633:x1874741493366784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893115.072343:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787893115.072367:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787893115.072375:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493366016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893115.072410:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493366016:12345-0@lo:400:kworker.0 Request processed in 37us (11144us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893115.072415:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787893115.072429:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787893115.072435:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493366528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893115.072461:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493366528:12345-0@lo:400:kworker.0 Request processed in 27us (11158us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893115.072473:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00080000:3.0:1787893115.072738:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9d1592300 x1874741493366016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893115.072751:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d1592300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493366016:0@lo:400:kworker.0 00000100:00100000:3.0:1787893115.072779:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c6e6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493366528:0@lo:400:kworker.0 00000100:00100000:2.0:1787893115.072788:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493365504 00000100:00100000:2.0:1787893115.072795:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493365504 00000100:00100000:3.0:1787893115.072796:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d1592d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874741493365376:0@lo:400:kworker.0 00010000:00080000:3.0:1787893115.072814:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9d1592680 x1874741493365888/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893115.072822:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d1592680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493365888:0@lo:400:kworker.0 00000100:00100000:2.0:1787893115.072838:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787893115.072849:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493365504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893115.072902:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493365504:12345-0@lo:400:kworker.0 Request processed in 56us (11673us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893115.072909:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787893115.072972:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d1590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493365504:0@lo:400:kworker.0 00000100:00100000:1.0:1787893115.073167:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d0f50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493366784:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787893115.073325:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787893115.077573:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493366400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893115.077722:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493366400:12345-0@lo:400:kworker.0 Request processed in 12887us (16593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893115.077733:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787893115.077932:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c6e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493366400:0@lo:400:kworker.0 00010000:00010000:2.0:1787893115.569645:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893115.941102:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893115.941135:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893115.941172:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893115.941192:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893115.941211:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893115.941237:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481734912 00000100:00100000:3.0:1787893115.941246:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481734912 00000100:00100000:3.0:1787893115.941310:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481735168 00000100:00100000:3.0:1787893115.941314:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481735168 00000100:00100000:3.0:1787893115.941332:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481735040 00000100:00100000:3.0:1787893115.941334:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481735040 00000100:00100000:3.0:1787893115.941344:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481735296 00000100:00100000:3.0:1787893115.941346:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481735296 00000100:00100000:3.0:1787893115.941362:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 297 00000100:00100000:3.0:1787893115.941371:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d017ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+5:2391:x1874741481734912:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893115.941450:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d017ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+5:2391:x1874741481734912:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 79us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893115.941458:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 297 00000100:00100000:3.0:1787893115.941475:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 298 00000100:00100000:3.0:1787893115.941482:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d017df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2391:x1874741481735168:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893115.941526:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d017df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2391:x1874741481735168:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 45us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893115.941533:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 298 00000100:00100000:3.0:1787893115.941545:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 299 00000100:00100000:3.0:1787893115.941551:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d017d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+5:2391:x1874741481735040:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893115.941574:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d017d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+5:2391:x1874741481735040:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 24us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893115.941580:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 299 00000100:00100000:3.0:1787893115.941591:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 300 00000100:00100000:3.0:1787893115.941597:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d017e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2391:x1874741481735296:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893115.941634:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d017e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2391:x1874741481735296:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 37us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893115.941641:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 300 00000100:00100000:2.0:1787893115.941975:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481734784 00000100:00100000:2.0:1787893115.941982:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481734784 00000100:00100000:2.0:1787893115.942063:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 383 00000100:00100000:2.0:1787893115.942072:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ec8b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2391:x1874741481734784:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893115.942106:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ec8b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2391:x1874741481734784:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 36us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893115.942112:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 383 00000100:00080000:2.0:1787893115.942154:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787893115.942158:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787893116.593892:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893117.109930:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787893117.109956:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d017e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493366912:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787893117.110030:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893117.110416:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787893117.110428:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493367040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787893117.110461:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893117.110515:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493366912 00000100:00100000:1.0:1787893117.110523:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493366912 00000100:00100000:1.0:1787893117.110571:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493367040 00000100:00100000:1.0:1787893117.110574:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493367040 00000100:00100000:1.0:1787893117.110592:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787893117.110600:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493366912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787893117.110629:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787893117.110671:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493366912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893117.110678:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787893117.110696:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787893117.110703:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d0f50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493367040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787893117.110713:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787893117.110766:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d0f50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493367040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893117.110772:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:2.0:1787893117.111789:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787893117.112125:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb99c00 x1874741493367040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893133 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893117.112157:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493367040:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1787893117.112732:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9d017e680 x1874741493366912/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893133 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893117.112748:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d017e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493366912:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787893117.623168:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787893117.687369:0:14049:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 00:58:36 (1787893116) 00010000:00010000:3.0:1787893118.641668:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893118.648002:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787893118.650420:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d0f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493367168:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787893118.650512:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893118.654443:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493367168 00000100:00100000:1.0:1787893118.654457:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493367168 00000100:00100000:1.0:1787893118.654586:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787893118.654596:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d017e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493367168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787893118.654636:0:7865:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787893118.654723:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d017e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493367168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (4211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893118.654731:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787893118.654814:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d0f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493367168:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787893119.665842:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893119.666037:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d0f50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493367296:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787893119.666119:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893119.666415:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493367296 00000100:00100000:1.0:1787893119.666424:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493367296 00000100:00100000:1.0:1787893119.666481:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787893119.666520:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d017c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493367296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787893119.666558:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787893119.666615:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d017c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493367296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893119.666623:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787893119.666790:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d0f50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493367296:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787893119.735848:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893119.736239:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481735424 00000100:00100000:1.0:1787893119.736249:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481735424 00000100:00100000:1.0:1787893119.736363:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 40 00000100:00100000:1.0:1787893119.736375:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d017f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+5:11075:x1874741481735424:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787893119.736396:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893119.736621:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf0efa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa725 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893119.736718:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf0f01 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893119.736733:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf0f01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893119.736747:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf0f01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893119.736799:0:6506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787893119.736803:0:6506:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787893119.736847:0:6506:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf0f01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893119.736872:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf0efa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa725 expref: 7 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893119.736892:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf0f01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa725 expref: 6 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893119.736902:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9c2f71800) 00010000:00010000:1.0:1787893119.736905:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787893119.736909:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe540c00, rc 0) 00000100:00100000:1.0:1787893119.736978:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d017f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+6:11075:x1874741481735424:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 605us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893119.736985:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 40 00000100:00080000:2.0:1787893119.737305:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787893119.746939:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893119.747021:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481735552 00000100:00100000:3.0:1787893119.747041:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481735552 00000100:00100000:3.0:1787893119.747096:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 41 00000100:00100000:3.0:1787893119.747115:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+6:11076:x1874741481735552:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787893119.747135:0:9515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893119.747155:0:9515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147d600/0x9232577658cf0f08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa72c expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893119.747218:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf0f0f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893119.747238:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf0f0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893119.747247:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf0f0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893119.747257:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf0f16 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893119.747274:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf0f16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893119.747279:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf0f16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893119.747326:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147ca00/0x9232577658cf0f1d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893119.747330:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147ca00/0x9232577658cf0f1d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893119.747334:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147ca00/0x9232577658cf0f1d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893119.747363:0:9515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787893119.747366:0:9515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787893119.747381:0:9515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147ca00/0x9232577658cf0f1d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893119.747389:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf0f0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893119.747395:0:9515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf0f0f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893119.747402:0:9515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf0f0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893119.747418:0:9515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c147c200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893119.747422:0:9515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf0f0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893119.747436:0:9515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf0f0f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893119.747449:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9c2f71800) 00010000:00010000:3.0:1787893119.747452:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893119.747456:0:9515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf0f0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893119.747462:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf0f0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893119.747476:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf0f16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893119.747482:0:9515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf0f16 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893119.747641:0:9515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf0f16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893119.747649:0:9515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c147cc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893119.747652:0:9515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf0f16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893119.747659:0:9515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf0f16 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893119.747668:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9fc9d5c29000) 00010000:00010000:3.0:1787893119.747671:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893119.747673:0:9515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf0f16 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893119.747690:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf0f16 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893119.747723:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147d600/0x9232577658cf0f08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa72c expref: 8 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893119.747737:0:9515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147ca00/0x9232577658cf0f1d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa72c expref: 7 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893119.747746:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fc9d5c29600) 00010000:00010000:3.0:1787893119.747748:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787893119.747750:0:9515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9c147ca00, rc 0) 00000100:00100000:3.0:1787893119.747811:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+7:11076:x1874741481735552:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 706us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893119.747819:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 41 00000100:00100000:0.0:1787893119.756190:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893119.756360:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481735680 00000100:00100000:3.0:1787893119.756369:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481735680 00000100:00100000:3.0:1787893119.756420:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 7 00000100:00100000:3.0:1787893119.756428:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:58232959-285a-4954-a3ac-571a2b817017+7:11076:x1874741481735680:12345-192.168.202.35@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787893119.756692:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:58232959-285a-4954-a3ac-571a2b817017+7:11076:x1874741481735680:12345-192.168.202.35@tcp:900:lhsmtool_posix.0 Request processed in 262us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893119.756702:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 7 00000100:00100000:0.0:1787893119.771621:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893119.771746:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481735936 00000100:00100000:3.0:1787893119.771756:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481735936 00000100:00100000:3.0:1787893119.771812:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 42 00000100:00100000:3.0:1787893119.771822:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+7:11076:x1874741481735936:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787893119.771857:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893119.771878:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147d600/0x9232577658cf0f24 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa733 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893119.771949:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf0f2b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893119.771963:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf0f2b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893119.771976:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf0f2b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893119.772893:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf0f32 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893119.772906:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf0f32 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893119.772914:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf0f32 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893119.773539:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f600/0x9232577658cf0f39 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893119.773574:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f600/0x9232577658cf0f39 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893119.773584:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f600/0x9232577658cf0f39 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893119.773595:0:6505:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1787893119.773693:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf0f2b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893119.773700:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf0f2b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893119.773707:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf0f2b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893119.773713:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c147cc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893119.773717:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf0f2b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893119.773724:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf0f2b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893119.773734:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fc9d5c29600) 00010000:00010000:2.0:1787893119.773737:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893119.773741:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf0f2b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893119.773747:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf0f2b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893119.773761:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf0f32 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893119.773774:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf0f32 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893119.773780:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf0f32 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893119.773785:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c147c200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893119.773788:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf0f32 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893119.773795:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf0f32 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893119.773803:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9fc9d5c29000) 00010000:00010000:2.0:1787893119.773806:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893119.773809:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf0f32 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893119.773815:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf0f32 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893119.774120:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147d600/0x9232577658cf0f24 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa733 expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893119.774136:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f600/0x9232577658cf0f39 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa733 expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893119.774144:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fc9d5c29800) 00010000:00010000:2.0:1787893119.774146:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893119.774154:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c771f600, rc 0) 00000100:00100000:2.0:1787893119.777573:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+9:11076:x1874741481735936:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 5738us (5947us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787893119.777587:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 42 00000100:00100000:0.0:1787893119.784759:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893119.785028:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481736064 00000100:00100000:3.0:1787893119.785039:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481736064 00000100:00100000:3.0:1787893119.785099:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 43 00000100:00100000:3.0:1787893119.785119:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+9:11076:x1874741481736064:12345-192.168.202.35@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787893119.785240:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+9:11076:x1874741481736064:12345-192.168.202.35@tcp:59:lhsmtool_posix.0 Request processed in 124us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893119.785248:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 43 00000100:00100000:0.0:1787893119.790779:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893119.790888:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481736192 00000100:00100000:1.0:1787893119.790899:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481736192 00000100:00080000:2.0:1787893119.790978:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787893119.791025:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 44 00000100:00100000:1.0:1787893119.791035:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+5:11076:x1874741481736192:12345-192.168.202.35@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1787893119.793230:0:6504:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2153us 00000100:00100000:1.0:1787893119.820846:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+5:11076:x1874741481736192:12345-192.168.202.35@tcp:59:lhsmtool_posix.0 Request processed in 29802us (30067us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893119.820862:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 44 00000100:00100000:0.0:1787893120.180128:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787893120.180152:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7f6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874741493367680:0@lo:400:kworker.0 00000100:00100000:0.0:1787893120.180224:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893120.180308:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7f6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1874741493367552:0@lo:400:kworker.0 00000100:00100000:0.0:1787893120.180333:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893120.180352:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787893120.180359:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7f6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493367424:0@lo:400:kworker.0 00000100:00100000:0.0:1787893120.180387:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893120.180431:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493367808:0@lo:400:kworker.0 00000100:00100000:0.0:1787893120.180455:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893120.180507:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787893120.180513:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1874741493367936:0@lo:400:kworker.0 00000100:00100000:0.0:1787893120.180537:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893120.180573:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1874741493368064:0@lo:400:kworker.0 00000100:00100000:0.0:1787893120.180596:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893120.180631:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493367680 00000100:00100000:0.0:1787893120.180638:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493367680 00000100:00100000:0.0:1787893120.180680:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493367552 00000100:00100000:0.0:1787893120.180682:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493367552 00000100:00100000:0.0:1787893120.180696:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493367936 00000100:00100000:0.0:1787893120.180698:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493367936 00000100:00100000:0.0:1787893120.180716:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493368064 00000100:00100000:0.0:1787893120.180719:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493368064 00000100:00100000:0.0:1787893120.180735:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1787893120.180744:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1874741493367680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893120.180794:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1874741493367680:12345-0@lo:400:kworker.0 Request processed in 52us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893120.180800:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1787893120.180816:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1787893120.180821:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1874741493367552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893120.180861:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1874741493367552:12345-0@lo:400:kworker.0 Request processed in 39us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893120.180866:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1787893120.180878:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1787893120.180884:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7f6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3631:x1874741493367936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893120.180907:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7f6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3631:x1874741493367936:12345-0@lo:400:kworker.0 Request processed in 24us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893120.180912:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1787893120.180923:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1787893120.180928:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1874741493368064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893120.180952:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1874741493368064:12345-0@lo:400:kworker.0 Request processed in 25us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893120.180957:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00010000:00080000:0.0:1787893120.180992:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7f6c000 x1874741493368064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893120.181006:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1874741493368064:0@lo:400:kworker.0 00000100:00100000:0.0:1787893120.181015:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1874741493367936:0@lo:400:kworker.0 00000100:00100000:0.0:1787893120.181023:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7f6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1874741493367552:0@lo:400:kworker.0 00000100:00100000:0.0:1787893120.181049:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7f6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874741493367680:0@lo:400:kworker.0 00000100:00100000:0.0:1787893120.181073:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787893120.181080:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7f6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493368192:0@lo:400:kworker.0 00000100:00100000:0.0:1787893120.181115:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893120.181141:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493368192 00000100:00100000:0.0:1787893120.181150:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493368192 00000100:00100000:0.0:1787893120.181206:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787893120.181213:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7f6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493368192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893120.181248:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7f6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493368192:12345-0@lo:400:kworker.0 Request processed in 36us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893120.181254:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:0.0:1787893120.181281:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7f6dc00 x1874741493368192/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893120.181291:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7f6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493368192:0@lo:400:kworker.0 00000100:00100000:0.0:1787893120.181318:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7f6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493368320:0@lo:400:kworker.0 00000100:00100000:0.0:1787893120.181341:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893120.181376:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787893120.181382:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1874741493368448:0@lo:400:kworker.0 00000100:00100000:0.0:1787893120.181403:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893120.181423:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493368448 00000100:00100000:0.0:1787893120.181426:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493368448 00000100:00100000:0.0:1787893120.181447:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1787893120.181453:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1874741493368448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893120.181483:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1874741493368448:12345-0@lo:400:kworker.0 Request processed in 30us (79us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893120.181510:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1787893120.181537:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1874741493368448:0@lo:400:kworker.0 00000100:00100000:0.0:1787893120.181567:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1874741493368576:0@lo:400:kworker.0 00000100:00100000:0.0:1787893120.181590:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893120.181612:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493368576 00000100:00100000:0.0:1787893120.181621:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493368576 00000100:00100000:0.0:1787893120.181645:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1787893120.181651:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7f6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1874741493368576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893120.181683:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7f6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1874741493368576:12345-0@lo:400:kworker.0 Request processed in 32us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893120.181689:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00010000:00080000:0.0:1787893120.181714:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7f6c000 x1874741493368576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893120.181726:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1874741493368576:0@lo:400:kworker.0 00000100:00100000:0.0:1787893120.181750:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787893120.181756:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493368704:0@lo:400:kworker.0 00000100:00100000:0.0:1787893120.181777:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893120.181799:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493368320 00000100:00100000:0.0:1787893120.181802:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493368320 00000100:00100000:0.0:1787893120.181822:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493368704 00000100:00100000:0.0:1787893120.181825:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493368704 00000100:00100000:0.0:1787893120.181841:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787893120.181847:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7f6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493368320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893120.181879:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7f6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493368320:12345-0@lo:400:kworker.0 Request processed in 33us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893120.181885:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787893120.181896:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787893120.181901:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493368704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893120.181926:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493368704:12345-0@lo:400:kworker.0 Request processed in 25us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893120.181932:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787893120.181964:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493368704:0@lo:400:kworker.0 00010000:00080000:0.0:1787893120.181975:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7f6dc00 x1874741493368320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893120.181984:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7f6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493368320:0@lo:400:kworker.0 00000100:00100000:0.0:1787893120.182016:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7f6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493368832:0@lo:400:kworker.0 00000100:00100000:0.0:1787893120.182038:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893120.182061:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493368832 00000100:00100000:0.0:1787893120.182065:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493368832 00000100:00100000:0.0:1787893120.182086:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787893120.182092:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7f6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493368832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893120.183300:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493367424 00000100:00100000:1.0:1787893120.183310:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493367424 00000100:00100000:1.0:1787893120.183348:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1787893120.183356:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+24:3631:x1874741493367424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893120.183413:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+24:3631:x1874741493367424:12345-0@lo:400:kworker.0 Request processed in 58us (3025us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893120.183419:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1787893120.183450:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493367808 00000100:00100000:1.0:1787893120.183454:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493367808 00000100:00100000:1.0:1787893120.183477:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787893120.183483:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7f6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493367808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893120.183540:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7f6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493367808:12345-0@lo:400:kworker.0 Request processed in 57us (3083us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893120.183546:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787893120.183630:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7f6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493367424:0@lo:400:kworker.0 00000100:00100000:1.0:1787893120.183644:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787893120.183651:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d0f52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493368960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787893120.183735:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893120.183765:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493368960 00000100:00100000:1.0:1787893120.183768:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493368960 00000100:00100000:1.0:1787893120.183795:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787893120.183813:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d0f51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3631:x1874741493368960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787893120.183834:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787893120.183870:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d0f51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3631:x1874741493368960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893120.183876:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787893120.183908:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493367808:0@lo:400:kworker.0 00000100:00100000:1.0:1787893120.183934:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d0f52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493368960:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787893120.187404:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787893120.187414:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787893120.187417:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787893120.187420:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787893120.187525:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787893120.187546:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493369088:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787893120.187629:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893120.187694:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493369088 00000100:00100000:2.0:1787893120.187702:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493369088 00000100:00100000:2.0:1787893120.187747:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787893120.187757:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493369088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787893120.187779:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787893120.187824:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493369088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893120.187831:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787893120.187874:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493369088:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787893120.190890:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7f6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493368832:12345-0@lo:400:kworker.0 Request processed in 8788us (8841us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893120.190904:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787893120.192296:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7f6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493368832:0@lo:400:kworker.0 00000040:00080000:3.0:1787893120.562914:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1787893120.628918:0:13789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787893120.691522:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893121.053214:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893121.053274:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893121.053319:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893121.053348:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893121.053385:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893121.053424:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481736448 00000100:00100000:3.0:1787893121.053434:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481736448 00000100:00100000:3.0:1787893121.053518:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481736704 00000100:00100000:3.0:1787893121.053522:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481736704 00000100:00100000:1.0:1787893121.053552:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481736576 00000100:00100000:1.0:1787893121.053558:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481736576 00000100:00100000:3.0:1787893121.053560:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481736832 00000100:00100000:3.0:1787893121.053565:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481736832 00000100:00100000:3.0:1787893121.053594:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 307 00000100:00100000:3.0:1787893121.053603:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d017ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+9:2390:x1874741481736448:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893121.053672:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d017ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+9:2390:x1874741481736448:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 69us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893121.057203:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 308 00000100:00100000:1.0:1787893121.057228:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d017c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481736704:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893121.057309:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d017c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481736704:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 93us (4036us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893121.057318:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 308 00000100:00100000:1.0:1787893121.057356:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 309 00000100:00100000:1.0:1787893121.057363:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d017ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481736576:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893121.057390:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d017ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481736576:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 28us (4044us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893121.057396:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 309 00000100:00100000:1.0:1787893121.057410:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 310 00000100:00100000:1.0:1787893121.057416:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d017d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481736832:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893121.057436:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d017d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481736832:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 21us (4054us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893121.057450:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 310 00000100:00100000:3.0:1787893121.059044:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 307 00000100:00100000:3.0:1787893121.059108:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481736320 00000100:00100000:3.0:1787893121.059117:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481736320 00000100:00100000:3.0:1787893121.059167:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 385 00000100:00100000:3.0:1787893121.059177:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2390:x1874741481736320:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893121.060357:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2390:x1874741481736320:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 1175us (7034us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893121.060368:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 385 00000100:00080000:3.0:1787893121.060419:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787893121.060424:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787893121.713724:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893122.038798:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893122.038837:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481736960 00000100:00100000:1.0:1787893122.038847:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481736960 00000100:00100000:1.0:1787893122.038899:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 45 00000100:00100000:1.0:1787893122.038910:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d0f52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+9:11119:x1874741481736960:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:1.0:1787893122.038944:0:10086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893122.038966:0:10086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf0f47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa73a expref: -99 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893122.039032:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf0f4e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893122.039058:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf0f4e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893122.039070:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf0f4e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893122.039096:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf0f55 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893122.039104:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf0f55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893122.039111:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf0f55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893122.039152:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf0f4e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893122.039172:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf0f4e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893122.039179:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf0f4e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893122.039185:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe541a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893122.039190:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf0f4e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893122.039198:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf0f4e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893122.039211:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9c2f71800) 00010000:00010000:1.0:1787893122.039214:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893122.039219:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf0f4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893122.039225:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf0f4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893122.039239:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf0f55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893122.039245:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf0f55 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893122.039252:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf0f55 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893122.039257:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe541600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893122.039266:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf0f55 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893122.039272:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf0f55 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893122.039280:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9fc9c28bd500) 00010000:00010000:1.0:1787893122.039282:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893122.039285:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf0f55 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893122.039290:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf0f55 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893122.039322:0:10086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf0f47 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa73a expref: 10 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893122.039332:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9c2f71800) 00010000:00010000:1.0:1787893122.039335:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893122.039339:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf0f47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa73a expref: 10 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893122.039348:0:10086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe541200, rc 0) 00000100:00100000:1.0:1787893122.039401:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d0f52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+9:11119:x1874741481736960:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 492us (613us total) trans 0 rc 301/301 00000100:00100000:1.0:1787893122.039408:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 45 00000100:00100000:0.0:1787893122.056796:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893122.058000:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481737216 00000100:00100000:3.0:1787893122.058011:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481737216 00000100:00100000:3.0:1787893122.058076:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 46 00000100:00100000:3.0:1787893122.058108:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7f6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+9:11119:x1874741481737216:12345-192.168.202.35@tcp:36:lfs.0 00010000:00010000:3.0:1787893122.058164:0:13436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893122.058189:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf0f01 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa725 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.058208:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9c2f71800) 00010000:00010000:3.0:1787893122.058217:0:13436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787893122.058275:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf0f5c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.058288:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf0f5c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.058298:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf0f5c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.058310:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf0f63 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.058317:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf0f63 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.058324:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf0f63 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.058830:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ec00/0x9232577658cf0f6a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.058840:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ec00/0x9232577658cf0f6a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.058848:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ec00/0x9232577658cf0f6a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787893122.058876:0:13436:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9e9b0d1 reply state 00000000b51a325c transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ec00/0x9232577658cf0f6a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.058885:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ec00/0x9232577658cf0f6a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.058891:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc9d0fd6700) 00010000:00010000:3.0:1787893122.058894:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787893122.058896:0:13436:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787893122.058900:0:13436:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1787893122.058906:0:13436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf0f5c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.058912:0:13436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf0f5c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.058918:0:13436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf0f5c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.058924:0:13436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c771fa00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893122.058928:0:13436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf0f5c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.058935:0:13436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf0f5c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.058943:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9d0fd6b00) 00010000:00010000:3.0:1787893122.058945:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893122.058948:0:13436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf0f5c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.058963:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf0f5c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787893122.058979:0:13436:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9e9b0d1 reply state 00000000b51a325c transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf0f63 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.058987:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf0f63 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.058993:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9fc9d0fd6600) 00010000:00010000:3.0:1787893122.058995:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787893122.058996:0:13436:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787893122.059102:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7f6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+10:11119:x1874741481737216:12345-192.168.202.35@tcp:36:lfs.0 Request processed in 995us (2315us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787893122.059110:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 46 00000100:00100000:0.0:1787893122.190382:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893122.192615:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481737344 00000100:00100000:3.0:1787893122.192626:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481737344 00000100:00100000:3.0:1787893122.192691:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 47 00000100:00100000:3.0:1787893122.192703:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7f6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+10:11127:x1874741481737344:12345-192.168.202.35@tcp:101:lctl.0 00010000:00010000:3.0:1787893122.192728:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893122.192751:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf0f71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa741 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.192814:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fe00/0x9232577658cf0f78 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.192827:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fe00/0x9232577658cf0f78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.192857:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fe00/0x9232577658cf0f78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893122.192895:0:6504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787893122.192899:0:6504:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787893122.192935:0:6504:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fe00/0x9232577658cf0f78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.192959:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf0f71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa741 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.192975:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fe00/0x9232577658cf0f78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa741 expref: 11 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.192984:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9d0fd6b00) 00010000:00010000:3.0:1787893122.192987:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787893122.192991:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c771fe00, rc 0) 00000100:00100000:3.0:1787893122.193770:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7f6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+11:11127:x1874741481737344:12345-192.168.202.35@tcp:101:lctl.0 Request processed in 1066us (3394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893122.193778:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 47 00000100:00100000:2.0:1787893122.228643:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d15cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493369216:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787893122.228722:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893122.228810:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787893122.228816:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493369344:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787893122.228834:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893122.233779:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493369216 00000100:00100000:3.0:1787893122.233795:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493369216 00000100:00080000:2.0:1787893122.233949:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787893122.235706:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493369344 00000100:00100000:3.0:1787893122.235719:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493369344 00000100:00100000:3.0:1787893122.235772:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787893122.235784:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493369216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787893122.235817:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787893122.235904:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493369216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 122us (7181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893122.235927:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787893122.235945:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787893122.235953:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ed562300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493369344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787893122.235964:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787893122.235991:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ed562300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493369344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (7155us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893122.235998:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:2.0:1787893122.237402:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787893122.237450:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7f6ea00 x1874741493369344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893138 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893122.237476:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493369344:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1787893122.237520:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9d15cb800 x1874741493369216/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893138 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893122.237534:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d15cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493369216:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787893122.317793:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893122.317902:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481737472 00000100:00100000:2.0:1787893122.317912:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481737472 00000100:00100000:2.0:1787893122.317969:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 48 00000100:00100000:2.0:1787893122.317978:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d0f50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+11:11133:x1874741481737472:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:2.0:1787893122.317997:0:10086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893122.318018:0:10086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf0f7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa748 expref: -99 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.318093:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf0f86 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.318107:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf0f86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.318118:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf0f86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.318148:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf0f8d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.318156:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf0f8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.318163:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf0f8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.318243:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f600/0x9232577658cf0f94 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.318251:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f600/0x9232577658cf0f94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.318258:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f600/0x9232577658cf0f94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893122.318295:0:10086:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1787893122.318299:0:10086:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787893122.318338:0:10086:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f600/0x9232577658cf0f94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.318350:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf0f86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.318356:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf0f86 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.318361:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf0f86 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.318372:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7e800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893122.318375:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf0f86 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.318381:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf0f86 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.318390:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9d0fd6b00) 00010000:00010000:2.0:1787893122.318392:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893122.318395:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf0f86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.318399:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf0f86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.318408:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf0f8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.318412:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf0f8d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.318415:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf0f8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.318418:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7ea00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893122.318419:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf0f8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.318422:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf0f8d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.318433:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9fc9d0fd6600) 00010000:00010000:2.0:1787893122.318434:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893122.318436:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf0f8d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.318439:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf0f8d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.318457:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf0f7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa748 expref: 13 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.318465:0:10086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f600/0x9232577658cf0f94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa748 expref: 12 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.318469:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc9d0fd6700) 00010000:00010000:2.0:1787893122.318470:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787893122.318472:0:10086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7f600, rc 0) 00000100:00100000:2.0:1787893122.318778:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d0f50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+12:11133:x1874741481737472:12345-192.168.202.35@tcp:101:bash.0 Request processed in 800us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893122.318783:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 48 00000100:00100000:1.0:1787893122.324417:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893122.324544:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481737728 00000100:00100000:3.0:1787893122.324555:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481737728 00000100:00100000:3.0:1787893122.324615:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 49 00000100:00100000:3.0:1787893122.324625:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d0f50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+12:11133:x1874741481737728:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:3.0:1787893122.324646:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893122.324665:0:13436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf0f9b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa74f expref: -99 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.325000:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771e400/0x9232577658cf0fa2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.325015:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771e400/0x9232577658cf0fa2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.325027:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771e400/0x9232577658cf0fa2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.325107:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf0fa9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.325116:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf0fa9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.325138:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf0fa9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787893122.325443:0:13436:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:3.0:1787893122.327025:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf0fb0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.327041:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf0fb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.327052:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf0fb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.327095:0:13436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771e400/0x9232577658cf0fa2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.327103:0:13436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771e400/0x9232577658cf0fa2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.327111:0:13436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771e400/0x9232577658cf0fa2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.327116:0:13436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c771e400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893122.327121:0:13436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771e400/0x9232577658cf0fa2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.327128:0:13436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771e400/0x9232577658cf0fa2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.327139:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc9d0fd6700) 00010000:00010000:3.0:1787893122.327142:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893122.327158:0:13436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771e400/0x9232577658cf0fa2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.327164:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771e400/0x9232577658cf0fa2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787893122.327177:0:13436:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000075c68d33 reply state 000000009208b35e transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf0fa9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.327188:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf0fa9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.327193:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc9d0fd6f00) 00010000:00010000:3.0:1787893122.327195:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787893122.327198:0:13436:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787893122.327231:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf0f9b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa74f expref: 15 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.327246:0:13436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf0fb0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa74f expref: 14 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.327253:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc9d0fd6300) 00010000:00010000:3.0:1787893122.327255:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787893122.327258:0:13436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9c0031400, rc 0) 00000100:00100000:3.0:1787893122.327337:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d0f50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+15:11133:x1874741481737728:12345-192.168.202.35@tcp:101:bash.0 Request processed in 2713us (2929us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1787893122.327345:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 49 00000100:00100000:3.0:1787893122.331714:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893122.331819:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481737856 00000100:00100000:0.0:1787893122.331828:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481737856 00000100:00100000:0.0:1787893122.331878:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 28 00000100:00100000:0.0:1787893122.331887:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2389:x1874741481737856:12345-192.168.202.35@tcp:8:bash.0 00010000:00080000:0.0:1787893122.331922:0:8535:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 58232959-285a-4954-a3ac-571a2b817017@192.168.202.35@tcp t0 exp 0000000000000000 cur 366 last 0 00000020:00000080:0.0:1787893122.331959:0:8535:0:(genops.c:1385:class_connect()) connect: client 58232959-285a-4954-a3ac-571a2b817017, cookie 0x9232577658cf0fbe 00002000:00100000:0.0:1787893122.331971:0:8535:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 58232959-285a-4954-a3ac-571a2b817017/ffff9fc8c7f30000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787893122.331982:0:8535:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787893122.332055:0:8535:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787893122.332092:0:8535:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7f34000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787893122.332158:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58232959-285a-4954-a3ac-571a2b817017+6:2389:x1874741481737856:12345-192.168.202.35@tcp:8:bash.0 Request processed in 269us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893122.332178:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 28 00000100:00100000:1.0:1787893122.348760:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893122.348907:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481737984 00000100:00100000:2.0:1787893122.348917:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481737984 00000100:00100000:2.0:1787893122.348999:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 29 00000100:00100000:2.0:1787893122.349011:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d0f51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58232959-285a-4954-a3ac-571a2b817017+6:0:x1874741481737984:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:2.0:1787893122.349029:0:8419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893122.349052:0:8419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e910ac25/0x9232577658cf0fc5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa756 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787893122.349103:0:8419:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893122.349126:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=366s v=(0 0) 00010000:00010000:2.0:1787893122.349130:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893122.349140:0:8419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e910ac25/0x9232577658cf0fc5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa756 expref: 7 pid: 8419 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.349161:0:8419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e910ac25/0x9232577658cf0fc5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa756 expref: 7 pid: 8419 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.349174:0:8419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7ea00, rc 0) 00000100:00100000:2.0:1787893122.349241:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d0f51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58232959-285a-4954-a3ac-571a2b817017+7:0:x1874741481737984:12345-192.168.202.35@tcp:101:bash.0 Request processed in 232us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893122.349248:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 29 00000100:00080000:3.0:1787893122.349789:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787893122.353090:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893122.353197:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481738112 00000100:00100000:0.0:1787893122.353207:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481738112 00000100:00100000:0.0:1787893122.353271:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 30 00000100:00100000:0.0:1787893122.353281:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ed560e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58232959-285a-4954-a3ac-571a2b817017+7:11133:x1874741481738112:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:0.0:1787893122.353298:0:8535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893122.353319:0:8535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001414b08e/0x9232577658cf0fcc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa75d expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893122.353350:0:8535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e910ac25/0x9232577658cf0fc5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa756 expref: 8 pid: 8419 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893122.353358:0:8535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787893122.353362:0:8535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787893122.353367:0:8535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001414b08e/0x9232577658cf0fcc lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa75d expref: 8 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893122.353399:0:8535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e910ac25/0x9232577658cf0fc5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa756 expref: 8 pid: 8419 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893122.353414:0:8535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e910ac25/0x9232577658cf0fc5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa756 expref: 8 pid: 8419 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893122.353428:0:8535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7f6d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8535:1874741493369472:192.168.202.35@tcp:104: 00000100:00100000:0.0:1787893122.353579:0:8535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57900 going to sleep for 11 seconds 00000100:00100000:0.0:1787893122.364641:0:8535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7f6d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8535:1874741493369472:192.168.202.35@tcp:104: 00010000:00010000:0.0:1787893122.364681:0:8535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001414b08e/0x9232577658cf0fcc lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa75d expref: 8 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893122.364703:0:8535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb31000, rc 0) 00000100:00100000:0.0:1787893122.364954:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ed560e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58232959-285a-4954-a3ac-571a2b817017+8:11133:x1874741481738112:12345-192.168.202.35@tcp:101:bash.0 Request processed in 11672us (11881us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893122.364964:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 30 00000100:00100000:2.0:1787893122.371552:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893122.378641:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481738240 00000100:00100000:1.0:1787893122.378676:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481738240 00010000:00010000:1.0:1787893122.378727:0:6490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e910ac25/0x9232577658cf0fc5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa756 expref: 8 pid: 8419 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893122.378988:0:10383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 52 00000100:00100000:0.0:1787893122.379002:0:10383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3efd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58232959-285a-4954-a3ac-571a2b817017+8:2390:x1874741481738240:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893122.379016:0:10383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893122.379039:0:10383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e910ac25/0x9232577658cf0fc5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa756 expref: 8 pid: 8419 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893122.379054:0:10383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e910ac25/0x9232577658cf0fc5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa756 expref: 8 pid: 8419 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893122.379090:0:10383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e910ac25/0x9232577658cf0fc5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa756 expref: 8 pid: 8419 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893122.379108:0:10383:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787893122.379113:0:10383:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787893122.379122:0:10383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001414b08e/0x9232577658cf0fcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa75d expref: 7 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893122.379146:0:10383:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001414b08e/0x9232577658cf0fcc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa75d expref: 7 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893122.379185:0:10383:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001414b08e/0x9232577658cf0fcc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa75d expref: 7 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893122.379200:0:10383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7f6d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10383:1874741493369600:192.168.202.35@tcp:105: 00000100:00100000:0.0:1787893122.379297:0:10383:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57900 going to sleep for 11 seconds 00000100:00100000:0.0:1787893122.383635:0:10383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7f6d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10383:1874741493369600:192.168.202.35@tcp:105: 00010000:00010000:0.0:1787893122.383661:0:10383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893122.383717:0:10383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3efd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58232959-285a-4954-a3ac-571a2b817017+7:2390:x1874741481738240:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 4718us (12186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893122.383729:0:10383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 52 00000100:00100000:3.0:1787893122.391938:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893122.392649:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481738496 00000100:00100000:2.0:1787893122.392660:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481738496 00000100:00100000:2.0:1787893122.392720:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 6 00000100:00100000:2.0:1787893122.392730:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+15:11133:x1874741481738496:12345-192.168.202.35@tcp:35:bash.0 00000100:00100000:2.0:1787893122.398213:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+16:11133:x1874741481738496:12345-192.168.202.35@tcp:35:bash.0 Request processed in 5471us (6272us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787893122.398229:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 6 00000100:00100000:2.0:1787893122.520591:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893122.520679:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481738752 00000100:00100000:0.0:1787893122.520689:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481738752 00000100:00100000:0.0:1787893122.520754:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 50 00000100:00100000:0.0:1787893122.520766:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ed561880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+16:11143:x1874741481738752:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787893122.520789:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893122.520810:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf0fd3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa764 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893122.520909:0:6505:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1787893122.521014:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf0fd3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa764 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893122.521047:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9d0fd6b00) 00010000:00010000:0.0:1787893122.521051:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787893122.521056:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf0fd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa764 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893122.521069:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb31c00, rc 0) 00000100:00100000:0.0:1787893122.521141:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ed561880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+17:11143:x1874741481738752:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 378us (560us total) trans 4294967315 rc 301/301 00000100:00100000:0.0:1787893122.521148:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 50 00000100:00100000:3.0:1787893122.525549:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893122.526619:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481739008 00000100:00100000:1.0:1787893122.526631:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481739008 00000100:00100000:1.0:1787893122.526703:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 7 00000100:00100000:1.0:1787893122.526714:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+17:11143:x1874741481739008:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:1.0:1787893122.527190:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+18:11143:x1874741481739008:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 477us (1698us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787893122.527199:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 7 00000040:00080000:3.0:1787893122.612301:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1787893122.677822:0:13789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787893122.737121:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893122.737305:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481739136 00000100:00100000:0.0:1787893122.737314:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481739136 00000100:00100000:0.0:1787893122.737379:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 51 00000100:00100000:0.0:1787893122.737390:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+18:11149:x1874741481739136:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787893122.737413:0:9515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893122.737433:0:9515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf0fe1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa76b expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893122.737531:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf0fe8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893122.737547:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf0fe8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893122.737558:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf0fe8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893122.737602:0:9515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1787893122.737618:0:9515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1787893122.737866:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:0.0:1787893122.737882:0:9515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf0fe8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893122.737913:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf0fe1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa76b expref: 20 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893122.737932:0:9515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf0fe8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa76b expref: 19 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893122.737940:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc9d0fd6700) 00010000:00010000:0.0:1787893122.737943:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787893122.737948:0:9515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb30000, rc 0) 00000100:00100000:0.0:1787893122.738013:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+19:11149:x1874741481739136:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 625us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893122.738021:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 51 00000100:00100000:2.0:1787893122.743369:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893122.743469:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481739392 00000100:00100000:0.0:1787893122.743479:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481739392 00000100:00100000:0.0:1787893122.743572:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 52 00000100:00100000:0.0:1787893122.743582:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ed562680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+19:11149:x1874741481739392:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787893122.743600:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893122.743621:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf0fef lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa772 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893122.743999:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf0ff6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893122.744012:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf0ff6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893122.744048:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf0ff6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893122.744059:0:6506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787893122.744169:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf0fef lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa772 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893122.744186:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf0ff6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa772 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893122.744195:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc9d0fd6300) 00010000:00010000:0.0:1787893122.744198:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787893122.744200:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb30600, rc 0) 00000100:00100000:0.0:1787893122.744290:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ed562680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+21:11149:x1874741481739392:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 710us (930us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1787893122.744297:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 52 00000100:00100000:3.0:1787893122.759328:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893122.759414:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893122.759614:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481739520 00000100:00100000:2.0:1787893122.759625:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481739520 00000100:00100000:2.0:1787893122.759706:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 3 00000100:00100000:2.0:1787893122.759717:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58232959-285a-4954-a3ac-571a2b817017+21:2390:x1874741481739520:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787893122.759732:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893122.759756:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf0ff6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa772 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.759778:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc9d0fd6300) 00010000:00010000:2.0:1787893122.759783:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893122.759838:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58232959-285a-4954-a3ac-571a2b817017+20:2390:x1874741481739520:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 123us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893122.759846:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 3 00000100:00100000:0.0:1787893122.760324:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481739776 00000100:00100000:0.0:1787893122.760332:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481739776 00000100:00100000:0.0:1787893122.760369:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 53 00000100:00100000:0.0:1787893122.760377:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+20:11149:x1874741481739776:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787893122.760397:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893122.760412:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1004 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa779 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893122.760527:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf100b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893122.760559:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf100b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893122.760570:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf100b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893122.760583:0:6504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787893122.760736:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1004 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa779 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893122.760752:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf100b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa779 expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893122.760775:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc9d0fd6300) 00010000:00010000:1.0:1787893122.760779:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787893122.760782:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb31e00, rc 0) 00000100:00100000:1.0:1787893122.760834:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+22:11149:x1874741481739776:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 457us (1419us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1787893122.760840:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 53 00000100:00100000:3.0:1787893122.770108:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893122.770297:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481739904 00000100:00100000:2.0:1787893122.770307:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481739904 00000100:00100000:2.0:1787893122.770361:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 31 00000100:00100000:2.0:1787893122.770370:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58232959-285a-4954-a3ac-571a2b817017+7:2390:x1874741481739904:12345-192.168.202.35@tcp:1:lfs.0 00010000:00010000:2.0:1787893122.770411:0:8419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e9de250/0x9232577658cf1019 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.770430:0:8419:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001414b08e/0x9232577658cf0fcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa75d expref: 7 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.770438:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893122.770443:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787893122.770447:0:8419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e9de250/0x9232577658cf1019 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.770523:0:8419:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001414b08e/0x9232577658cf0fcc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa75d expref: 7 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.770539:0:8419:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001414b08e/0x9232577658cf0fcc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa75d expref: 7 pid: 8535 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893122.770555:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed563b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8419:1874741493369728:192.168.202.35@tcp:104: 00000100:00100000:1.0:1787893122.771645:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c3ed2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787893122.773814:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893122.774107:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed563b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8419:1874741493369728:192.168.202.35@tcp:104: 00010000:00010000:1.0:1787893122.774135:0:8419:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009e9de250/0x9232577658cf1019 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893122.776147:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481740032 00000100:00100000:0.0:1787893122.776164:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481740032 00002000:00100000:0.0:1787893122.776219:0:8424:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff9fc9d15c8000 x1874741481740032/t0(0) o4->58232959-285a-4954-a3ac-571a2b817017@192.168.202.35@tcp:283/0 lens 504/0 e 0 to 0 dl 1787893133 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787893122.776230:0:8424:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc9d15c8000 with x1874741481740032 ext(0->12) 00010000:00010000:0.0:1787893122.776239:0:8424:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001414b08e/0x9232577658cf0fcc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa75d expref: 8 pid: 8535 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893122.776257:0:8424:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001414b08e/0x9232577658cf0fcc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa75d expref: 8 pid: 8535 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787893122.776265:0:8424:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9fc9d15c8000 00000100:00100000:0.0:1787893122.776367:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 0 00000100:00100000:0.0:1787893122.776377:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:58232959-285a-4954-a3ac-571a2b817017+8:2391:x1874741481740032:12345-192.168.202.35@tcp:4:lfs.0 00000001:00100000:1.0:1787893122.781941:0:8413:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 58232959-285a-4954-a3ac-571a2b817017 00000100:00100000:0.0:1787893122.782623:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:58232959-285a-4954-a3ac-571a2b817017+9:2391:x1874741481740032:12345-192.168.202.35@tcp:4:lfs.0 Request processed in 6240us (8811us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787893122.782635:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 0 00002000:00100000:0.0:1787893122.782648:0:8424:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff9fc9d15c8000 x1874741481740032/t4294967300(0) o4->58232959-285a-4954-a3ac-571a2b817017@192.168.202.35@tcp:283/0 lens 504/448 e 0 to 0 dl 1787893133 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787893122.782674:0:8424:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc9d15c8000 with x1874741481740032 ext(0->12) 00010000:00010000:0.0:1787893122.782684:0:8424:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001414b08e/0x9232577658cf0fcc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa75d expref: 9 pid: 8535 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893122.782703:0:8424:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001414b08e/0x9232577658cf0fcc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa75d expref: 9 pid: 8535 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787893122.782712:0:8424:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9fc9d15c8000 00000100:00100000:3.0:1787893122.790399:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893122.790552:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481740160 00000100:00100000:1.0:1787893122.790562:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481740160 00010000:00010000:1.0:1787893122.790606:0:6490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001414b08e/0x9232577658cf0fcc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa75d expref: 9 pid: 8535 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893122.790644:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 53 00000100:00100000:1.0:1787893122.790654:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+9:2393:x1874741481740160:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893122.790671:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787893122.790690:0:6490:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787893122.790694:0:6490:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1787893122 00002000:00010000:1.0:1787893122.790696:0:6490:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1787893122 00002000:00010000:1.0:1787893122.790698:0:6490:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1787893122 00002000:00010000:1.0:1787893122.790700:0:6490:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1787893122.790706:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001414b08e/0x9232577658cf0fcc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa75d expref: 9 pid: 8535 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893122.790720:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001414b08e/0x9232577658cf0fcc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa75d expref: 9 pid: 8535 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893122.790745:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001414b08e/0x9232577658cf0fcc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa75d expref: 9 pid: 8535 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893122.790763:0:6490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787893122.790767:0:6490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787893122.790789:0:6490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009e9de250/0x9232577658cf1019 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893122.790799:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e9de250/0x9232577658cf1019 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893122.790841:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893122.790899:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+8:2393:x1874741481740160:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 246us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893122.790907:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 53 00010000:00010000:2.0:1787893122.791208:0:8419:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009e9de250/0x9232577658cf1019 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.791218:0:8419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e9de250/0x9232577658cf1019 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.791238:0:8419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e9de250/0x9232577658cf1019 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.791248:0:8419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e9de250/0x9232577658cf1019 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.791256:0:8419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e9de250/0x9232577658cf1019 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.791263:0:8419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7f200 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787893122.791267:0:8419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e9de250/0x9232577658cf1019 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.791285:0:8419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e9de250/0x9232577658cf1019 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.791298:0:8419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e9de250/0x9232577658cf1019 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.791306:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e9de250/0x9232577658cf1019 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893122.791372:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58232959-285a-4954-a3ac-571a2b817017+7:2390:x1874741481739904:12345-192.168.202.35@tcp:1:lfs.0 Request processed in 21002us (21274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893122.791380:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 31 00000100:00100000:3.0:1787893122.793935:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893122.794096:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481740416 00000100:00100000:2.0:1787893122.794105:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481740416 00000100:00100000:2.0:1787893122.794165:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 8 00000100:00100000:2.0:1787893122.794175:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+22:11149:x1874741481740416:12345-192.168.202.35@tcp:35:lfs.0 00000004:00010000:2.0:1787893122.794246:0:6507:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf100b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa779 expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787893122.794451:0:6507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:2.0:1787893122.794551:0:6507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1787893122.794842:0:6507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:2.0:1787893122.794881:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf1020 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.794895:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf0fb0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa74f expref: 26 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.794912:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf1020 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.794949:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf0fb0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa74f expref: 26 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.795247:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf0fb0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa74f expref: 26 pid: 13436 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893122.795262:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed561180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6507:1874741493369856:192.168.202.35@tcp:104: 00000100:00100000:3.0:1787893122.798334:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c3ed2900 going to sleep for 11 seconds 00000100:00100000:3.0:1787893122.805169:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893122.805316:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed561180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6507:1874741493369856:192.168.202.35@tcp:104: 00010000:00010000:0.0:1787893122.805344:0:6507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf1020 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893122.805465:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481740544 00000100:00100000:2.0:1787893122.805473:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481740544 00010000:00010000:2.0:1787893122.805548:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf0fb0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa74f expref: 27 pid: 13436 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893122.805584:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 54 00000100:00100000:2.0:1787893122.805593:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58232959-285a-4954-a3ac-571a2b817017+27:2390:x1874741481740544:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787893122.805607:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893122.805615:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf0fb0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa74f expref: 27 pid: 13436 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.805627:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf0fb0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa74f expref: 27 pid: 13436 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.805651:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf0fb0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa74f expref: 27 pid: 13436 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.805686:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc9d0fd6300) 00010000:00010000:2.0:1787893122.805691:0:6491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf1020 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.805701:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf1020 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.805709:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf1020 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.805727:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893122.805782:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58232959-285a-4954-a3ac-571a2b817017+26:2390:x1874741481740544:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 190us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893122.805789:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 54 00010000:00010000:0.0:1787893122.806750:0:6507:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf1020 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893122.806763:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf1020 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787893122.806878:0:6507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:0.0:1787893122.807069:0:6507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:0.0:1787893122.807172:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7f6d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6507:1874741493369984:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787893122.807295:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893122.807330:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787893122.807381:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493369984 00000100:00100000:2.0:1787893122.807388:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493369984 00000100:00100000:2.0:1787893122.807527:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787893122.807546:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6507:x1874741493369984:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787893122.807618:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6507:x1874741493369984:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 74us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893122.807625:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787893122.807702:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7f6d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6507:1874741493369984:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787893122.807828:0:6507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:0.0:1787893122.807863:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7f6d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6507:1874741493370112:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787893122.807901:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893122.811423:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57780 going to sleep for 11 seconds 00000100:00100000:1.0:1787893122.815517:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493370112 00000100:00100000:1.0:1787893122.815536:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493370112 00000100:00100000:1.0:1787893122.815616:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787893122.815626:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6507:x1874741493370112:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787893122.815844:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6507:x1874741493370112:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 219us (7942us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787893122.815852:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787893122.815972:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7f6d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6507:1874741493370112:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787893122.816037:0:6507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:3.0:1787893122.816089:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf1020 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.816099:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf1020 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.816107:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf1020 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.816112:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7e600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893122.816117:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf1020 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.816125:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf1020 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.816140:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc9d0fd6300) 00010000:00010000:3.0:1787893122.816155:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787893122.816160:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf1020 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.816166:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf1020 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787893122.816263:0:6507:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787893122.816325:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1787893122.816336:0:6507:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 366637843762ns, next at 367637841538ns, rc = 0 00000001:00080000:3.0:1787893122.816342:0:6507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:3.0:1787893122.816366:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc9d0fd6300) 00010000:00010000:3.0:1787893122.816369:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787893122.816376:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf100b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa779 expref: 30 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893122.816474:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+29:11149:x1874741481740416:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 22300us (22549us total) trans 4294967327 rc 0/0 00000100:00100000:3.0:1787893122.816482:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 8 00000020:00080000:3.0:1787893122.816486:0:6507:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787893122.823110:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893122.823219:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481740672 00000100:00100000:2.0:1787893122.823230:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481740672 00000100:00100000:2.0:1787893122.823296:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 54 00000100:00100000:2.0:1787893122.823306:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+29:11149:x1874741481740672:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:2.0:1787893122.823332:0:10086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893122.823355:0:10086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f200/0x9232577658cf1027 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa780 expref: -99 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.823429:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f200/0x9232577658cf1027 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa780 expref: 30 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.823444:0:10086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f200/0x9232577658cf1027 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa780 expref: 30 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893122.823463:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c660e800) 00010000:00010000:2.0:1787893122.823466:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787893122.823471:0:10086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7f200, rc 0) 00000100:00100000:2.0:1787893122.823577:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+30:11149:x1874741481740672:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 272us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893122.823583:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 54 00000100:00100000:1.0:1787893122.826919:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893122.827250:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481740928 00000100:00100000:0.0:1787893122.827260:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481740928 00000100:00100000:0.0:1787893122.827319:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 9 00000100:00100000:0.0:1787893122.827329:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fec850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+30:11149:x1874741481740928:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:0.0:1787893122.827610:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fec850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+31:11149:x1874741481740928:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 280us (701us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1787893122.827619:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 9 00000100:00100000:3.0:1787893122.963664:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893122.965343:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481741184 00000100:00100000:1.0:1787893122.965357:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481741184 00000100:00100000:1.0:1787893122.965439:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 55 00000100:00100000:1.0:1787893122.965451:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+31:11159:x1874741481741184:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:1.0:1787893122.965478:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893122.965546:0:13436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf102e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa787 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893122.965656:0:13436:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1787893122.965782:0:13436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf102e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa787 expref: 33 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893122.965797:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9d0fd6b00) 00010000:00010000:1.0:1787893122.965800:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787893122.965805:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf102e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa787 expref: 33 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893122.966184:0:13436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe541a00, rc 0) 00000100:00100000:1.0:1787893122.966256:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+32:11159:x1874741481741184:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 807us (2613us total) trans 4294967329 rc 301/301 00000100:00100000:1.0:1787893122.966264:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 55 00000100:00100000:2.0:1787893122.972297:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893122.972433:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481741312 00000100:00100000:3.0:1787893122.972443:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481741312 00000100:00100000:3.0:1787893122.972538:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 56 00000100:00100000:3.0:1787893122.972550:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ed561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+32:11159:x1874741481741312:12345-192.168.202.35@tcp:34:lfs.0 00010000:00010000:3.0:1787893122.972620:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031200/0x9232577658cf103c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.972637:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031200/0x9232577658cf103c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.972693:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031200/0x9232577658cf103c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.972706:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1043 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.972714:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1043 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.972721:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1043 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.972786:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf104a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.972795:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf104a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.972801:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf104a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787893122.972844:0:6505:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf104a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.972856:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031200/0x9232577658cf103c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.972863:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031200/0x9232577658cf103c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.972870:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031200/0x9232577658cf103c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.972886:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c0031200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893122.972891:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031200/0x9232577658cf103c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.972899:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031200/0x9232577658cf103c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.972912:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc9d0fd6700) 00010000:00010000:3.0:1787893122.972915:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893122.972920:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031200/0x9232577658cf103c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.972927:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031200/0x9232577658cf103c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.972940:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1043 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.972947:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1043 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.972953:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1043 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.972959:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c0031000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893122.972962:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1043 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.972968:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1043 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.972984:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc9d0fd6f00) 00010000:00010000:3.0:1787893122.972987:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893122.972989:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1043 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.972996:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1043 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.973005:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf104a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.973012:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf104a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.973364:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf104a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.973371:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c0030800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893122.973375:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf104a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.973382:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf104a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.973392:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c660e800) 00010000:00010000:3.0:1787893122.973394:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893122.973398:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf104a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893122.973404:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf104a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893122.973528:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ed561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+32:11159:x1874741481741312:12345-192.168.202.35@tcp:34:lfs.0 Request processed in 942us (1203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893122.973537:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 56 00000100:00100000:2.0:1787893122.981464:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893122.981883:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481741568 00000100:00100000:0.0:1787893122.981894:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481741568 00000100:00100000:0.0:1787893122.981960:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 10 00000100:00100000:0.0:1787893122.981971:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ed563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+32:11159:x1874741481741568:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:0.0:1787893122.982792:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ed563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+33:11159:x1874741481741568:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 817us (1333us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1787893122.982802:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 10 00000100:00100000:2.0:1787893123.037443:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893123.037849:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481741824 00000100:00100000:1.0:1787893123.037859:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481741824 00000100:00100000:1.0:1787893123.037965:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 57 00000100:00100000:1.0:1787893123.037976:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+33:11162:x1874741481741824:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:1.0:1787893123.037999:0:10086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893123.038026:0:10086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf1051 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa78e expref: -99 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.038108:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf1058 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.038122:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf1058 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.038133:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf1058 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.038153:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf105f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.038161:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf105f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.038167:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf105f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.038386:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf1066 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.038395:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf1066 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.038402:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf1066 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893123.038410:0:10086:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787893123.038476:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf1058 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.038484:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf1058 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.038528:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf1058 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.038534:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe541600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893123.038871:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf1058 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.038891:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf1058 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.038904:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc9d0fd6700) 00010000:00010000:1.0:1787893123.038906:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893123.038911:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf1058 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.038918:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf1058 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.038931:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf105f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.038937:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf105f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.038944:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf105f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.038949:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe541200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893123.038951:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf105f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.038957:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf105f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.038963:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc9d0fd6f00) 00010000:00010000:1.0:1787893123.038966:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893123.038968:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf105f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.038981:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf105f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.039016:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf1051 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa78e expref: 36 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.039027:0:10086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf1066 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa78e expref: 35 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.039034:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c660e800) 00010000:00010000:1.0:1787893123.039036:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787893123.039039:0:10086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe540a00, rc 0) 00000100:00100000:1.0:1787893123.039102:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+35:11162:x1874741481741824:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 1129us (1668us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1787893123.039109:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 57 00000100:00080000:3.0:1787893123.043858:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787893123.044248:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893123.044487:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481741952 00000100:00100000:3.0:1787893123.044633:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481741952 00000100:00100000:3.0:1787893123.044788:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 58 00000100:00100000:3.0:1787893123.044799:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7f6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+35:11162:x1874741481741952:12345-192.168.202.35@tcp:54:lfs.0 00010000:00010000:3.0:1787893123.044861:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1074 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893123.044878:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1074 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893123.044888:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1074 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893123.044922:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1074 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893123.044929:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1074 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893123.044935:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1074 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893123.044941:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c0030800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893123.044945:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1074 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893123.044969:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1074 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893123.044981:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c660e800) 00010000:00010000:3.0:1787893123.044984:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787893123.044988:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1074 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893123.044994:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1074 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893123.045082:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7f6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+35:11162:x1874741481741952:12345-192.168.202.35@tcp:54:lfs.0 Request processed in 277us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893123.045089:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 58 00000100:00100000:2.0:1787893123.048891:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893123.048975:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481742208 00000100:00100000:3.0:1787893123.048984:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481742208 00000100:00100000:3.0:1787893123.049124:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 11 00000100:00100000:3.0:1787893123.049136:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+35:11162:x1874741481742208:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:2.0:1787893123.049881:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+36:11162:x1874741481742208:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 745us (996us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1787893123.049892:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 11 00000100:00100000:2.0:1787893123.419872:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893123.420010:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481742464 00000100:00100000:3.0:1787893123.420018:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481742464 00000100:00100000:3.0:1787893123.420091:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 59 00000100:00100000:3.0:1787893123.420101:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+36:11193:x1874741481742464:12345-192.168.202.35@tcp:101:cat.0 00010000:00010000:3.0:1787893123.420124:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893123.420144:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf107b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa795 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893123.420233:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1082 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893123.420254:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1082 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893123.420263:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1082 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893123.420272:0:6505:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787893123.420368:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf107b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa795 expref: 39 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893123.420383:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1082 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa795 expref: 38 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893123.420389:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c660e800) 00010000:00010000:3.0:1787893123.420391:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787893123.420394:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9c0031000, rc 0) 00000100:00100000:3.0:1787893123.420448:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+38:11193:x1874741481742464:12345-192.168.202.35@tcp:101:cat.0 Request processed in 344us (579us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1787893123.420453:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 59 00000100:00100000:0.0:1787893123.427900:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893123.428794:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481742720 00000100:00100000:1.0:1787893123.428806:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481742720 00000100:00100000:2.0:1787893123.428855:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893123.428875:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 12 00000100:00100000:1.0:1787893123.428887:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+38:11193:x1874741481742720:12345-192.168.202.35@tcp:35:cat.0 00000100:00100000:1.0:1787893123.429366:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+39:11193:x1874741481742720:12345-192.168.202.35@tcp:35:cat.0 Request processed in 479us (1474us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1787893123.429375:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 12 00000100:00100000:3.0:1787893123.429614:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481742848 00000100:00100000:3.0:1787893123.429620:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481742848 00000100:00100000:3.0:1787893123.429671:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 4 00000100:00100000:3.0:1787893123.429680:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+39:2392:x1874741481742848:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893123.429692:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893123.429713:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1082 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa795 expref: 39 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893123.429751:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c660e800) 00010000:00010000:3.0:1787893123.429756:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893123.429780:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+38:2392:x1874741481742848:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 102us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893123.429788:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 4 00000100:00100000:0.0:1787893123.501328:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893123.501864:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481743104 00000100:00100000:3.0:1787893123.501876:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481743104 00000100:00100000:3.0:1787893123.501946:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 60 00000100:00100000:3.0:1787893123.501957:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+38:11199:x1874741481743104:12345-192.168.202.35@tcp:101:dd.0 00010000:00010000:3.0:1787893123.501982:0:9515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893123.501986:0:9515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787893123.502013:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf0fe8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa76b expref: 38 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893123.502045:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc9d0fd6700) 00010000:00010000:3.0:1787893123.502050:0:9515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787893123.502063:0:9515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1090 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa79c expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893123.502172:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1097 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893123.502187:0:9515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf1066 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa78e expref: 38 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893123.502196:0:9515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1097 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893123.502245:0:9515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf1066 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa78e expref: 38 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893123.502259:0:9515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf1066 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa78e expref: 38 pid: 10086 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893123.502273:0:9515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d15c8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9515:1874741493370240:192.168.202.35@tcp:104: 00000100:00100000:3.0:1787893123.502628:0:9515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d7ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787893123.511245:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893123.511336:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481743232 00000100:00100000:0.0:1787893123.511346:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481743232 00010000:00010000:0.0:1787893123.511387:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf1066 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa78e expref: 39 pid: 10086 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893123.511427:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 55 00000100:00100000:0.0:1787893123.511438:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58232959-285a-4954-a3ac-571a2b817017+39:2391:x1874741481743232:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893123.511472:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893123.511480:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf1066 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa78e expref: 39 pid: 10086 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893123.511550:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf1066 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa78e expref: 39 pid: 10086 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893123.511574:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c660e800) 00010000:00010000:0.0:1787893123.511580:0:6491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1097 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893123.511589:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1097 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893123.511597:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1097 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893123.511629:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893123.511676:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58232959-285a-4954-a3ac-571a2b817017+39:2391:x1874741481743232:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 240us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893123.511695:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 55 00010000:00010000:3.0:1787893123.512330:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf1066 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa78e expref: 38 pid: 10086 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893123.512348:0:9515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d15c8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9515:1874741493370240:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787893123.512372:0:9515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1097 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893123.512381:0:9515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1097 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893123.512387:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1097 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893123.512406:0:9515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787893123.512622:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1090 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa79c expref: 39 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893123.512640:0:9515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1097 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa79c expref: 38 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893123.512661:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c660e800) 00010000:00010000:3.0:1787893123.512664:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787893123.512667:0:9515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9c0030800, rc 0) 00000100:00100000:3.0:1787893123.512711:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+38:11199:x1874741481743104:12345-192.168.202.35@tcp:101:dd.0 Request processed in 10756us (11395us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1787893123.512719:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 60 00000100:00100000:3.0:1787893123.516328:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893123.516736:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481743360 00000100:00100000:1.0:1787893123.516748:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481743360 00000100:00100000:1.0:1787893123.516808:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 61 00000100:00100000:1.0:1787893123.516819:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+38:11199:x1874741481743360:12345-192.168.202.35@tcp:101:dd.0 00010000:00010000:1.0:1787893123.516869:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893123.516891:0:13436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf10a5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa7a3 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.516927:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf10ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.516943:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf10ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.516956:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf10ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.517093:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf10a5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7a3 expref: 40 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.517112:0:13436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf10ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7a3 expref: 39 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.517121:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c660e800) 00010000:00010000:1.0:1787893123.517124:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787893123.517128:0:13436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe541200, rc 0) 00000100:00100000:1.0:1787893123.517196:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+39:11199:x1874741481743360:12345-192.168.202.35@tcp:101:dd.0 Request processed in 378us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893123.517203:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 61 00000100:00100000:2.0:1787893123.520206:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893123.521440:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481743616 00000100:00100000:1.0:1787893123.521453:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481743616 00000100:00100000:1.0:1787893123.532760:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 62 00000100:00100000:1.0:1787893123.532786:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+39:11199:x1874741481743616:12345-192.168.202.35@tcp:36:dd.0 00010000:00010000:1.0:1787893123.533038:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf10b3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.533056:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf10b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.533066:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf10b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787893123.533126:0:6504:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:1.0:1787893123.533147:0:6504:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000062e9bb4e reply state 00000000fb56afc3 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf10b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.533160:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf10b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.533167:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c660e800) 00010000:00010000:1.0:1787893123.533170:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787893123.533175:0:6504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787893123.533277:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+42:11199:x1874741481743616:12345-192.168.202.35@tcp:36:dd.0 Request processed in 503us (13079us total) trans 4294967337 rc 0/0 00000100:00100000:1.0:1787893123.533285:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 62 00000020:00080000:1.0:1787893123.533290:0:6504:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787893123.762377:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787893123.762400:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d15caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493370368:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787893123.762468:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893123.762678:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493370368 00000100:00100000:3.0:1787893123.762687:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493370368 00000100:00100000:3.0:1787893123.762742:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787893123.762752:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d0f53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493370368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787893123.762785:0:7865:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787893123.762841:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d0f53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493370368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893123.762847:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787893123.766010:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d15caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493370368:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787893123.768264:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893123.914986:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893123.915421:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481743744 00000100:00100000:1.0:1787893123.915432:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481743744 00000100:00100000:1.0:1787893123.915588:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 63 00000100:00100000:1.0:1787893123.915614:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+42:11213:x1874741481743744:12345-192.168.202.35@tcp:101:stat.0 00010000:00010000:1.0:1787893123.915637:0:10086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893123.915658:0:10086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf10ba lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa7aa expref: -99 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.915724:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf10c1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.915739:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf10c1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.915750:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf10c1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.915762:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf10c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.915769:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf10c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.915776:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf10c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.915842:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf10cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.915854:0:10086:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1097 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa79c expref: 43 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.915863:0:10086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf10cf lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.915908:0:10086:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1097 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa79c expref: 43 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893123.915921:0:10086:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1097 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa79c expref: 43 pid: 9515 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893123.915934:0:10086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d1590000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10086:1874741493370496:192.168.202.35@tcp:104: 00000100:00100000:1.0:1787893123.916226:0:10086:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c6696840 going to sleep for 11 seconds 00000100:00100000:2.0:1787893123.923121:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893123.923236:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481744000 00000100:00100000:0.0:1787893123.923246:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481744000 00000100:00100000:0.0:1787893123.923348:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 13 00000100:00100000:0.0:1787893123.923359:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+44:6163:x1874741481744000:12345-192.168.202.35@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787893123.923821:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+45:6163:x1874741481744000:12345-192.168.202.35@tcp:35:ldlm_bl.0 Request processed in 462us (709us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1787893123.923842:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 13 00000100:00100000:1.0:1787893123.923926:0:10086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d1590000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10086:1874741493370496:192.168.202.35@tcp:104: 00010000:00010000:1.0:1787893123.923955:0:10086:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf10cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893123.929747:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893123.929848:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481744128 00000100:00100000:3.0:1787893123.929859:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481744128 00010000:00010000:3.0:1787893123.929905:0:6490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1097 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa79c expref: 45 pid: 9515 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893123.929952:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 56 00000100:00100000:3.0:1787893123.929962:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+45:2391:x1874741481744128:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893123.929976:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893123.929983:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1097 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa79c expref: 45 pid: 9515 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893123.930015:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1097 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa79c expref: 45 pid: 9515 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893123.930050:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1097 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa79c expref: 45 pid: 9515 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893123.930079:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c660e800) 00010000:00010000:3.0:1787893123.930084:0:6490:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf10cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893123.930093:0:6490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf10cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893123.930101:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf10cf lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893123.930298:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893123.930376:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+44:2391:x1874741481744128:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 415us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893123.930384:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 56 00010000:00010000:2.0:1787893123.933278:0:10086:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf10cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893123.933314:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf10cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893123.933375:0:10086:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787893123.933379:0:10086:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787893123.933424:0:10086:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf10cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893123.933440:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf10cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893123.933450:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf10c1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893123.933627:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf10c1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893123.933636:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf10c1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893123.933642:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893123.933647:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf10c1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893123.933655:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf10c1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893123.933671:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc9d0fd6700) 00010000:00010000:2.0:1787893123.933674:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893123.933679:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf10c1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893123.933695:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf10c1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893123.933713:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf10c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893123.933719:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf10c8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893123.933725:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf10c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893123.933730:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893123.933734:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf10c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893123.933739:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf10c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893123.933747:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc9d0fd6f00) 00010000:00010000:2.0:1787893123.933750:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893123.933753:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf10c8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893123.933759:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf10c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893123.933796:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf10ba lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7aa expref: 44 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893123.933823:0:10086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf10cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7aa expref: 43 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893123.933830:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c660e800) 00010000:00010000:2.0:1787893123.933832:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787893123.933835:0:10086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe541c00, rc 0) 00000100:00100000:2.0:1787893123.933955:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+43:11213:x1874741481743744:12345-192.168.202.35@tcp:101:stat.0 Request processed in 18342us (18976us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893123.933963:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 63 00000100:00100000:2.0:1787893124.108036:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893124.108167:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481744384 00000100:00100000:1.0:1787893124.108187:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481744384 00000100:00100000:1.0:1787893124.108248:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 64 00000100:00100000:1.0:1787893124.108259:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+43:11219:x1874741481744384:12345-192.168.202.35@tcp:36:truncate.0 00010000:00010000:1.0:1787893124.108314:0:13436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893124.108342:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf10cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7aa expref: 43 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.108364:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c660e800) 00010000:00010000:1.0:1787893124.108369:0:13436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787893124.108603:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf10d6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.108617:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf10d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.108640:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf10d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787893124.108683:0:13436:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:1.0:1787893124.108718:0:13436:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007948e510 reply state 00000000980ac00f transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf10d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.108731:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf10d6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.108737:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c660e800) 00010000:00010000:1.0:1787893124.108739:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787893124.108742:0:13436:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787893124.108854:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+45:11219:x1874741481744384:12345-192.168.202.35@tcp:36:truncate.0 Request processed in 597us (835us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1787893124.108862:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 64 00000020:00080000:1.0:1787893124.108867:0:13436:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787893124.356900:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893124.357107:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481744512 00000100:00100000:1.0:1787893124.357118:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481744512 00000100:00100000:1.0:1787893124.357170:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 65 00000100:00100000:1.0:1787893124.357186:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+45:11233:x1874741481744512:12345-192.168.202.35@tcp:101:stat.0 00010000:00010000:1.0:1787893124.357210:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893124.357229:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf10dd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa7b1 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.357787:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf10e4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.357804:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf10e4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.357832:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf10e4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.357845:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf10eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.357853:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf10eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.357859:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf10eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.357930:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf10f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.357940:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf10f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.357946:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf10f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893124.357986:0:6504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1787893124.357991:0:6504:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787893124.358084:0:6504:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf10f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.358097:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf10f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.358104:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf10e4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.358119:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf10e4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.358126:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf10e4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.358131:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893124.358136:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf10e4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.358144:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf10e4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.358156:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc9d0fd6700) 00010000:00010000:1.0:1787893124.358159:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893124.358163:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf10e4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.358169:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf10e4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.358193:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf10eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.358199:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf10eb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.358204:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf10eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.358208:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893124.358216:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf10eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.358222:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf10eb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.358229:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc9d0fd6f00) 00010000:00010000:1.0:1787893124.358232:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893124.358234:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf10eb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.358239:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf10eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.358268:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf10dd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7b1 expref: 47 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.358280:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf10f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7b1 expref: 46 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.358287:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c660e800) 00010000:00010000:1.0:1787893124.358289:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787893124.358291:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe540a00, rc 0) 00000100:00100000:1.0:1787893124.358423:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+46:11233:x1874741481744512:12345-192.168.202.35@tcp:101:stat.0 Request processed in 1244us (1531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893124.358431:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 65 00000100:00100000:2.0:1787893124.484167:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893124.484256:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481744768 00000100:00100000:3.0:1787893124.484266:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481744768 00000100:00100000:3.0:1787893124.484326:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 66 00000100:00100000:3.0:1787893124.484336:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+46:11243:x1874741481744768:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:3.0:1787893124.484356:0:9515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893124.484375:0:9515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf10f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa7b8 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893124.484485:0:9515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1787893124.484627:0:9515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf10f9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7b8 expref: 48 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893124.484792:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9d0fd6b00) 00010000:00010000:3.0:1787893124.484796:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787893124.484802:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf10f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7b8 expref: 48 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893124.484818:0:9515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9c0030800, rc 0) 00000100:00100000:3.0:1787893124.484883:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+47:11243:x1874741481744768:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 548us (725us total) trans 4294967341 rc 301/301 00000100:00100000:3.0:1787893124.484890:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 66 00000100:00100000:2.0:1787893124.490410:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893124.490525:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481745024 00000100:00100000:3.0:1787893124.490534:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481745024 00000100:00100000:3.0:1787893124.490583:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 14 00000100:00100000:3.0:1787893124.490593:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+47:11243:x1874741481745024:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:3.0:1787893124.490819:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+48:11243:x1874741481745024:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 226us (418us total) trans 4294967342 rc 0/0 00000100:00100000:3.0:1787893124.490826:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 14 00000100:00100000:0.0:1787893124.579594:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893124.579740:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481745280 00000100:00100000:0.0:1787893124.579750:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481745280 00000100:00100000:0.0:1787893124.579810:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 67 00000100:00100000:0.0:1787893124.579818:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c772f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+48:11249:x1874741481745280:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:0.0:1787893124.579837:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893124.579854:0:13436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf1107 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa7bf expref: -99 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893124.580397:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf110e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893124.580413:0:13436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf10f2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7b1 expref: 49 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893124.580423:0:13436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf110e lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893124.580453:0:13436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf10f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7b1 expref: 49 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893124.580463:0:13436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf10f2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7b1 expref: 49 pid: 6504 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893124.580482:0:13436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c772d880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13436:1874741493370624:192.168.202.35@tcp:104: 00000100:00100000:0.0:1787893124.580636:0:13436:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57780 going to sleep for 11 seconds 00000100:00100000:0.0:1787893124.582820:0:13436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c772d880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13436:1874741493370624:192.168.202.35@tcp:104: 00010000:00010000:0.0:1787893124.582848:0:13436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf110e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893124.583070:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893124.583143:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481745408 00000100:00100000:0.0:1787893124.583150:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481745408 00010000:00010000:0.0:1787893124.583186:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf10f2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7b1 expref: 50 pid: 6504 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893124.583255:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 57 00000100:00100000:0.0:1787893124.583265:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3eff450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58232959-285a-4954-a3ac-571a2b817017+50:2390:x1874741481745408:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893124.583279:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893124.583286:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf10f2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7b1 expref: 50 pid: 6504 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893124.583299:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf10f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7b1 expref: 50 pid: 6504 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893124.583322:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf10f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7b1 expref: 50 pid: 6504 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893124.583340:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c660e800) 00010000:00010000:0.0:1787893124.583345:0:6491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf110e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893124.583353:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf110e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893124.583360:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf110e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893124.583406:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893124.583459:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3eff450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58232959-285a-4954-a3ac-571a2b817017+49:2390:x1874741481745408:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 195us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893124.583467:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 57 00010000:00010000:3.0:1787893124.583594:0:13436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf110e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893124.583602:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf110e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893124.583630:0:13436:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1787893124.583763:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf1107 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7bf expref: 50 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893124.583778:0:13436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf110e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7bf expref: 49 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893124.583784:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c660e800) 00010000:00010000:3.0:1787893124.583787:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787893124.583789:0:13436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb31e00, rc 0) 00000100:00100000:3.0:1787893124.583814:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c772f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+49:11249:x1874741481745280:12345-192.168.202.35@tcp:101:bash.0 Request processed in 3996us (4325us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1787893124.583821:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 67 00000100:00100000:2.0:1787893124.586466:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893124.586742:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481745664 00000100:00100000:3.0:1787893124.586753:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481745664 00000100:00100000:3.0:1787893124.586868:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 68 00000100:00100000:3.0:1787893124.586878:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+49:11249:x1874741481745664:12345-192.168.202.35@tcp:36:bash.0 00010000:00010000:3.0:1787893124.587101:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf111c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893124.587114:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf111c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893124.587122:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf111c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787893124.587155:0:6505:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:3.0:1787893124.587185:0:6505:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000020f9e8ec reply state 00000000476f7d6c transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf111c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893124.587197:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf111c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893124.587203:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c660e800) 00010000:00010000:3.0:1787893124.587206:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787893124.587210:0:6505:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787893124.587288:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+52:11249:x1874741481745664:12345-192.168.202.35@tcp:36:bash.0 Request processed in 412us (830us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1787893124.587293:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 68 00000020:00080000:3.0:1787893124.587297:0:6505:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787893124.596412:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893124.596834:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481745792 00000100:00100000:3.0:1787893124.596843:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481745792 00000100:00100000:1.0:1787893124.597130:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 69 00000100:00100000:1.0:1787893124.597139:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+52:11249:x1874741481745792:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:1.0:1787893124.597174:0:9515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893124.597194:0:9515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf1123 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa7c6 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.597288:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf112a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.597301:0:9515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf110e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7bf expref: 53 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.597308:0:9515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf112a lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.597333:0:9515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf110e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7bf expref: 53 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.597342:0:9515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf110e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7bf expref: 53 pid: 13436 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893124.597353:0:9515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d1590000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9515:1874741493370752:192.168.202.35@tcp:104: 00000100:00100000:1.0:1787893124.597421:0:9515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c6696d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787893124.600208:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893124.600232:0:9515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d1590000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9515:1874741493370752:192.168.202.35@tcp:104: 00010000:00010000:1.0:1787893124.600257:0:9515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf112a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893124.600331:0:10383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481745920 00000100:00100000:0.0:1787893124.600339:0:10383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481745920 00010000:00010000:0.0:1787893124.600375:0:10383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf110e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7bf expref: 54 pid: 13436 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893124.600413:0:10383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 58 00000100:00100000:0.0:1787893124.600422:0:10383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58232959-285a-4954-a3ac-571a2b817017+54:2391:x1874741481745920:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893124.600438:0:10383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893124.600444:0:10383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf110e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7bf expref: 54 pid: 13436 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893124.600455:0:10383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf110e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7bf expref: 54 pid: 13436 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893124.600486:0:10383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf110e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7bf expref: 54 pid: 13436 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893124.600518:0:10383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c660e800) 00010000:00010000:0.0:1787893124.600523:0:10383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf112a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893124.600533:0:10383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf112a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893124.600557:0:10383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf112a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893124.600575:0:10383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893124.600621:0:10383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58232959-285a-4954-a3ac-571a2b817017+53:2391:x1874741481745920:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 199us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893124.600629:0:10383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 58 00010000:00010000:1.0:1787893124.600737:0:9515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf112a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.600745:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf112a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893124.600800:0:9515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787893124.600804:0:9515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787893124.600825:0:9515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf112a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.600855:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf1123 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7c6 expref: 53 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.600870:0:9515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf112a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7c6 expref: 52 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.600877:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c660e800) 00010000:00010000:1.0:1787893124.600880:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787893124.600883:0:9515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe540c00, rc 0) 00000100:00100000:1.0:1787893124.601149:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+52:11249:x1874741481745792:12345-192.168.202.35@tcp:101:bash.0 Request processed in 3770us (4508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893124.601158:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 69 00000100:00100000:3.0:1787893124.604417:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893124.604633:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481746176 00000100:00100000:2.0:1787893124.604753:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481746176 00000100:00100000:2.0:1787893124.604839:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 15 00000100:00100000:2.0:1787893124.604851:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fef050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+52:11249:x1874741481746176:12345-192.168.202.35@tcp:35:bash.0 00000100:00100000:2.0:1787893124.605279:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fef050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+53:11249:x1874741481746176:12345-192.168.202.35@tcp:35:bash.0 Request processed in 429us (874us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1787893124.605287:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 15 00000100:00100000:2.0:1787893124.675789:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893124.675890:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481746432 00000100:00100000:3.0:1787893124.675900:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481746432 00000100:00100000:3.0:1787893124.675995:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 70 00000100:00100000:3.0:1787893124.676018:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+53:11259:x1874741481746432:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:3.0:1787893124.676167:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893124.676198:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1131 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa7cd expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893124.676316:0:6506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1787893124.676414:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1131 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7cd expref: 55 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893124.676429:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9d0fd6b00) 00010000:00010000:3.0:1787893124.676432:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787893124.676443:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1131 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7cd expref: 55 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893124.676458:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9c0031000, rc 0) 00000100:00100000:3.0:1787893124.676615:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+54:11259:x1874741481746432:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 612us (837us total) trans 4294967347 rc 301/301 00000100:00100000:3.0:1787893124.676623:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 70 00000100:00100000:3.0:1787893124.679046:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893124.679374:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481746560 00000100:00100000:1.0:1787893124.679383:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481746560 00000100:00100000:1.0:1787893124.679468:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 71 00000100:00100000:1.0:1787893124.679480:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+54:11259:x1874741481746560:12345-192.168.202.35@tcp:34:lfs.0 00010000:00010000:1.0:1787893124.679576:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf113f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.679593:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf113f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.679602:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf113f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.679625:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1146 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.679632:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1146 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.679638:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1146 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.679704:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf114d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.679713:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf114d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.679720:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf114d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787893124.679762:0:6504:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf114d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.679775:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf113f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.679782:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf113f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.679788:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf113f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.679794:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe541c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893124.679797:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf113f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.679812:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf113f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.679824:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc9d0fd6700) 00010000:00010000:1.0:1787893124.679827:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893124.679831:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf113f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.679838:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf113f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.679850:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1146 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.679855:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1146 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.679860:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1146 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.679865:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893124.679867:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1146 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.679872:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1146 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.679878:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc9d0fd6f00) 00010000:00010000:1.0:1787893124.679880:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893124.679882:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1146 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.679896:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1146 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.679906:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf114d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.679912:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf114d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.679918:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf114d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.679922:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893124.679925:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf114d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.679931:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf114d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.679938:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c660e800) 00010000:00010000:1.0:1787893124.679941:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893124.679943:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf114d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.679948:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf114d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893124.680203:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+54:11259:x1874741481746560:12345-192.168.202.35@tcp:34:lfs.0 Request processed in 723us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893124.680211:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 71 00000100:00100000:2.0:1787893124.686723:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893124.686784:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481746816 00000100:00100000:1.0:1787893124.686793:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481746816 00000100:00100000:1.0:1787893124.686838:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 16 00000100:00100000:1.0:1787893124.686846:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+54:11259:x1874741481746816:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:1.0:1787893124.687048:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+55:11259:x1874741481746816:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 201us (332us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1787893124.687065:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 16 00000100:00100000:2.0:1787893124.732629:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893124.733066:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481747072 00000100:00100000:1.0:1787893124.733077:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481747072 00000100:00100000:1.0:1787893124.733180:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 72 00000100:00100000:1.0:1787893124.733192:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+55:11262:x1874741481747072:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:1.0:1787893124.733217:0:10086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893124.733238:0:10086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf1154 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa7d4 expref: -99 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.733311:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf115b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.733326:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf115b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.733339:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf115b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.733349:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf1162 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.733356:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf1162 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.733374:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf1162 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.733478:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf1169 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.733487:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf1169 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.733519:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf1169 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893124.733530:0:10086:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787893124.733605:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf115b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.733613:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf115b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.733620:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf115b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.733625:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893124.733628:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf115b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.733633:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf115b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.733691:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc9d0fd6700) 00010000:00010000:1.0:1787893124.733694:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893124.733703:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf115b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.733707:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf115b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.733717:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf1162 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.733721:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf1162 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.733724:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf1162 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.733727:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe541c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893124.733729:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf1162 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.733732:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf1162 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.733736:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc9d0fd6f00) 00010000:00010000:1.0:1787893124.733738:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893124.733739:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf1162 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.733742:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf1162 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.733769:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf1154 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7d4 expref: 58 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.733788:0:10086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf1169 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7d4 expref: 57 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.733793:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c660e800) 00010000:00010000:1.0:1787893124.733795:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787893124.733796:0:10086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe540a00, rc 0) 00000100:00100000:1.0:1787893124.733881:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+57:11262:x1874741481747072:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 692us (1261us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1787893124.733885:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 72 00000100:00100000:0.0:1787893124.741100:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893124.741154:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893124.741381:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481747200 00000100:00100000:3.0:1787893124.741390:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481747200 00000100:00100000:3.0:1787893124.741453:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 73 00000100:00100000:3.0:1787893124.741463:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c772d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+57:11262:x1874741481747200:12345-192.168.202.35@tcp:54:lfs.0 00010000:00010000:3.0:1787893124.741557:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1177 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893124.741576:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1177 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893124.741587:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1177 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893124.741620:0:13436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1177 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893124.741627:0:13436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1177 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893124.741633:0:13436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1177 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893124.741762:0:13436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c0031000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893124.741781:0:13436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1177 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893124.741790:0:13436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1177 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893124.741803:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c660e800) 00010000:00010000:3.0:1787893124.741807:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787893124.741811:0:13436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1177 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893124.741818:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1177 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893124.741974:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481747328 00000100:00100000:2.0:1787893124.741979:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481747328 00000100:00100000:2.0:1787893124.742017:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 5 00000100:00100000:2.0:1787893124.742030:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58232959-285a-4954-a3ac-571a2b817017+58:2392:x1874741481747328:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787893124.742040:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893124.742055:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf1169 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7d4 expref: 58 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893124.742077:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c660e800) 00010000:00010000:2.0:1787893124.742080:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893124.742120:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c772d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+57:11262:x1874741481747200:12345-192.168.202.35@tcp:54:lfs.0 Request processed in 658us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893124.742128:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 73 00000100:00100000:2.0:1787893124.742363:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58232959-285a-4954-a3ac-571a2b817017+56:2392:x1874741481747328:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 333us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893124.742370:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 5 00000100:00100000:2.0:1787893124.746978:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893124.747265:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481747584 00000100:00100000:1.0:1787893124.747275:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481747584 00000100:00100000:1.0:1787893124.747374:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 17 00000100:00100000:1.0:1787893124.747386:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+56:11262:x1874741481747584:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:0.0:1787893124.748282:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+57:11262:x1874741481747584:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 894us (1308us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1787893124.748292:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 17 00000100:00100000:0.0:1787893124.787923:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d15c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493370880:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787893124.788011:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893124.788227:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493370880 00000100:00100000:3.0:1787893124.788236:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493370880 00000100:00100000:3.0:1787893124.788286:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787893124.788296:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493370880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787893124.788328:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:3.0:1787893124.788374:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493370880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893124.788381:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787893124.788463:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d15c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493370880:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787893124.789274:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893124.957199:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893124.957579:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481747840 00000100:00100000:3.0:1787893124.957590:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481747840 00000100:00100000:3.0:1787893124.957645:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 74 00000100:00100000:3.0:1787893124.957656:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+57:11280:x1874741481747840:12345-192.168.202.35@tcp:101:cat.0 00010000:00010000:3.0:1787893124.957694:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893124.957713:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031200/0x9232577658cf117e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa7db expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893124.957814:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1185 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893124.957843:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1185 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893124.957854:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1185 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893124.957865:0:6505:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787893124.957976:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031200/0x9232577658cf117e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7db expref: 60 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893124.957995:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1185 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7db expref: 59 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893124.958006:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c660e800) 00010000:00010000:3.0:1787893124.958009:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787893124.958012:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9c0031000, rc 0) 00000100:00100000:3.0:1787893124.958083:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+59:11280:x1874741481747840:12345-192.168.202.35@tcp:101:cat.0 Request processed in 429us (895us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1787893124.958090:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 74 00000001:00080000:1.0:1787893124.962297:0:6484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000004:00080000:1.0:1787893124.962363:0:6484:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1787893124.962388:0:6484:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fc8c7d57d80 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1787893124.962394:0:6484:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fc9fe233300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fc8c7d57e40 00000020:00080000:1.0:1787893124.962397:0:6484:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fc9c8586a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fc9c2858e00 00010000:00010000:2.0:1787893124.962577:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf0f63 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893124.962590:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf0f63 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893124.962599:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf0f63 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893124.962605:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c771ee00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893124.962610:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf0f63 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893124.962619:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf0f63 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893124.962656:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9fc9d0fd6600) 00010000:00010000:2.0:1787893124.962659:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893124.962664:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf0f63 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893124.962668:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d15cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493371008:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1787893124.962673:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf0f63 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893124.962696:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ec00/0x9232577658cf0f6a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893124.962703:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ec00/0x9232577658cf0f6a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893124.962709:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ec00/0x9232577658cf0f6a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893124.962715:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c771ec00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893124.962718:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ec00/0x9232577658cf0f6a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893124.962724:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ec00/0x9232577658cf0f6a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893124.962732:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc9d0fd6700) 00010000:00010000:2.0:1787893124.962734:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787893124.962740:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787893124.962740:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ec00/0x9232577658cf0f6a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893124.962747:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ec00/0x9232577658cf0f6a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893124.962775:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf0fa9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893124.962782:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf0fa9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893124.962787:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf0fa9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893124.962792:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c771f400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893124.962795:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf0fa9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893124.962801:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf0fa9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893124.962810:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc9d0fd6f00) 00010000:00010000:2.0:1787893124.962813:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893124.962816:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf0fa9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893124.962820:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf0fa9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893124.962834:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf10b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893124.962840:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf10b3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893124.962845:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf10b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893124.962856:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe541600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893124.962859:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf10b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893124.962865:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf10b3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893124.962873:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c660e800) 00010000:00010000:2.0:1787893124.962875:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893124.962878:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf10b3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893124.962884:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf10b3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893124.962895:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf10d6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893124.962901:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf10d6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893124.962906:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf10d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893124.962911:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe541a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893124.962914:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf10d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893124.962919:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf10d6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893124.962937:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c660e800) 00010000:00010000:2.0:1787893124.962939:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893124.962942:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf10d6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893124.962948:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf10d6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893124.962959:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf111c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893124.962965:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf111c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893124.962971:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf111c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893124.962975:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c0030800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893124.962978:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf111c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893124.962983:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf111c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893124.962989:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c660e800) 00010000:00010000:2.0:1787893124.962991:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893124.962993:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf111c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893124.962999:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf111c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893124.963151:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493371008 00000100:00100000:1.0:1787893124.963160:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493371008 00000100:00100000:1.0:1787893124.963281:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787893124.963290:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3632:x1874741493371008:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787893124.963316:0:8420:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:1.0:1787893124.963348:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a911582, atime: 0x6a911582, ctime: 0x6a911582, blocks: 0x8 00010000:00010000:1.0:1787893124.963355:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060f5eadb/0x9232577658cf1193 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.963369:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=368s v=(0 0) 00010000:00010000:1.0:1787893124.963373:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893124.963379:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060f5eadb/0x9232577658cf1193 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.963393:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060f5eadb/0x9232577658cf1193 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.963401:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060f5eadb/0x9232577658cf1193 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.963408:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060f5eadb/0x9232577658cf1193 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893124.963426:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787893124.963577:0:8435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787893124.963584:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060f5eadb/0x9232577658cf1193 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893124.963594:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540600 already unused, calling callback (ffffffffc0cb7230) 00000100:00100000:1.0:1787893124.963600:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3632:x1874741493371008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 308us (860us total) trans 4294967302 rc 0/0 00010000:00010000:3.0:1787893124.963601:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060f5eadb/0x9232577658cf1193 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893124.963615:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1787893124.963617:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060f5eadb/0x9232577658cf1193 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893124.963636:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060f5eadb/0x9232577658cf1193 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893124.963643:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060f5eadb/0x9232577658cf1193 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893124.963659:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893124.963662:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893124.963664:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787893124.963666:0:3632:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fc9d15cb480/2, rc 0, transno 4294967302 00000100:00100000:1.0:1787893124.963673:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d15cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493371008:0@lo:6:osp-syn-0-0.0 00000100:00080000:2.0:1787893124.963822:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:0.0:1787893124.964634:0:6536:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1787893124.964804:0:6536:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1787893124.993661:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893124.994202:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481747968 00000100:00100000:0.0:1787893124.994213:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481747968 00000100:00100000:0.0:1787893124.994277:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 75 00000100:00100000:0.0:1787893124.994288:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+13:11281:x1874741481747968:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787893124.994311:0:9515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893124.994331:0:9515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf119a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa7e2 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893124.994412:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf11a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893124.994425:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf11a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893124.994437:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf11a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893124.994481:0:9515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1787893124.994485:0:9515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787893124.994552:0:9515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf11a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893124.994581:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf119a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7e2 expref: 15 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893124.994599:0:9515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf11a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7e2 expref: 14 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893124.994608:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc9d0fd6700) 00010000:00010000:0.0:1787893124.994611:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787893124.994615:0:9515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb30600, rc 0) 00000100:00100000:0.0:1787893124.994694:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+14:11281:x1874741481747968:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 408us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893124.994701:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 75 00000100:00100000:2.0:1787893125.004089:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893125.004188:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481748352 00000100:00100000:3.0:1787893125.004199:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481748352 00000100:00100000:3.0:1787893125.004274:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 18 00000100:00100000:3.0:1787893125.004284:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+14:11281:x1874741481748352:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:3.0:1787893125.004613:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+15:11281:x1874741481748352:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 330us (534us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1787893125.005081:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 18 00000100:00080000:2.0:1787893125.005806:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787893125.007612:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893125.007845:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481748480 00000100:00100000:3.0:1787893125.007855:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481748480 00000100:00100000:3.0:1787893125.007919:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 6 00000100:00100000:3.0:1787893125.007929:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+15:11281:x1874741481748480:12345-192.168.202.35@tcp:103:lfs.0 00010000:00010000:3.0:1787893125.007943:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787893125.007968:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf112a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7c6 expref: 15 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.007991:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1185 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7db expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.008004:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f200/0x9232577658cf1027 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa780 expref: 13 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.008023:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c660e800) 00010000:00010000:3.0:1787893125.008029:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893125.008091:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+12:11281:x1874741481748480:12345-192.168.202.35@tcp:103:lfs.0 Request processed in 164us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893125.008099:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 6 00000100:00100000:1.0:1787893125.010806:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893125.010925:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481748608 00000100:00100000:0.0:1787893125.010934:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481748608 00000100:00100000:0.0:1787893125.011314:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 76 00000100:00100000:0.0:1787893125.011325:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d1590000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+12:11281:x1874741481748608:12345-192.168.202.35@tcp:58:lfs.0 00010000:00010000:0.0:1787893125.011434:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf11a8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.011451:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf11a8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.011462:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf11a8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787893125.011729:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787893125.011865:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1787893125.011952:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1787893125.012048:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d1590000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+12:11281:x1874741481748608:12345-192.168.202.35@tcp:58:lfs.0 Request processed in 723us (1407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893125.012064:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 76 00000100:00100000:2.0:1787893125.043995:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893125.045132:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481748736 00000100:00100000:1.0:1787893125.045145:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481748736 00000100:00100000:0.0:1787893125.045425:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 77 00000100:00100000:0.0:1787893125.045438:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+12:11283:x1874741481748736:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787893125.045458:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893125.045481:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf11af lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa7e9 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.047629:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf11b6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.047837:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf11b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.047851:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf11b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.047889:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf11bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.047896:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf11bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.047903:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf11bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.047991:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf11c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.048080:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf11c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.048090:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf11c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893125.048138:0:6504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787893125.048142:0:6504:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787893125.048162:0:6504:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf11c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.048243:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf11c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.048251:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf11b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.048257:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf11b6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.048274:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf11b6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.048280:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893125.048283:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf11b6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.048290:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf11b6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.048302:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc9d0fd6700) 00010000:00010000:0.0:1787893125.048305:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893125.048309:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf11b6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.048316:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf11b6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.048329:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf11bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.048337:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf11bd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.048343:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf11bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.048348:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893125.048351:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf11bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.048367:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf11bd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.048375:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc8c751ac00) 00010000:00010000:0.0:1787893125.048377:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893125.048379:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf11bd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.048384:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf11bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.048420:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf11af lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7e9 expref: 14 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.048434:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf11c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7e9 expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.048440:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c660e800) 00010000:00010000:0.0:1787893125.048443:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787893125.048445:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb30000, rc 0) 00000100:00100000:0.0:1787893125.048824:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+13:11283:x1874741481748736:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 3387us (4838us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893125.048833:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 77 00000100:00100000:3.0:1787893125.298033:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787893125.298068:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493371136:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787893125.298137:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893125.298439:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493371136 00000100:00100000:2.0:1787893125.298448:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493371136 00000100:00100000:2.0:1787893125.298573:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787893125.298583:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493371136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787893125.298610:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787893125.298658:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493371136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893125.298666:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787893125.298712:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493371136:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787893125.299455:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787893125.299468:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493371264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787893125.299532:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893125.299573:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493371264 00000100:00100000:0.0:1787893125.299578:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493371264 00000100:00100000:2.0:1787893125.299735:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493371520:0@lo:400:kworker.0 00000100:00100000:2.0:1787893125.299767:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893125.299785:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c77f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493372032:0@lo:400:kworker.0 00000100:00100000:2.0:1787893125.299806:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893125.299821:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c77f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1874741493372544:0@lo:400:kworker.0 00000100:00100000:2.0:1787893125.299840:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893125.299860:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787893125.299865:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493371648:0@lo:400:kworker.0 00000100:00100000:2.0:1787893125.299889:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893125.299904:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c77f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493372160:0@lo:400:kworker.0 00000100:00100000:2.0:1787893125.299952:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893125.299969:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c77f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493372672:0@lo:400:kworker.0 00000100:00100000:2.0:1787893125.299988:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893125.300027:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493371520 00000100:00100000:2.0:1787893125.300031:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493371520 00000100:00100000:2.0:1787893125.300071:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493372032 00000100:00100000:2.0:1787893125.300075:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493372032 00000100:00100000:1.0:1787893125.300125:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed563b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874741493371776:0@lo:400:kworker.0 00000100:00100000:1.0:1787893125.300154:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893125.300187:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c77f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493372288:0@lo:400:kworker.0 00000100:00100000:1.0:1787893125.300211:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893125.300230:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787893125.300236:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493371392:0@lo:400:kworker.0 00000100:00100000:1.0:1787893125.300259:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893125.300280:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7f6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493371904:0@lo:400:kworker.0 00000100:00100000:1.0:1787893125.300300:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893125.300316:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c77f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493372416:0@lo:400:kworker.0 00000100:00100000:1.0:1787893125.300335:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893125.300365:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493372544 00000100:00100000:1.0:1787893125.300369:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493372544 00000100:00080000:3.0:1787893125.300865:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787893125.300870:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787893125.300969:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493372160 00000100:00100000:3.0:1787893125.300982:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493372160 00000100:00100000:3.0:1787893125.301026:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493372672 00000100:00100000:3.0:1787893125.301030:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493372672 00000100:00100000:3.0:1787893125.301043:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493371776 00000100:00100000:3.0:1787893125.301045:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493371776 00000100:00100000:3.0:1787893125.301070:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1787893125.301078:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493371520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893125.301136:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493371520:12345-0@lo:400:kworker.0 Request processed in 59us (1369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893125.301143:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1787893125.301160:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1787893125.301827:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493372160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893125.301866:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493372160:12345-0@lo:400:kworker.0 Request processed in 700us (1913us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893125.301871:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1787893125.301884:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1787893125.301888:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493372672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893125.301906:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493372672:12345-0@lo:400:kworker.0 Request processed in 19us (1918us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893125.301919:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1787893125.301926:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1787893125.301930:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d1592680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874741493371776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893125.301949:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d1592680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874741493371776:12345-0@lo:400:kworker.0 Request processed in 19us (1796us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893125.301952:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1787893125.301981:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed563b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874741493371776:0@lo:400:kworker.0 00000100:00080000:3.0:1787893125.302074:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787893125.302098:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c77f5f80 x1874741493372160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893125.302109:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c77f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493372160:0@lo:400:kworker.0 00010000:00080000:3.0:1787893125.302120:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c77f4000 x1874741493372672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893125.302129:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c77f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493372672:0@lo:400:kworker.0 00000100:00100000:3.0:1787893125.302139:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493371520:0@lo:400:kworker.0 00000100:00100000:3.0:1787893125.302306:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493372288 00000100:00100000:3.0:1787893125.302310:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493372288 00000100:00100000:3.0:1787893125.302333:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493372416 00000100:00100000:3.0:1787893125.302334:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493372416 00000100:00100000:3.0:1787893125.302345:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787893125.302349:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d1592d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493372288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893125.302375:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d1592d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493372288:12345-0@lo:400:kworker.0 Request processed in 26us (2165us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893125.302379:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787893125.302386:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787893125.302389:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d1591f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3630:x1874741493372416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893125.302403:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d1591f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3630:x1874741493372416:12345-0@lo:400:kworker.0 Request processed in 14us (2069us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893125.302407:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:3.0:1787893125.302428:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787893125.302438:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c77f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493372416:0@lo:400:kworker.0 00000100:00100000:3.0:1787893125.302455:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c77f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493372288:0@lo:400:kworker.0 00000100:00100000:3.0:1787893125.302484:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493371648 00000100:00100000:3.0:1787893125.302486:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493371648 00000100:00100000:3.0:1787893125.302520:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493371904 00000100:00100000:3.0:1787893125.302522:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493371904 00000100:00100000:3.0:1787893125.302529:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787893125.302533:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493371648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893125.302558:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493371648:12345-0@lo:400:kworker.0 Request processed in 25us (2669us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893125.302561:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787893125.302568:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787893125.302571:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d1592300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493371904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893125.302602:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d1592300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493371904:12345-0@lo:400:kworker.0 Request processed in 30us (2301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893125.302606:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787893125.302618:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493371392 00000100:00100000:3.0:1787893125.302620:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493371392 00000100:00100000:3.0:1787893125.302635:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1787893125.302638:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+24:3630:x1874741493371392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893125.302655:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+24:3630:x1874741493371392:12345-0@lo:400:kworker.0 Request processed in 17us (2397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893125.302659:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1787893125.302682:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493371392:0@lo:400:kworker.0 00000100:00100000:3.0:1787893125.302689:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7f6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493371904:0@lo:400:kworker.0 00000100:00100000:3.0:1787893125.302703:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493371648:0@lo:400:kworker.0 00000100:00100000:0.0:1787893125.302853:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787893125.302861:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493371264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787893125.302877:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787893125.302906:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493371264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (3375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893125.302920:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787893125.302941:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493371264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787893125.303440:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1787893125.303448:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493372032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893125.303487:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493372032:12345-0@lo:400:kworker.0 Request processed in 41us (3681us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893125.303512:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1787893125.303543:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c77f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493372032:0@lo:400:kworker.0 00000100:00100000:1.0:1787893125.303782:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1787893125.303790:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1874741493372544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893125.303835:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1874741493372544:12345-0@lo:400:kworker.0 Request processed in 45us (3993us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893125.303841:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1787893125.303923:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c77f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1874741493372544:0@lo:400:kworker.0 00000040:00080000:2.0:1787893125.685828:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787893125.685837:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787893125.685874:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787893125.685881:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787893125.686016:0:13786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c77f6680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13786:1874741493372800:192.168.202.35@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787893125.686128:0:13786:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c3ed2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787893125.690066:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893125.690097:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481748864 00000100:00100000:3.0:1787893125.690107:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481748864 00000100:00100000:3.0:1787893125.690159:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 78 00000100:00100000:3.0:1787893125.690169:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+14:11294:x1874741481748864:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787893125.690208:0:6506:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787893125.690320:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+14:11294:x1874741481748864:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 Request processed in 151us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893125.690328:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 78 00000100:00100000:3.0:1787893125.690469:0:13786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c77f6680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13786:1874741493372800:192.168.202.35@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787893125.695784:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893125.695824:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481748992 00000100:00100000:3.0:1787893125.695834:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481748992 00000100:00100000:3.0:1787893125.695897:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 79 00000100:00100000:3.0:1787893125.695907:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+13:11294:x1874741481748992:12345-192.168.202.35@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787893125.695979:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031200/0x9232577658cf11cb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.695995:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031200/0x9232577658cf11cb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.696021:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031200/0x9232577658cf11cb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.696101:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf11d2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.696109:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf11d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.696128:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf11d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.696153:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030c00/0x9232577658cf11d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.696162:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030c00/0x9232577658cf11d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.696168:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030c00/0x9232577658cf11d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893125.696210:0:13436:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787893125.696215:0:13436:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787893125.696227:0:13436:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030c00/0x9232577658cf11d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.696237:0:13436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031200/0x9232577658cf11cb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.696243:0:13436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031200/0x9232577658cf11cb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.696250:0:13436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031200/0x9232577658cf11cb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.696255:0:13436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c0031200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893125.696259:0:13436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031200/0x9232577658cf11cb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.696266:0:13436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031200/0x9232577658cf11cb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.696291:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fc9d5c29800) 00010000:00010000:3.0:1787893125.696294:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893125.696299:0:13436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031200/0x9232577658cf11cb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.696305:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031200/0x9232577658cf11cb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.696330:0:13436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf11d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.696336:0:13436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf11d2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.696341:0:13436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf11d2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.696346:0:13436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c0031000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893125.696349:0:13436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf11d2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.696354:0:13436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf11d2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.696361:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9fc9d0fd6300) 00010000:00010000:3.0:1787893125.696363:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893125.696366:0:13436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf11d2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.696372:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf11d2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.696399:0:13436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030c00/0x9232577658cf11d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.696406:0:13436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030c00/0x9232577658cf11d9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.696412:0:13436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030c00/0x9232577658cf11d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.696417:0:13436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c0030c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893125.696420:0:13436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030c00/0x9232577658cf11d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.696426:0:13436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030c00/0x9232577658cf11d9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.696433:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c660e800) 00010000:00010000:3.0:1787893125.696436:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893125.696438:0:13436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030c00/0x9232577658cf11d9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.696444:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030c00/0x9232577658cf11d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893125.696541:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+13:11294:x1874741481748992:12345-192.168.202.35@tcp:34:lhsmtool_posix.0 Request processed in 634us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893125.696549:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 79 00000100:00100000:3.0:1787893125.700913:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893125.701804:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481749248 00000100:00100000:0.0:1787893125.701816:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481749248 00000100:00100000:0.0:1787893125.701870:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 80 00000100:00100000:0.0:1787893125.701879:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+13:11294:x1874741481749248:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787893125.701899:0:10086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893125.701919:0:10086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf11e0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa7f0 expref: -99 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.702015:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf11e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.702030:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf11e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.702040:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf11e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893125.702971:0:10086:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787893125.703075:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf11e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.703084:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf11e7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.703098:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf11e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.703104:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893125.703108:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf11e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.703115:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf11e7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.703128:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c660e800) 00010000:00010000:0.0:1787893125.703132:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787893125.703136:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf11e7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.703142:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf11e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.703228:0:10086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf11e0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7f0 expref: 15 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.703240:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fc9d5c29800) 00010000:00010000:0.0:1787893125.703242:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787893125.703246:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf11e0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7f0 expref: 15 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.703256:0:10086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb31600, rc 0) 00000100:00100000:0.0:1787893125.703329:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+14:11294:x1874741481749248:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 1451us (2426us total) trans 4294967353 rc 301/301 00000100:00100000:0.0:1787893125.703350:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 80 00000100:00100000:0.0:1787893125.709223:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893125.709306:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481749376 00000100:00100000:3.0:1787893125.709315:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481749376 00000100:00100000:3.0:1787893125.709389:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 81 00000100:00100000:3.0:1787893125.709399:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+14:11294:x1874741481749376:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787893125.709435:0:6506:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787893125.709577:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+14:11294:x1874741481749376:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 Request processed in 178us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893125.709586:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 81 00000100:00100000:2.0:1787893125.722001:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893125.726189:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481749632 00000100:00100000:3.0:1787893125.726205:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481749632 00000100:00100000:3.0:1787893125.726810:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 82 00000100:00100000:3.0:1787893125.726823:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+14:11294:x1874741481749632:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787893125.726843:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893125.726846:0:13436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787893125.726873:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf11a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7e2 expref: 14 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.726891:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc9d0fd6700) 00010000:00010000:3.0:1787893125.726896:0:13436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787893125.726909:0:13436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf11f5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa7f7 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787893125.727281:0:13436:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:3.0:1787893125.727412:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030c00/0x9232577658cf11fc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.727424:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030c00/0x9232577658cf11fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.727433:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030c00/0x9232577658cf11fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.727486:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf11f5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7f7 expref: 16 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.727544:0:13436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030c00/0x9232577658cf11fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7f7 expref: 15 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.727551:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fc9d0fd6300) 00010000:00010000:3.0:1787893125.727553:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787893125.727556:0:13436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9c0030c00, rc 0) 00000100:00100000:3.0:1787893125.727631:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+15:11294:x1874741481749632:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 811us (5640us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1787893125.727637:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 82 00000040:00080000:0.0:1787893125.739770:0:14199:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787893125.739779:0:14199:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787893125.739815:0:14199:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787893125.739823:0:14199:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787893125.742777:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893125.742883:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481749888 00000100:00100000:0.0:1787893125.742894:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481749888 00000100:00100000:0.0:1787893125.742949:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 83 00000100:00100000:0.0:1787893125.742959:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d1591500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+15:11294:x1874741481749888:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787893125.743008:0:10086:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893125.743033:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030c00/0x9232577658cf11fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7f7 expref: 15 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.743078:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fc9d0fd6300) 00010000:00010000:0.0:1787893125.743087:0:10086:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787893125.743107:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf120a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.743120:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf120a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.743129:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf120a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.743142:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1211 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x26df6bfc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.743147:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1211 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x26df6bfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.743161:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1211 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x26df6bfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.743201:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf120a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.743207:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf120a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.743213:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf120a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.743218:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893125.743222:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf120a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.743229:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf120a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.743236:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc9d0fd6700) 00010000:00010000:0.0:1787893125.743239:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893125.743243:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf120a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.743248:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf120a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.743256:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1211 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x26df6bfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.743261:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1211 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x26df6bfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.743272:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1211 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x26df6bfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.743277:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893125.743280:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1211 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x26df6bfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.743286:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1211 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x26df6bfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.743294:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x26df6bfc (ffff9fc8c751ac00) 00010000:00010000:0.0:1787893125.743296:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893125.743299:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1211 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x26df6bfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.743304:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1211 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x26df6bfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893125.743379:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d1591500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+14:11294:x1874741481749888:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 Request processed in 422us (611us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787893125.743386:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 83 00000100:00100000:0.0:1787893125.749621:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893125.752182:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481750016 00000100:00100000:3.0:1787893125.752196:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481750016 00000100:00100000:3.0:1787893125.752262:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 84 00000100:00100000:3.0:1787893125.752272:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+14:11294:x1874741481750016:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787893125.752293:0:9515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893125.752314:0:9515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1218 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa7fe expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.752350:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031200/0x9232577658cf121f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.752363:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031200/0x9232577658cf121f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.752373:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031200/0x9232577658cf121f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.752473:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1218 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7fe expref: 16 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.752522:0:9515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031200/0x9232577658cf121f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7fe expref: 15 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.752531:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fc9d0fd6900) 00010000:00010000:3.0:1787893125.752533:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787893125.752536:0:9515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9c0031200, rc 0) 00000100:00100000:3.0:1787893125.752593:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+15:11294:x1874741481750016:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 323us (2981us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893125.752890:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 84 00000100:00100000:2.0:1787893125.761344:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893125.761405:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481750272 00000100:00100000:0.0:1787893125.761414:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481750272 00000100:00100000:0.0:1787893125.761468:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 85 00000100:00100000:0.0:1787893125.761477:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+15:11294:x1874741481750272:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787893125.761585:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf1226 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.761861:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf1226 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.761873:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf1226 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787893125.762027:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:0.0:1787893125.762035:0:6505:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 369583543462ns, next at 370583541560ns, rc = 0 00000004:00010000:0.0:1787893125.762163:0:6505:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008bbb7335 reply state 000000002f6ea2a4 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf1226 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.762178:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf1226 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.762186:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fc9d0fd6900) 00010000:00010000:0.0:1787893125.762188:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787893125.762193:0:6505:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787893125.762291:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+17:11294:x1874741481750272:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 Request processed in 814us (954us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1787893125.762299:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 85 00000100:00100000:1.0:1787893125.773556:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893125.773614:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481750400 00000100:00100000:1.0:1787893125.773627:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481750400 00000100:00100000:1.0:1787893125.773690:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 86 00000100:00100000:1.0:1787893125.773701:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d1590380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+17:11294:x1874741481750400:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787893125.773726:0:10086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893125.773747:0:10086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf122d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa805 expref: -99 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893125.773819:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf122d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa805 expref: 18 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893125.773833:0:10086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf122d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa805 expref: 18 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893125.773853:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fc9d0fd6900) 00010000:00010000:1.0:1787893125.773856:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787893125.773860:0:10086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe540600, rc 0) 00000100:00100000:1.0:1787893125.773915:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d1590380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+18:11294:x1874741481750400:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 215us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893125.773922:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 86 00000100:00100000:3.0:1787893125.781396:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893125.782173:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481750528 00000100:00100000:1.0:1787893125.782183:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481750528 00000100:00100000:1.0:1787893125.782235:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 33 00000100:00100000:1.0:1787893125.782244:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2389:x1874741481750528:12345-192.168.202.35@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1787893125.782277:0:8421:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 58232959-285a-4954-a3ac-571a2b817017@192.168.202.35@tcp t0 exp 0000000000000000 cur 369 last 0 00000020:00000080:1.0:1787893125.782304:0:8421:0:(genops.c:1385:class_connect()) connect: client 58232959-285a-4954-a3ac-571a2b817017, cookie 0x9232577658cf1234 00002000:00100000:1.0:1787893125.782314:0:8421:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 58232959-285a-4954-a3ac-571a2b817017/ffff9fc9d0f71000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787893125.782325:0:8421:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787893125.782401:0:8421:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787893125.782430:0:8421:0:(import.c:65:import_set_state_nolock()) ffff9fc9d0f77800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787893125.782527:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58232959-285a-4954-a3ac-571a2b817017+6:2389:x1874741481750528:12345-192.168.202.35@tcp:8:lhsmtool_posix.0 Request processed in 282us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893125.782551:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 33 00000100:00100000:3.0:1787893125.784723:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893125.784756:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481750656 00000100:00100000:3.0:1787893125.784764:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481750656 00000100:00100000:3.0:1787893125.784813:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 34 00000100:00100000:3.0:1787893125.784822:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+6:0:x1874741481750656:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1787893125.784957:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787893125.813159:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787893125.814718:0:9497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:2.0:1787893125.814733:0:9497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 58232959-285a-4954-a3ac-571a2b817017 00000100:00100000:3.0:1787893125.815024:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+5:0:x1874741481750656:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 Request processed in 30197us (30303us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787893125.815037:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 34 00000100:00100000:0.0:1787893125.828461:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893125.828961:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481750912 00000100:00100000:3.0:1787893125.828970:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481750912 00000100:00100000:3.0:1787893125.829018:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 19 00000100:00100000:3.0:1787893125.829033:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+18:11294:x1874741481750912:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787893125.830522:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+19:11294:x1874741481750912:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 Request processed in 1483us (2065us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1787893125.830533:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 19 00000100:00100000:2.0:1787893125.840987:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893125.841144:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481751168 00000100:00100000:3.0:1787893125.841154:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481751168 00000100:00100000:3.0:1787893125.841217:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 87 00000100:00100000:3.0:1787893125.841227:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+19:11294:x1874741481751168:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787893125.841338:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+19:11294:x1874741481751168:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 Request processed in 112us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893125.841346:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 87 00000100:00100000:0.0:1787893125.852690:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893125.852777:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481751296 00000100:00100000:3.0:1787893125.852787:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481751296 00000100:00100000:3.0:1787893125.852837:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 88 00000100:00100000:3.0:1787893125.852846:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+19:11294:x1874741481751296:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787893125.852865:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893125.852884:0:13436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf123b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa80c expref: -99 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.852964:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1242 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.852978:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1242 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.852989:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1242 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893125.853039:0:13436:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787893125.853134:0:13436:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1242 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.853159:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf123b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa80c expref: 21 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.853186:0:13436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1242 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa80c expref: 20 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.853194:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fc9d0fd6900) 00010000:00010000:3.0:1787893125.853197:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787893125.853201:0:13436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9c0030800, rc 0) 00000100:00100000:3.0:1787893125.853258:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+20:11294:x1874741481751296:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 413us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893125.853265:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 88 00000100:00100000:2.0:1787893125.859673:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893125.860118:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481751424 00000100:00100000:1.0:1787893125.860129:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481751424 00000100:00100000:1.0:1787893125.860186:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 35 00000100:00100000:1.0:1787893125.860196:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481751424:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787893125.860213:0:8421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893125.860234:0:8421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef0c62e5/0x9232577658cf1249 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa813 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787893125.860260:0:8421:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a911585, blocks: 0x0 00010000:00010000:1.0:1787893125.860278:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=369s v=(0 0) 00010000:00010000:1.0:1787893125.860283:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893125.860294:0:8421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef0c62e5/0x9232577658cf1249 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa813 expref: 6 pid: 8421 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893125.860315:0:8421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ef0c62e5/0x9232577658cf1249 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa813 expref: 6 pid: 8421 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893125.860329:0:8421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe540a00, rc 0) 00000100:00100000:1.0:1787893125.860386:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58232959-285a-4954-a3ac-571a2b817017+6:2390:x1874741481751424:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 192us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893125.860393:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 35 00000100:00100000:1.0:1787893125.863745:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893125.863899:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481751680 00000100:00100000:0.0:1787893125.863910:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481751680 00000100:00100000:0.0:1787893125.864071:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 89 00000100:00100000:0.0:1787893125.864084:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d1590e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+20:11294:x1874741481751680:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787893125.864198:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d1590e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+20:11294:x1874741481751680:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 Request processed in 117us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893125.864216:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 89 00000100:00100000:3.0:1787893125.870365:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893125.870534:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481751808 00000100:00100000:1.0:1787893125.870545:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481751808 00000100:00100000:1.0:1787893125.870611:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 36 00000100:00100000:1.0:1787893125.870622:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58232959-285a-4954-a3ac-571a2b817017+6:11294:x1874741481751808:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787893125.870641:0:8419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893125.870659:0:8419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000782729dd/0x9232577658cf1250 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa81a expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893125.870690:0:8419:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef0c62e5/0x9232577658cf1249 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa813 expref: 7 pid: 8421 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893125.870699:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893125.870704:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893125.870709:0:8419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000782729dd/0x9232577658cf1250 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa81a expref: 7 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893125.870755:0:8419:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ef0c62e5/0x9232577658cf1249 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa813 expref: 7 pid: 8421 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893125.870769:0:8419:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ef0c62e5/0x9232577658cf1249 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa813 expref: 7 pid: 8421 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893125.870782:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7fddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8419:1874741493372928:192.168.202.35@tcp:104: 00000100:00100000:1.0:1787893125.870871:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9f3e75f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787893125.874787:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893125.874819:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481751936 00000100:00100000:3.0:1787893125.874828:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481751936 00010000:00010000:3.0:1787893125.874870:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ef0c62e5/0x9232577658cf1249 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa813 expref: 8 pid: 8421 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893125.874906:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 59 00000100:00100000:3.0:1787893125.874916:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58232959-285a-4954-a3ac-571a2b817017+8:2391:x1874741481751936:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893125.874931:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893125.874959:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ef0c62e5/0x9232577658cf1249 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa813 expref: 8 pid: 8421 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.874975:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ef0c62e5/0x9232577658cf1249 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa813 expref: 8 pid: 8421 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.875003:0:6491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893125.875008:0:6491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893125.875016:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000782729dd/0x9232577658cf1250 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa81a expref: 8 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.875025:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000782729dd/0x9232577658cf1250 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa81a expref: 8 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.875075:0:6491:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000782729dd/0x9232577658cf1250 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa81a expref: 8 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893125.875090:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc99180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6491:1874741493373056:192.168.202.35@tcp:105: 00000100:00100000:3.0:1787893125.875165:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c70b8840 going to sleep for 11 seconds 00010000:00010000:2.0:1787893125.875358:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef0c62e5/0x9232577658cf1249 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa813 expref: 8 pid: 8421 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893125.875372:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7fddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8419:1874741493372928:192.168.202.35@tcp:104: 00010000:00010000:2.0:1787893125.875396:0:8419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000782729dd/0x9232577658cf1250 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa81a expref: 7 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893125.875406:0:8419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe541600, rc 0) 00000100:00100000:2.0:1787893125.875451:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58232959-285a-4954-a3ac-571a2b817017+7:11294:x1874741481751808:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 4831us (5095us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893125.875460:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 36 00000100:00100000:2.0:1787893125.882449:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893125.882713:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc99180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6491:1874741493373056:192.168.202.35@tcp:105: 00010000:00010000:3.0:1787893125.882736:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893125.882793:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58232959-285a-4954-a3ac-571a2b817017+6:2391:x1874741481751936:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 7878us (8015us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893125.882803:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 59 00000100:00100000:0.0:1787893125.884534:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481752064 00000100:00100000:0.0:1787893125.884548:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481752064 00002000:00100000:0.0:1787893125.884593:0:8426:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9fc8c77f5c00 x1874741481752064/t0(0) o4->58232959-285a-4954-a3ac-571a2b817017@192.168.202.35@tcp:286/0 lens 504/0 e 0 to 0 dl 1787893136 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787893125.884604:0:8426:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc8c77f5c00 with x1874741481752064 ext(0->8) 00002000:00010000:0.0:1787893125.884610:0:8426:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fc8c77f5c00 00000100:00100000:0.0:1787893125.884638:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 0 00000100:00100000:0.0:1787893125.884648:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:58232959-285a-4954-a3ac-571a2b817017+6:2390:x1874741481752064:12345-192.168.202.35@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787893125.885842:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:58232959-285a-4954-a3ac-571a2b817017+8:2390:x1874741481752064:12345-192.168.202.35@tcp:4:lhsmtool_posix.0 Request processed in 1189us (3394us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787893125.885857:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 0 00002000:00100000:1.0:1787893125.885866:0:8426:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9fc8c77f5c00 x1874741481752064/t4294967303(0) o4->58232959-285a-4954-a3ac-571a2b817017@192.168.202.35@tcp:286/0 lens 504/448 e 0 to 0 dl 1787893136 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787893125.885883:0:8426:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc8c77f5c00 with x1874741481752064 ext(0->8) 00002000:00010000:1.0:1787893125.885887:0:8426:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fc8c77f5c00 00000100:00100000:3.0:1787893125.888380:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893125.889063:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481752192 00000100:00100000:0.0:1787893125.889074:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481752192 00000100:00100000:0.0:1787893125.889138:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 90 00000100:00100000:0.0:1787893125.889149:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+20:11294:x1874741481752192:12345-192.168.202.35@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787893125.895069:0:6484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:2.0:1787893125.895084:0:6484:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00010000:00010000:0.0:1787893125.895097:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf1226 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787893125.895109:0:6484:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00010000:00010000:0.0:1787893125.895111:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf1226 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.895120:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf1226 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.895126:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893125.895132:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf1226 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.895139:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf1226 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.895165:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fc9d0fd6900) 00010000:00010000:0.0:1787893125.895168:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787893125.895173:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf1226 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.895178:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf1226 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787893125.895200:0:6536:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1787893125.895210:0:6536:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1787893125.895346:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+14:11294:x1874741481752192:12345-192.168.202.35@tcp:44:lhsmtool_posix.0 Request processed in 6194us (6970us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893125.895356:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 90 00000100:00100000:0.0:1787893125.895813:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787893125.895830:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7fdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493373184:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787893125.895894:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893125.896014:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493373184 00000100:00100000:1.0:1787893125.896023:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493373184 00000100:00100000:1.0:1787893125.896082:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787893125.896092:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493373184:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787893125.896202:0:8535:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787893125.896206:0:8535:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787893126 00002000:00010000:1.0:1787893125.896208:0:8535:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787893125.896210:0:8535:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1787893125 -> 1787893126 00002000:00010000:1.0:1787893125.896213:0:8535:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1787893125.896258:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3631:x1874741493373184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 168us (364us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787893125.896265:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:0.0:1787893125.896334:0:3631:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fc8c7fdf100/2, rc 0, transno 4294967304 00000100:00100000:0.0:1787893125.896340:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7fdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493373184:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787893125.899980:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893125.900237:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481752320 00000100:00100000:0.0:1787893125.900248:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481752320 00000100:00100000:0.0:1787893125.900317:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 38 00000100:00100000:0.0:1787893125.900329:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+8:2392:x1874741481752320:12345-192.168.202.35@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1787893125.902295:0:9497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:3.0:1787893125.902311:0:9497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:0.0:1787893125.903316:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+6:2392:x1874741481752320:12345-192.168.202.35@tcp:16:lhsmtool_posix.0 Request processed in 2982us (3336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893125.903328:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 38 00000100:00100000:2.0:1787893125.915404:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893125.915749:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481752576 00000100:00100000:3.0:1787893125.915760:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481752576 00000100:00100000:3.0:1787893125.915828:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 91 00000100:00100000:3.0:1787893125.915839:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+14:11294:x1874741481752576:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787893125.915891:0:13436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893125.915917:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1242 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa80c expref: 14 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.915947:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fc9d0fd6900) 00010000:00010000:3.0:1787893125.915952:0:13436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787893125.915981:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1257 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.915994:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1257 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.916003:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1257 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787893125.916248:0:13436:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c9406c63 reply state 00000000b6b53267 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1257 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.916260:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1257 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.916267:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fc9d0fd6900) 00010000:00010000:3.0:1787893125.916270:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787893125.916272:0:13436:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787893125.916367:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+15:11294:x1874741481752576:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 Request processed in 530us (971us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1787893125.916376:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 91 00000100:00100000:2.0:1787893125.920056:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893125.920152:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481752704 00000100:00100000:3.0:1787893125.920160:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481752704 00000100:00100000:3.0:1787893125.920222:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 39 00000100:00100000:3.0:1787893125.920230:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58232959-285a-4954-a3ac-571a2b817017+6:2390:x1874741481752704:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787893125.920374:0:8535:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787893125.920377:0:8535:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1787893126 -> 1787893124 00002000:00010000:3.0:1787893125.920380:0:8535:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787893122 00002000:00010000:3.0:1787893125.920381:0:8535:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1787893126 -> 1787893124 00002000:00010000:3.0:1787893125.920383:0:8535:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1787893125.920424:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58232959-285a-4954-a3ac-571a2b817017+7:2390:x1874741481752704:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 Request processed in 195us (388us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787893125.920429:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 39 00000100:00100000:2.0:1787893125.926892:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893125.926959:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481752960 00000100:00100000:3.0:1787893125.926970:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481752960 00000100:00100000:3.0:1787893125.927030:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 92 00000100:00100000:3.0:1787893125.927040:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+15:11294:x1874741481752960:12345-192.168.202.35@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787893125.927116:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf125e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.927134:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031200/0x9232577658cf121f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7fe expref: 15 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.927144:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf125e lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.927200:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031200/0x9232577658cf121f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7fe expref: 15 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.927213:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031200/0x9232577658cf121f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7fe expref: 15 pid: 9515 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893125.927227:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed563b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6504:1874741493373312:192.168.202.35@tcp:104: 00000100:00100000:3.0:1787893125.927324:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c70b89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787893125.930906:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893125.931054:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed563b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6504:1874741493373312:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787893125.931084:0:6504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf125e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893125.934810:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481753088 00000100:00100000:0.0:1787893125.934832:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481753088 00010000:00010000:0.0:1787893125.934876:0:6490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031200/0x9232577658cf121f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7fe expref: 16 pid: 9515 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893125.935186:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 60 00000100:00100000:0.0:1787893125.935199:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+16:2391:x1874741481753088:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893125.935214:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893125.935222:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031200/0x9232577658cf121f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7fe expref: 16 pid: 9515 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.935237:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031200/0x9232577658cf121f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7fe expref: 16 pid: 9515 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.935259:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031200/0x9232577658cf121f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7fe expref: 16 pid: 9515 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.935290:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fc9d0fd6900) 00010000:00010000:0.0:1787893125.935295:0:6490:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf125e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.935305:0:6490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf125e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.935313:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf125e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.935342:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893125.935400:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+15:2391:x1874741481753088:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 203us (4500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893125.935417:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 60 00010000:00010000:0.0:1787893125.940076:0:6504:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf125e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.940093:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf125e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.940134:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf125e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.940143:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf125e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.940150:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf125e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.940157:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c0031400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893125.940162:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf125e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.940169:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf125e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.940187:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fc9d0fd6900) 00010000:00010000:0.0:1787893125.940190:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787893125.940194:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf125e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.940201:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf125e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893125.940297:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+14:11294:x1874741481752960:12345-192.168.202.35@tcp:55:lhsmtool_posix.0 Request processed in 13252us (13408us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787893125.940316:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 92 00000100:00100000:2.0:1787893125.943174:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893125.943209:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481753216 00000100:00100000:2.0:1787893125.943220:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481753216 00000100:00100000:2.0:1787893125.943265:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 40 00000100:00100000:2.0:1787893125.943274:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58232959-285a-4954-a3ac-571a2b817017+7:2390:x1874741481753216:12345-192.168.202.35@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787893125.943318:0:8419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000991ac37/0x9232577658cf1265 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893125.943344:0:8419:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000782729dd/0x9232577658cf1250 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa81a expref: 7 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893125.943354:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893125.943358:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787893125.943362:0:8419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000991ac37/0x9232577658cf1265 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893125.943396:0:8419:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000782729dd/0x9232577658cf1250 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa81a expref: 7 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893125.943411:0:8419:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000782729dd/0x9232577658cf1250 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa81a expref: 7 pid: 8419 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893125.943426:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c77f5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8419:1874741493373440:192.168.202.35@tcp:104: 00000100:00100000:2.0:1787893125.943513:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c6696a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787893125.951227:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893125.954267:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c77f5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8419:1874741493373440:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787893125.954300:0:8419:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000991ac37/0x9232577658cf1265 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893125.954335:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481753344 00000100:00100000:3.0:1787893125.954342:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481753344 00010000:00010000:3.0:1787893125.954380:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000782729dd/0x9232577658cf1250 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa81a expref: 8 pid: 8419 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893125.954431:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 61 00000100:00100000:3.0:1787893125.954442:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58232959-285a-4954-a3ac-571a2b817017+8:2390:x1874741481753344:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893125.954456:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893125.954481:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000782729dd/0x9232577658cf1250 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa81a expref: 8 pid: 8419 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.954529:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000782729dd/0x9232577658cf1250 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa81a expref: 8 pid: 8419 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.954552:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000782729dd/0x9232577658cf1250 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa81a expref: 8 pid: 8419 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.954568:0:6492:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787893125.954574:0:6492:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787893125.954579:0:6492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000991ac37/0x9232577658cf1265 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.954587:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000991ac37/0x9232577658cf1265 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.954611:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893125.954662:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58232959-285a-4954-a3ac-571a2b817017+7:2390:x1874741481753344:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 222us (3443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893125.954670:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 61 00010000:00010000:3.0:1787893125.954693:0:8419:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000991ac37/0x9232577658cf1265 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.954702:0:8419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000991ac37/0x9232577658cf1265 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.954720:0:8419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000991ac37/0x9232577658cf1265 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.954736:0:8419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000991ac37/0x9232577658cf1265 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.954742:0:8419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000991ac37/0x9232577658cf1265 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.954749:0:8419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7e200 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:3.0:1787893125.954752:0:8419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000991ac37/0x9232577658cf1265 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.954760:0:8419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000991ac37/0x9232577658cf1265 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.954772:0:8419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000991ac37/0x9232577658cf1265 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.954778:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000991ac37/0x9232577658cf1265 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893125.954821:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58232959-285a-4954-a3ac-571a2b817017+6:2390:x1874741481753216:12345-192.168.202.35@tcp:1:lhsmtool_posix.0 Request processed in 11548us (11657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893125.954829:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 40 00000100:00100000:2.0:1787893125.958204:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893125.958320:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481753600 00000100:00100000:3.0:1787893125.958330:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481753600 00000100:00100000:3.0:1787893125.958384:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 93 00000100:00100000:3.0:1787893125.958402:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+14:11294:x1874741481753600:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787893125.958476:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf126c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.958513:0:9515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf10ac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7a3 expref: 14 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.958524:0:9515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf126c lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.958558:0:9515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf10ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7a3 expref: 14 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893125.958573:0:9515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf10ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7a3 expref: 14 pid: 13436 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893125.958587:0:9515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ed563b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9515:1874741493373568:192.168.202.35@tcp:104: 00000100:00100000:3.0:1787893125.958671:0:9515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c70b8600 going to sleep for 11 seconds 00000100:00100000:3.0:1787893125.965837:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893125.966165:0:9515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ed563b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9515:1874741493373568:192.168.202.35@tcp:104: 00010000:00010000:1.0:1787893125.966193:0:9515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf126c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893125.968208:0:10383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481753728 00000100:00100000:2.0:1787893125.968221:0:10383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481753728 00010000:00010000:2.0:1787893125.968262:0:10383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf10ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7a3 expref: 15 pid: 13436 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893125.968730:0:10383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 62 00000100:00100000:2.0:1787893125.968742:0:10383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3effc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58232959-285a-4954-a3ac-571a2b817017+15:2391:x1874741481753728:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787893125.968767:0:10383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893125.968776:0:10383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf10ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7a3 expref: 15 pid: 13436 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893125.968789:0:10383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf10ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7a3 expref: 15 pid: 13436 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893125.968808:0:10383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf10ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7a3 expref: 15 pid: 13436 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893125.968821:0:10383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c660e800) 00010000:00010000:2.0:1787893125.968826:0:10383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf126c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893125.968836:0:10383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf126c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893125.968843:0:10383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf126c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893125.968967:0:10383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893125.969028:0:10383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3effc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58232959-285a-4954-a3ac-571a2b817017+14:2391:x1874741481753728:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 288us (3200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893125.969036:0:10383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 62 00010000:00010000:0.0:1787893125.969232:0:9515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf126c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.969241:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf126c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.969426:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1273 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.969439:0:9515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf122d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa805 expref: 14 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.969446:0:9515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1273 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.969471:0:9515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf122d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa805 expref: 14 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.969483:0:9515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf122d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa805 expref: 14 pid: 10086 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893125.969531:0:9515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9515:1874741493373696:192.168.202.35@tcp:104: 00000100:00100000:0.0:1787893125.969581:0:9515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57240 going to sleep for 11 seconds 00000100:00100000:0.0:1787893125.972308:0:9515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9515:1874741493373696:192.168.202.35@tcp:104: 00000100:00100000:3.0:1787893125.972309:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00010000:00010000:0.0:1787893125.972337:0:9515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1273 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893125.972408:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481753856 00000100:00100000:1.0:1787893125.972415:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481753856 00010000:00010000:1.0:1787893125.972446:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf122d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa805 expref: 15 pid: 10086 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893125.972483:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 63 00000100:00100000:1.0:1787893125.972523:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ed563b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58232959-285a-4954-a3ac-571a2b817017+15:2390:x1874741481753856:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893125.972545:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893125.972552:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf122d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa805 expref: 15 pid: 10086 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893125.972564:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf122d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa805 expref: 15 pid: 10086 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893125.972585:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf122d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa805 expref: 15 pid: 10086 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893125.972599:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fc9d0fd6900) 00010000:00010000:1.0:1787893125.972603:0:6492:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1273 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893125.972613:0:6492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1273 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893125.972619:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1273 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893125.972641:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893125.972691:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ed563b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58232959-285a-4954-a3ac-571a2b817017+14:2390:x1874741481753856:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 200us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893125.972698:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 63 00010000:00010000:0.0:1787893125.972756:0:9515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1273 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.972763:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1273 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787893125.972859:0:9515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:0.0:1787893125.972985:0:9515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:0.0:1787893125.973024:0:9515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:0.0:1787893125.973109:0:9515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9515:1874741493373824:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787893125.973154:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893125.973285:0:9515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57000 going to sleep for 11 seconds 00000100:00100000:1.0:1787893125.977081:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493373824 00000100:00100000:1.0:1787893125.977096:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493373824 00000100:00100000:1.0:1787893125.977164:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787893125.977176:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9515:x1874741493373824:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787893125.977400:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9515:x1874741493373824:12345-0@lo:1000:mdt00_003.0 Request processed in 226us (4244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893125.977421:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787893125.983476:0:9515:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1787893125.983557:0:9515:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fc8c7fdf100, transno 4294967304 00000100:00100000:0.0:1787893125.983717:0:9515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9515:1874741493373824:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1787893125.983871:0:9515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:0.0:1787893125.983946:0:9515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9515:1874741493373952:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787893125.984010:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893125.984058:0:9515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787893125.984152:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493373952 00000100:00100000:3.0:1787893125.984171:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493373952 00000100:00100000:3.0:1787893125.984227:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787893125.984236:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:9515:x1874741493373952:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787893125.984369:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:9515:x1874741493373952:12345-0@lo:1000:mdt00_003.0 Request processed in 133us (358us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787893125.984377:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787893125.984401:0:9515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9515:1874741493373952:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1787893125.984441:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1273 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.984452:0:9515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1273 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.984460:0:9515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1273 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.984478:0:9515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893125.984483:0:9515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1273 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.984669:0:9515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1273 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.984689:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fc9d0fd6900) 00010000:00010000:0.0:1787893125.984692:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787893125.984696:0:9515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1273 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.984703:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1273 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.984726:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf11a8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.984731:0:9515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf11a8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.984737:0:9515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf11a8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.984742:0:9515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893125.984745:0:9515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf11a8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.984751:0:9515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf11a8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.984768:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c660e800) 00010000:00010000:0.0:1787893125.984769:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787893125.984772:0:9515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf11a8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.984777:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf11a8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.984796:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf127a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.984808:0:9515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf11c4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7e9 expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.984816:0:9515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf127a lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.984842:0:9515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf11c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7e9 expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.984855:0:9515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf11c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7e9 expref: 17 pid: 6504 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893125.984866:0:9515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9515:1874741493374080:192.168.202.35@tcp:104: 00000100:00100000:0.0:1787893125.985021:0:9515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c3ed2900 going to sleep for 11 seconds 00000100:00100000:3.0:1787893125.988042:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893125.988526:0:9515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9515:1874741493374080:192.168.202.35@tcp:104: 00010000:00010000:0.0:1787893125.988554:0:9515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf127a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893125.988671:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481753984 00000100:00100000:1.0:1787893125.988679:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481753984 00010000:00010000:1.0:1787893125.988715:0:6490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf11c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7e9 expref: 18 pid: 6504 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893125.988744:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 64 00000100:00100000:1.0:1787893125.988752:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+18:2390:x1874741481753984:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893125.988767:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893125.988775:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf11c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7e9 expref: 18 pid: 6504 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893125.988787:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf11c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7e9 expref: 18 pid: 6504 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893125.988809:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf11c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa7e9 expref: 18 pid: 6504 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893125.988824:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c660e800) 00010000:00010000:1.0:1787893125.988828:0:6490:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf127a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893125.988838:0:6490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf127a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893125.988844:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf127a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893125.988880:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893125.988940:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+17:2390:x1874741481753984:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 188us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893125.988947:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 64 00010000:00010000:0.0:1787893125.989002:0:9515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf127a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.989010:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf127a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.989021:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf127a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.989028:0:9515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf127a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.989035:0:9515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf127a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.989040:0:9515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893125.989055:0:9515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf127a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.989064:0:9515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf127a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.989073:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c660e800) 00010000:00010000:0.0:1787893125.989076:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893125.989079:0:9515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf127a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.989085:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf127a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.989095:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf126c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.989107:0:9515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf126c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.989113:0:9515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf126c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.989119:0:9515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c0030800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893125.989122:0:9515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf126c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.989127:0:9515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf126c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.989134:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c660e800) 00010000:00010000:0.0:1787893125.989137:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787893125.989140:0:9515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf126c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.989144:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf126c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893125.989307:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+16:11294:x1874741481753600:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 Request processed in 30907us (31114us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1787893125.989315:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 93 00000020:00080000:0.0:1787893125.989319:0:9515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787893125.989629:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787893125.989634:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787893125.989650:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787893125.989655:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787893125.994363:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893125.994666:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481754240 00000100:00100000:0.0:1787893125.994677:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481754240 00000100:00100000:0.0:1787893125.994736:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 20 00000100:00100000:0.0:1787893125.994747:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+16:11294:x1874741481754240:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787893125.995016:0:6507:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787893125.995061:0:6507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:0.0:1787893125.995096:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf1281 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.995113:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf1281 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.995125:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf1281 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.995133:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf1281 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.995139:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf1281 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.995145:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf1281 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893125.995216:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787893125.995299:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+18:11294:x1874741481754240:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 Request processed in 553us (942us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1787893125.995307:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 20 00000020:00080000:0.0:1787893125.995312:0:6507:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787893125.999441:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893125.999455:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf1281 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893125.999467:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31000 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:1.0:1787893125.999472:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf1281 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893125.999481:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf1281 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893125.999514:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fc9d0fd6900) 00010000:00010000:1.0:1787893125.999517:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787893125.999521:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf1281 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893125.999527:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf1281 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893125.999543:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893125.999545:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893125.999547:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893126.171902:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893126.171967:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893126.172021:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893126.172120:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481754496 00000100:00100000:0.0:1787893126.172131:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481754496 00000100:00100000:3.0:1787893126.172166:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481755008 00000100:00100000:3.0:1787893126.172173:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481755008 00000100:00100000:0.0:1787893126.172202:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 317 00000100:00100000:0.0:1787893126.172214:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+18:2390:x1874741481754496:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893126.172227:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 318 00000100:00100000:3.0:1787893126.172237:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481755008:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893126.172321:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481754752 00000100:00100000:2.0:1787893126.172326:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481754752 00000100:00080000:1.0:1787893126.172401:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787893126.172415:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787893126.172420:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+18:2390:x1874741481754496:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 197us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893126.172437:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 317 00000100:00100000:2.0:1787893126.172826:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 119 00000100:00100000:2.0:1787893126.173038:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58232959-285a-4954-a3ac-571a2b817017+7:2390:x1874741481754752:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893126.176683:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58232959-285a-4954-a3ac-571a2b817017+7:2390:x1874741481754752:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 3673us (4703us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893126.177391:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481755008:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 5152us (5365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893126.177403:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 318 00000100:00100000:2.0:1787893126.191956:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 119 00000100:00100000:0.0:1787893126.195430:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893126.195836:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893126.195872:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893126.195903:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893126.195941:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481754624 00000100:00100000:0.0:1787893126.195958:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481754624 00000100:00100000:0.0:1787893126.196012:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481755136 00000100:00100000:0.0:1787893126.196016:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481755136 00000100:00100000:0.0:1787893126.196039:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 319 00000100:00100000:0.0:1787893126.196082:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481754624:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893126.196154:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481754624:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 75us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893126.196162:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 319 00000100:00100000:0.0:1787893126.196178:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 320 00000100:00100000:0.0:1787893126.196185:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481755136:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893126.196209:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481755136:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 25us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893126.196216:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 320 00000100:00080000:2.0:1787893126.196329:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787893126.196907:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481754880 00000100:00100000:3.0:1787893126.196928:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481754880 00000100:00100000:3.0:1787893126.196991:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 120 00000100:00100000:3.0:1787893126.197000:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+6:2390:x1874741481754880:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893126.197038:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+6:2390:x1874741481754880:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 39us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893126.197053:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 120 00000100:00100000:1.0:1787893126.199823:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481754368 00000100:00100000:1.0:1787893126.199837:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481754368 00000100:00100000:1.0:1787893126.199901:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 387 00000100:00100000:1.0:1787893126.200101:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2390:x1874741481754368:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893126.200234:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2390:x1874741481754368:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 324us (4813us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893126.200242:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 387 00010000:00010000:3.0:1787893126.834134:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893127.348582:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787893127.348603:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493374208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787893127.348670:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893127.348733:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493374208 00000100:00100000:0.0:1787893127.348739:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493374208 00000100:00100000:0.0:1787893127.348793:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787893127.348803:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3630:x1874741493374208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787893127.348845:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787893127.348885:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3630:x1874741493374208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893127.348893:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:0.0:1787893127.348926:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787893127.348961:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493374208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787893127.350425:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787893127.350441:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7fdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493374336:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787893127.350976:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893127.356219:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493374336 00000100:00100000:2.0:1787893127.356233:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493374336 00000100:00100000:2.0:1787893127.356312:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787893127.356322:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe7bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493374336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787893127.356346:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787893127.356427:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe7bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493374336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (5938us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893127.356434:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:1.0:1787893127.358304:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787893127.358363:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7fdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493374336:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1787893127.625409:0:14250:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787893127.625418:0:14250:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787893127.625666:0:14250:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787893127.625674:0:14250:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787893127.777284:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893127.777323:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481755392 00000100:00100000:3.0:1787893127.777334:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481755392 00000100:00100000:3.0:1787893127.777405:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 94 00000100:00100000:3.0:1787893127.777416:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+18:11313:x1874741481755392:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:3.0:1787893127.777438:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893127.777471:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf1288 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa821 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.777588:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031200/0x9232577658cf128f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.777602:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031200/0x9232577658cf128f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.777616:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031200/0x9232577658cf128f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893127.777626:0:6505:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1787893127.777720:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf1288 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa821 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.777745:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031200/0x9232577658cf128f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa821 expref: 20 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.777751:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc9d0fd6700) 00010000:00010000:3.0:1787893127.777754:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787893127.777756:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9c0031200, rc 0) 00000100:00100000:3.0:1787893127.777807:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+20:11313:x1874741481755392:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 393us (532us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1787893127.777813:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 94 00000100:00080000:1.0:1787893127.778700:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787893127.791001:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893127.791168:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481755520 00000100:00100000:3.0:1787893127.791178:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481755520 00000100:00100000:3.0:1787893127.791234:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 95 00000100:00100000:3.0:1787893127.791242:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7fdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+20:11313:x1874741481755520:12345-192.168.202.35@tcp:34:lfs.0 00010000:00010000:3.0:1787893127.791315:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030c00/0x9232577658cf129d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.791329:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030c00/0x9232577658cf129d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.791338:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030c00/0x9232577658cf129d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.791348:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf12a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.791353:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf12a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.791357:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf12a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.791415:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf12ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.791420:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf12ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.791423:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf12ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787893127.791455:0:9515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf12ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.791464:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030c00/0x9232577658cf129d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.791475:0:9515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030c00/0x9232577658cf129d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.791480:0:9515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030c00/0x9232577658cf129d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.791484:0:9515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c0030c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893127.791511:0:9515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030c00/0x9232577658cf129d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.791520:0:9515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030c00/0x9232577658cf129d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.791532:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc9d0fd6700) 00010000:00010000:3.0:1787893127.791535:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893127.791540:0:9515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030c00/0x9232577658cf129d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.791546:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030c00/0x9232577658cf129d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.791570:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf12a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.791574:0:9515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf12a4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.791577:0:9515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf12a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.791580:0:9515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c0030800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893127.791586:0:9515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf12a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.791590:0:9515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf12a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.791596:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc9d0fd6a00) 00010000:00010000:3.0:1787893127.791597:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893127.791599:0:9515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf12a4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.791602:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf12a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.791613:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf12ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.791616:0:9515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf12ab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.791619:0:9515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf12ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.791622:0:9515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c771f400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893127.791624:0:9515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf12ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.791627:0:9515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf12ab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.791630:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc9d0fd6200) 00010000:00010000:3.0:1787893127.791631:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893127.791636:0:9515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf12ab lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.791640:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf12ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893127.791695:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7fdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+20:11313:x1874741481755520:12345-192.168.202.35@tcp:34:lfs.0 Request processed in 454us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893127.791699:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 95 00010000:00010000:3.0:1787893127.858066:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893127.864369:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893127.864614:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481755776 00000100:00100000:2.0:1787893127.864624:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481755776 00000100:00100000:2.0:1787893127.864713:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 96 00000100:00100000:2.0:1787893127.864724:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+20:11316:x1874741481755776:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:2.0:1787893127.864744:0:10086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893127.864765:0:10086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf12b2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa828 expref: -99 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893127.864832:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f800/0x9232577658cf12b9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893127.864864:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f800/0x9232577658cf12b9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893127.864876:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f800/0x9232577658cf12b9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893127.864892:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf12c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893127.864900:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf12c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893127.864906:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf12c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893127.865042:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf12c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893127.865051:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf12c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893127.865058:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf12c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893127.865068:0:10086:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1787893127.865144:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f800/0x9232577658cf12b9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893127.865152:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f800/0x9232577658cf12b9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893127.865159:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f800/0x9232577658cf12b9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893127.865171:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7f800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893127.865176:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f800/0x9232577658cf12b9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893127.865183:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f800/0x9232577658cf12b9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893127.865196:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc9d0fd6700) 00010000:00010000:2.0:1787893127.865199:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893127.865204:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f800/0x9232577658cf12b9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893127.865210:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f800/0x9232577658cf12b9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893127.865221:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf12c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893127.865227:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf12c0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893127.865232:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf12c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893127.865237:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7ea00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893127.865239:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf12c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893127.865245:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf12c0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893127.865263:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc8c6614d00) 00010000:00010000:2.0:1787893127.865265:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893127.865268:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf12c0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893127.865274:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf12c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893127.865372:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf12b2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa828 expref: 23 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893127.865387:0:10086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf12c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa828 expref: 22 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893127.865394:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c6614000) 00010000:00010000:2.0:1787893127.865396:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787893127.865399:0:10086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7e800, rc 0) 00000100:00100000:2.0:1787893127.865467:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+22:11316:x1874741481755776:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 744us (1107us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1787893127.865473:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 96 00000100:00100000:3.0:1787893127.868683:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893127.868835:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481755904 00000100:00100000:0.0:1787893127.868845:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481755904 00000100:00100000:0.0:1787893127.868901:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 97 00000100:00100000:0.0:1787893127.868920:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+22:11316:x1874741481755904:12345-192.168.202.35@tcp:54:lfs.0 00010000:00010000:0.0:1787893127.868980:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf12d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893127.868994:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf12d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893127.869005:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf12d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893127.869046:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf12d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893127.869053:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf12d5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893127.869059:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf12d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893127.869065:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893127.869080:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf12d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893127.869088:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf12d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893127.869099:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c6614000) 00010000:00010000:0.0:1787893127.869102:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787893127.869105:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf12d5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893127.869111:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf12d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893127.869184:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+22:11316:x1874741481755904:12345-192.168.202.35@tcp:54:lfs.0 Request processed in 274us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893127.869192:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 97 00000100:00100000:0.0:1787893127.871817:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893127.871872:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481756160 00000100:00100000:3.0:1787893127.871880:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481756160 00000100:00100000:3.0:1787893127.871933:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 21 00000100:00100000:3.0:1787893127.871944:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fee050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+22:11316:x1874741481756160:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:3.0:1787893127.872173:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fee050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+23:11316:x1874741481756160:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 230us (364us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1787893127.872181:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 21 00000100:00100000:1.0:1787893127.915873:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893127.915968:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481756416 00000100:00100000:3.0:1787893127.915978:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481756416 00000100:00100000:3.0:1787893127.916111:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 98 00000100:00100000:3.0:1787893127.916120:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7fde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+23:10834:x1874741481756416:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:3.0:1787893127.916141:0:9515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893127.916161:0:9515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ec00/0x9232577658cf12dc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa82f expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.916259:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf12e3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.916283:0:9515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf12c7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa828 expref: 24 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.916289:0:9515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf12e3 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.916313:0:9515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf12c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa828 expref: 24 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.916323:0:9515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf12c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa828 expref: 24 pid: 10086 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893127.916333:0:9515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9515:1874741493374464:192.168.202.35@tcp:104: 00000100:00100000:3.0:1787893127.916419:0:9515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c70b83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787893127.920438:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893127.920549:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481756544 00000100:00100000:1.0:1787893127.920558:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481756544 00010000:00010000:1.0:1787893127.920598:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf12c7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa828 expref: 25 pid: 10086 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893127.920639:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 65 00000100:00100000:1.0:1787893127.920649:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58232959-285a-4954-a3ac-571a2b817017+25:2390:x1874741481756544:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893127.920663:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893127.920669:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf12c7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa828 expref: 25 pid: 10086 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893127.920698:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf12c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa828 expref: 25 pid: 10086 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893127.920721:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c6614000) 00010000:00010000:1.0:1787893127.920726:0:6492:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf12e3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893127.920736:0:6492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf12e3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893127.920744:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf12e3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893127.920761:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893127.920824:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58232959-285a-4954-a3ac-571a2b817017+25:2390:x1874741481756544:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 176us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893127.920832:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 65 00010000:00010000:3.0:1787893127.921882:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf12c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa828 expref: 24 pid: 10086 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893127.921898:0:9515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9515:1874741493374464:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787893127.921926:0:9515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf12e3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.921933:0:9515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf12e3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.921937:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf12e3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893127.921952:0:9515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787893127.922089:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ec00/0x9232577658cf12dc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa82f expref: 25 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.922117:0:9515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf12e3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa82f expref: 24 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.922126:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c6614000) 00010000:00010000:3.0:1787893127.922128:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787893127.922131:0:9515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c771f400, rc 0) 00000100:00100000:3.0:1787893127.922269:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7fde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+24:10834:x1874741481756416:12345-192.168.202.35@tcp:101:bash.0 Request processed in 6149us (6405us total) trans 4294967368 rc 0/0 00000100:00100000:3.0:1787893127.922278:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 98 00000100:00100000:0.0:1787893127.927400:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893127.927674:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481756672 00000100:00100000:1.0:1787893127.927685:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481756672 00000100:00100000:1.0:1787893127.927796:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 99 00000100:00100000:1.0:1787893127.927806:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+24:10834:x1874741481756672:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:1.0:1787893127.927830:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893127.927851:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf12f1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa836 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893127.927887:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf12f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893127.927918:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf12f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893127.927929:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf12f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893127.928130:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf12f1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa836 expref: 26 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893127.928147:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf12f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa836 expref: 25 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893127.928157:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c6614000) 00010000:00010000:1.0:1787893127.928160:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787893127.928164:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe540c00, rc 0) 00000100:00100000:1.0:1787893127.928225:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+25:10834:x1874741481756672:12345-192.168.202.35@tcp:101:bash.0 Request processed in 420us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893127.928232:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 99 00000100:00100000:1.0:1787893127.935590:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893127.935855:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481756928 00000100:00100000:0.0:1787893127.935866:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481756928 00000100:00100000:0.0:1787893127.935933:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 100 00000100:00100000:0.0:1787893127.935944:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+25:10834:x1874741481756928:12345-192.168.202.35@tcp:36:bash.0 00010000:00010000:0.0:1787893127.936194:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf12ff lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893127.936211:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf12ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893127.936222:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf12ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787893127.936275:0:6505:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:0.0:1787893127.936298:0:6505:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002adef39c reply state 00000000a20c85e1 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf12ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893127.936310:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf12ff lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893127.936317:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c6614000) 00010000:00010000:0.0:1787893127.936319:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787893127.936322:0:6505:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787893127.936388:0:6505:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:0.0:1787893127.937098:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+29:10834:x1874741481756928:12345-192.168.202.35@tcp:36:bash.0 Request processed in 1151us (1512us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1787893127.937108:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 100 00000020:00080000:0.0:1787893127.937114:0:6505:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1787893127.939556:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893127.939671:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481757056 00000100:00100000:1.0:1787893127.939681:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481757056 00000100:00100000:1.0:1787893127.939743:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 101 00000100:00100000:1.0:1787893127.939754:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+29:10834:x1874741481757056:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:1.0:1787893127.939777:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893127.939798:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf1306 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa83d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893127.939879:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf1306 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa83d expref: 30 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893127.939894:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf1306 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa83d expref: 30 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893127.940975:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c6614000) 00010000:00010000:1.0:1787893127.940981:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787893127.940985:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe540600, rc 0) 00000100:00100000:1.0:1787893127.941127:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+30:10834:x1874741481757056:12345-192.168.202.35@tcp:101:bash.0 Request processed in 1373us (1578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893127.941135:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 101 00000100:00100000:1.0:1787893127.944574:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893127.944673:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481757184 00000100:00100000:3.0:1787893127.944682:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481757184 00000100:00100000:3.0:1787893127.944781:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 41 00000100:00100000:3.0:1787893127.944799:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7fdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58232959-285a-4954-a3ac-571a2b817017+6:10834:x1874741481757184:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:3.0:1787893127.944816:0:8535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893127.944836:0:8535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028870c7f/0x9232577658cf130d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa844 expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787893127.944862:0:8535:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a911584, atime: 0x6a911582, ctime: 0x6a911584, blocks: 0x8 00010000:00010000:3.0:1787893127.944883:0:8535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=371s v=(0 0) 00010000:00010000:3.0:1787893127.944888:0:8535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893127.944895:0:8535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028870c7f/0x9232577658cf130d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa844 expref: 7 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.944928:0:8535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000028870c7f/0x9232577658cf130d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa844 expref: 7 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893127.944951:0:8535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c771ec00, rc 0) 00000100:00100000:3.0:1787893127.945013:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7fdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58232959-285a-4954-a3ac-571a2b817017+7:10834:x1874741481757184:12345-192.168.202.35@tcp:101:bash.0 Request processed in 216us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893127.945021:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 41 00000100:00080000:1.0:1787893127.946591:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787893127.948921:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893127.949142:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481757312 00000100:00100000:0.0:1787893127.949152:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481757312 00002000:00010000:0.0:1787893127.949194:0:8424:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:0.0:1787893127.949199:0:8424:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc8c7d48e00 with x1874741481757312 ext(0->18446744073709551615) 00002000:00010000:0.0:1787893127.949212:0:8424:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fc8c7d48e00. 00000100:00100000:0.0:1787893127.949244:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 1 00000100:00100000:0.0:1787893127.949253:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:58232959-285a-4954-a3ac-571a2b817017+7:2390:x1874741481757312:12345-192.168.202.35@tcp:10:bash.0 00002000:00010000:0.0:1787893127.949647:0:8424:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787893127.949651:0:8424:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1787893124 -> 1787893128 00002000:00010000:0.0:1787893127.949653:0:8424:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1787893122 -> 1787893122 00002000:00010000:0.0:1787893127.949655:0:8424:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1787893124 -> 1787893128 00002000:00010000:0.0:1787893127.949665:0:8424:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1787893127.949750:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:58232959-285a-4954-a3ac-571a2b817017+8:2390:x1874741481757312:12345-192.168.202.35@tcp:10:bash.0 Request processed in 498us (838us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787893127.949757:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 1 00002000:00010000:0.0:1787893127.949760:0:8424:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:0.0:1787893127.949763:0:8424:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc8c7d48e00 with x1874741481757312 ext(0->18446744073709551615) 00002000:00010000:0.0:1787893127.949767:0:8424:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fc8c7d48e00. 00000100:00100000:0.0:1787893128.047551:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893128.047625:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481757440 00000100:00100000:2.0:1787893128.047635:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481757440 00000100:00100000:2.0:1787893128.047694:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 102 00000100:00100000:2.0:1787893128.047704:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+30:11330:x1874741481757440:12345-192.168.202.35@tcp:34:lfs.0 00010000:00010000:2.0:1787893128.047790:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf1314 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.047823:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf1314 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.047834:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf1314 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.047850:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f800/0x9232577658cf131b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.047856:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f800/0x9232577658cf131b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.047862:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f800/0x9232577658cf131b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.047930:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1322 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.047939:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1322 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.047945:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1322 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787893128.047993:0:10086:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1322 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.048003:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf1314 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.048009:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf1314 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.048057:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf1314 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.048064:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7ea00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893128.048069:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf1314 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.048077:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf1314 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.048145:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc9d0fd6700) 00010000:00010000:2.0:1787893128.048149:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893128.048154:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf1314 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.048164:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf1314 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.048177:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f800/0x9232577658cf131b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.048183:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f800/0x9232577658cf131b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.048189:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f800/0x9232577658cf131b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.048194:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7f800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893128.048197:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f800/0x9232577658cf131b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.048216:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f800/0x9232577658cf131b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.048227:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc8c6614d00) 00010000:00010000:2.0:1787893128.048229:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893128.048232:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f800/0x9232577658cf131b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.048237:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f800/0x9232577658cf131b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.048251:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1322 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.048256:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1322 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.048261:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1322 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.048266:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7ee00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893128.048268:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1322 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.048276:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1322 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.048282:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c6614000) 00010000:00010000:2.0:1787893128.048284:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893128.048286:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1322 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.048299:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1322 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893128.048463:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+30:11330:x1874741481757440:12345-192.168.202.35@tcp:34:lfs.0 Request processed in 760us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893128.048470:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 102 00000100:00100000:1.0:1787893128.102343:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893128.102588:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481757696 00000100:00100000:0.0:1787893128.102598:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481757696 00000100:00100000:0.0:1787893128.102663:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 103 00000100:00100000:0.0:1787893128.102675:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+30:11333:x1874741481757696:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787893128.102696:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893128.102719:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf1329 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa84b expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.103175:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1330 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.103193:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1330 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.103205:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1330 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.103220:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1337 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.103227:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1337 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.103248:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1337 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.103361:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf133e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.103371:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf133e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.103378:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf133e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893128.103387:0:6505:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787893128.103458:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1330 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.103465:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1330 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.103471:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1330 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.103477:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893128.103482:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1330 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.104034:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1330 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.104050:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc9d0fd6700) 00010000:00010000:0.0:1787893128.104053:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893128.104066:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1330 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.104073:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1330 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.104088:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1337 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.104095:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1337 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.104101:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1337 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.104106:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893128.104109:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1337 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.104115:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1337 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.104123:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc8c751ac00) 00010000:00010000:0.0:1787893128.104124:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893128.104127:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1337 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.104131:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1337 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.104174:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf1329 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa84b expref: 33 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.104201:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf133e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa84b expref: 32 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.104209:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c6614000) 00010000:00010000:0.0:1787893128.104211:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787893128.104213:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb31000, rc 0) 00000100:00100000:0.0:1787893128.104287:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+32:11333:x1874741481757696:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 1614us (1955us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1787893128.104296:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 103 00000100:00100000:3.0:1787893128.109904:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893128.109976:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481757824 00000100:00100000:0.0:1787893128.109985:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481757824 00000100:00100000:0.0:1787893128.110049:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 104 00000100:00100000:0.0:1787893128.110059:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+32:11333:x1874741481757824:12345-192.168.202.35@tcp:54:lfs.0 00010000:00010000:0.0:1787893128.110132:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf134c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.110149:0:9515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf12e3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa82f expref: 32 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.110158:0:9515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf134c lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.110193:0:9515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf12e3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa82f expref: 32 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.110206:0:9515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf12e3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa82f expref: 32 pid: 9515 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893128.110235:0:9515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9515:1874741493374592:192.168.202.35@tcp:104: 00000100:00100000:0.0:1787893128.110345:0:9515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d7ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1787893128.115227:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893128.115342:0:9515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9515:1874741493374592:192.168.202.35@tcp:104: 00010000:00010000:0.0:1787893128.115365:0:9515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf134c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893128.115416:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481758080 00000100:00100000:3.0:1787893128.115422:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481758080 00000100:00100000:3.0:1787893128.115464:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 22 00000100:00100000:3.0:1787893128.115471:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+33:6162:x1874741481758080:12345-192.168.202.35@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787893128.115718:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+34:6162:x1874741481758080:12345-192.168.202.35@tcp:35:ldlm_bl.0 Request processed in 247us (501us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1787893128.115723:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 22 00000100:00100000:2.0:1787893128.117849:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893128.117937:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481758208 00000100:00100000:1.0:1787893128.117946:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481758208 00010000:00010000:1.0:1787893128.117982:0:6490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf12e3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa82f expref: 34 pid: 9515 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893128.118022:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 66 00000100:00100000:1.0:1787893128.118042:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+34:2391:x1874741481758208:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893128.118053:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893128.118060:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf12e3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa82f expref: 34 pid: 9515 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.118091:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf12e3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa82f expref: 34 pid: 9515 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.118113:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf12e3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa82f expref: 34 pid: 9515 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.118150:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c6614000) 00010000:00010000:1.0:1787893128.118156:0:6490:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf134c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.118165:0:6490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf134c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.118173:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf134c lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.118205:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893128.118258:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+33:2391:x1874741481758208:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 218us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893128.118265:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 66 00010000:00010000:0.0:1787893128.118338:0:9515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf134c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.118346:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf134c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.118383:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf134c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.118390:0:9515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf134c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.118396:0:9515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf134c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.118402:0:9515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893128.118405:0:9515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf134c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.118413:0:9515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf134c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.118422:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c6614000) 00010000:00010000:0.0:1787893128.118431:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787893128.118434:0:9515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf134c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.118439:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf134c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893128.118475:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+32:11333:x1874741481757824:12345-192.168.202.35@tcp:54:lfs.0 Request processed in 8418us (8580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893128.118483:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 104 00000100:00100000:2.0:1787893128.121295:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893128.121384:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481758464 00000100:00100000:3.0:1787893128.121394:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481758464 00000100:00100000:3.0:1787893128.121449:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 23 00000100:00100000:3.0:1787893128.121460:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+32:11333:x1874741481758464:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:3.0:1787893128.121701:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+33:11333:x1874741481758464:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 243us (414us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1787893128.121708:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 23 00000100:00100000:3.0:1787893128.219572:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893128.219681:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481758720 00000100:00100000:1.0:1787893128.219691:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481758720 00000100:00100000:1.0:1787893128.219755:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 105 00000100:00100000:1.0:1787893128.219766:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+33:11344:x1874741481758720:12345-192.168.202.35@tcp:101:cat.0 00010000:00010000:1.0:1787893128.219791:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893128.219812:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf1353 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa852 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.219906:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf135a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.219920:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf135a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.219934:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf135a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.219949:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf1361 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.219956:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf1361 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.219962:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf1361 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.220086:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf1368 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.220096:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf1368 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.220103:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf1368 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893128.220113:0:6504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:1.0:1787893128.220200:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf135a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.220208:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf135a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.220223:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf135a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.220228:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe541a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893128.220233:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf135a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.220240:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf135a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.220253:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc9d0fd6700) 00010000:00010000:1.0:1787893128.220257:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893128.220261:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf135a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.220267:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf135a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.220280:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf1361 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.220286:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf1361 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.220291:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf1361 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.220296:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893128.220298:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf1361 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.220312:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf1361 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.220319:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc9c3918000) 00010000:00010000:1.0:1787893128.220321:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893128.220324:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf1361 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.220329:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf1361 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.220362:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf1353 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa852 expref: 36 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.220373:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf1368 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa852 expref: 35 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.220380:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c6614000) 00010000:00010000:1.0:1787893128.220382:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787893128.220384:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe541200, rc 0) 00000100:00100000:1.0:1787893128.220442:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+35:11344:x1874741481758720:12345-192.168.202.35@tcp:101:cat.0 Request processed in 679us (881us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1787893128.220449:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 105 00000100:00100000:2.0:1787893128.231023:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893128.231120:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481758976 00000100:00100000:3.0:1787893128.231129:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481758976 00000100:00100000:3.0:1787893128.231199:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 24 00000100:00100000:3.0:1787893128.231210:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+35:11344:x1874741481758976:12345-192.168.202.35@tcp:35:cat.0 00000100:00100000:3.0:1787893128.231539:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+36:11344:x1874741481758976:12345-192.168.202.35@tcp:35:cat.0 Request processed in 330us (525us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1787893128.231546:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 24 00000100:00100000:3.0:1787893128.254857:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893128.255020:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481759232 00000100:00100000:0.0:1787893128.255039:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481759232 00000100:00100000:0.0:1787893128.255101:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 106 00000100:00100000:0.0:1787893128.255112:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+36:11345:x1874741481759232:12345-192.168.202.35@tcp:36:rm.0 00010000:00010000:0.0:1787893128.255179:0:13436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1787893128.255206:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf1306 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa83d expref: 36 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.255229:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf1368 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa852 expref: 35 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.255242:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf133e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa84b expref: 34 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.255254:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf12f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa836 expref: 33 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.255265:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c6614000) 00010000:00010000:0.0:1787893128.255284:0:13436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787893128.255306:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1376 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.255318:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1376 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.255327:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1376 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.255341:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf137d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.255348:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf137d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.255354:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf137d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.255430:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1384 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.255439:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1384 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.255445:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1384 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787893128.255824:0:13436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1787893128.255836:0:13436:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 372077343809ns, next at 373077341001ns, rc = 0 00010000:00010000:0.0:1787893128.255881:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf138b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.255900:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf138b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.255908:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf138b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.255916:0:13436:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf138b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.255922:0:13436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf138b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.255928:0:13436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf138b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.255954:0:13436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787893128.255972:0:13436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1384 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.255978:0:13436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1384 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.255984:0:13436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1384 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.255990:0:13436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893128.255995:0:13436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1384 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.256002:0:13436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1384 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.256022:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c6614000) 00010000:00010000:0.0:1787893128.256035:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787893128.256039:0:13436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1384 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.256045:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1384 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.256062:0:13436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1376 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.256067:0:13436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1376 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.256072:0:13436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1376 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.256077:0:13436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893128.256080:0:13436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1376 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.256085:0:13436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1376 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.256093:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc9d0fd6700) 00010000:00010000:0.0:1787893128.256095:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893128.256098:0:13436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1376 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.256103:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1376 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787893128.256122:0:13436:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003fa893d2 reply state 000000009af894e3 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf137d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.256133:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf137d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.256390:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc8c751ac00) 00010000:00010000:0.0:1787893128.256393:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787893128.256396:0:13436:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787893128.256705:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+34:11345:x1874741481759232:12345-192.168.202.35@tcp:36:rm.0 Request processed in 1592us (1855us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1787893128.256714:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 106 00010000:00010000:1.0:1787893128.256851:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893128.256859:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf138b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.256865:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31c00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:1.0:1787893128.256876:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf138b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.256883:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf138b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.256892:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c6614000) 00010000:00010000:1.0:1787893128.256894:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787893128.256897:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf138b lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.256901:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf138b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.256912:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893128.256914:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893128.256916:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893128.311410:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893128.311608:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481759488 00000100:00100000:2.0:1787893128.311618:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481759488 00000100:00100000:2.0:1787893128.311804:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 107 00000100:00100000:2.0:1787893128.311816:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+34:11351:x1874741481759488:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:2.0:1787893128.311840:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893128.311861:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fe00/0x9232577658cf1392 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa859 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.311963:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf1399 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.311977:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf1399 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.311987:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf1399 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.311998:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf13a0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.312022:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf13a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.312040:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf13a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787893128.312419:0:6506:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:2.0:1787893128.313006:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fc00/0x9232577658cf13a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.313018:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fc00/0x9232577658cf13a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.313038:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fc00/0x9232577658cf13a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.313070:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf1399 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.313077:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf1399 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.313084:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf1399 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.313090:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7e400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893128.313094:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf1399 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.313101:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf1399 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.313126:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc9d0fd6700) 00010000:00010000:2.0:1787893128.313129:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893128.313133:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf1399 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.313150:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf1399 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787893128.313163:0:6506:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000053abe992 reply state 00000000d44b7a69 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf13a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.313173:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf13a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.313180:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc8c751ac00) 00010000:00010000:2.0:1787893128.313181:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787893128.313184:0:6506:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787893128.313213:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fe00/0x9232577658cf1392 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa859 expref: 37 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.313227:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fc00/0x9232577658cf13a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa859 expref: 36 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.313234:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:2.0:1787893128.313236:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787893128.313239:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7fc00, rc 0) 00000100:00100000:2.0:1787893128.313606:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+37:11351:x1874741481759488:12345-192.168.202.35@tcp:101:bash.0 Request processed in 1792us (2205us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1787893128.313615:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 107 00000100:00100000:2.0:1787893128.318730:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893128.318821:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481759616 00000100:00100000:3.0:1787893128.318831:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481759616 00000100:00100000:3.0:1787893128.318965:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 42 00000100:00100000:3.0:1787893128.318976:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58232959-285a-4954-a3ac-571a2b817017+7:2391:x1874741481759616:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:3.0:1787893128.318992:0:8419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893128.319012:0:8419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000529ff7e3/0x9232577658cf13b5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa860 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787893128.319046:0:8419:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787893128.319065:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=372s v=(0 0) 00010000:00010000:3.0:1787893128.319070:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893128.319079:0:8419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000529ff7e3/0x9232577658cf13b5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa860 expref: 8 pid: 8419 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893128.319099:0:8419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000529ff7e3/0x9232577658cf13b5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa860 expref: 8 pid: 8419 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893128.319113:0:8419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c771ee00, rc 0) 00000100:00080000:0.0:1787893128.319243:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787893128.319312:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58232959-285a-4954-a3ac-571a2b817017+8:2391:x1874741481759616:12345-192.168.202.35@tcp:101:bash.0 Request processed in 337us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893128.319319:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 42 00000100:00100000:3.0:1787893128.322627:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893128.322781:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481759744 00000100:00100000:1.0:1787893128.322791:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481759744 00000100:00100000:1.0:1787893128.322852:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 43 00000100:00100000:1.0:1787893128.322862:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58232959-285a-4954-a3ac-571a2b817017+8:11351:x1874741481759744:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:1.0:1787893128.322880:0:8535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893128.322898:0:8535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef0c62e5/0x9232577658cf13bc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa867 expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.322928:0:8535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000529ff7e3/0x9232577658cf13b5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa860 expref: 9 pid: 8419 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.322935:0:8535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893128.322952:0:8535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893128.322958:0:8535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef0c62e5/0x9232577658cf13bc lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa867 expref: 9 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.322991:0:8535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000529ff7e3/0x9232577658cf13b5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa860 expref: 9 pid: 8419 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.323004:0:8535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000529ff7e3/0x9232577658cf13b5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa860 expref: 9 pid: 8419 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893128.323018:0:8535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7fded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8535:1874741493374720:192.168.202.35@tcp:104: 00000100:00100000:1.0:1787893128.323117:0:8535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c73f93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787893128.326118:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893128.326287:0:8535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7fded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8535:1874741493374720:192.168.202.35@tcp:104: 00010000:00010000:1.0:1787893128.326320:0:8535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ef0c62e5/0x9232577658cf13bc lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa867 expref: 9 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.326339:0:8535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe540a00, rc 0) 00000100:00100000:1.0:1787893128.326405:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58232959-285a-4954-a3ac-571a2b817017+9:11351:x1874741481759744:12345-192.168.202.35@tcp:101:bash.0 Request processed in 3544us (3789us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893128.326415:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 43 00000100:00100000:3.0:1787893128.326950:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481759872 00000100:00100000:3.0:1787893128.326957:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481759872 00010000:00010000:3.0:1787893128.326991:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000529ff7e3/0x9232577658cf13b5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa860 expref: 9 pid: 8419 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893128.327037:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 67 00000100:00100000:3.0:1787893128.327046:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58232959-285a-4954-a3ac-571a2b817017+9:2390:x1874741481759872:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893128.327058:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893128.327079:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000529ff7e3/0x9232577658cf13b5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa860 expref: 9 pid: 8419 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893128.327091:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000529ff7e3/0x9232577658cf13b5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa860 expref: 9 pid: 8419 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893128.327115:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000529ff7e3/0x9232577658cf13b5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa860 expref: 9 pid: 8419 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893128.327129:0:6492:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893128.327133:0:6492:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893128.327153:0:6492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ef0c62e5/0x9232577658cf13bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa867 expref: 8 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893128.327164:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef0c62e5/0x9232577658cf13bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa867 expref: 8 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893128.327221:0:6492:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ef0c62e5/0x9232577658cf13bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa867 expref: 8 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893128.327236:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6492:1874741493374848:192.168.202.35@tcp:105: 00000100:00100000:3.0:1787893128.327312:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c70b8900 going to sleep for 11 seconds 00000100:00100000:0.0:1787893128.337534:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893128.337688:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6492:1874741493374848:192.168.202.35@tcp:105: 00010000:00010000:3.0:1787893128.337716:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893128.337777:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58232959-285a-4954-a3ac-571a2b817017+8:2390:x1874741481759872:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 10731us (11667us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893128.337789:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 67 00000100:00100000:1.0:1787893128.337885:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481760128 00000100:00100000:1.0:1787893128.337892:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481760128 00000100:00100000:1.0:1787893128.337941:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 25 00000100:00100000:1.0:1787893128.337950:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+37:11351:x1874741481760128:12345-192.168.202.35@tcp:35:bash.0 00000100:00100000:1.0:1787893128.338218:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+38:11351:x1874741481760128:12345-192.168.202.35@tcp:35:bash.0 Request processed in 269us (732us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1787893128.338239:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 25 00000001:00080000:1.0:1787893128.371384:0:8413:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:1.0:1787893128.371399:0:8413:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:0.0:1787893128.524423:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893128.524533:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481760256 00000100:00100000:1.0:1787893128.524544:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481760256 00000100:00100000:1.0:1787893128.524609:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 108 00000100:00100000:1.0:1787893128.524620:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+38:11367:x1874741481760256:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:1.0:1787893128.524646:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893128.524667:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf13c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa86e expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.524726:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf13ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.524738:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf13ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.524748:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf13ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893128.524802:0:6504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1787893128.524806:0:6504:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787893128.524826:0:6504:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf13ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.524851:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf13c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa86e expref: 40 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.524869:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf13ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa86e expref: 39 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.524890:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc9d0fd6700) 00010000:00010000:1.0:1787893128.524893:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787893128.524896:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe541c00, rc 0) 00000100:00100000:1.0:1787893128.525107:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+39:11367:x1874741481760256:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 488us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893128.525115:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 108 00000100:00100000:2.0:1787893128.532170:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893128.532297:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481760512 00000100:00100000:3.0:1787893128.532308:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481760512 00000100:00100000:3.0:1787893128.532374:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 109 00000100:00100000:3.0:1787893128.532386:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+39:11367:x1874741481760512:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:3.0:1787893128.532408:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893128.532431:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf13d1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa875 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893128.532594:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf13d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893128.532607:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf13d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893128.532618:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf13d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893128.532646:0:6505:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787893128.532754:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf13d1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa875 expref: 42 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893128.532784:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf13d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa875 expref: 41 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893128.532793:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:3.0:1787893128.532796:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787893128.532799:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c771fa00, rc 0) 00000100:00100000:3.0:1787893128.532855:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+41:11367:x1874741481760512:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 472us (695us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1787893128.532861:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 109 00000100:00100000:0.0:1787893128.538343:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893128.538423:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481760896 00000100:00100000:1.0:1787893128.538434:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481760896 00000100:00100000:1.0:1787893128.538535:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 7 00000100:00100000:1.0:1787893128.538547:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+41:2391:x1874741481760896:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893128.538561:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893128.538587:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf13d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa875 expref: 41 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.538620:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:1.0:1787893128.538625:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893128.538696:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+40:2391:x1874741481760896:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 151us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893128.538703:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 7 00000100:00100000:1.0:1787893128.540957:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893128.541289:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481760768 00000100:00100000:0.0:1787893128.541300:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481760768 00000100:00100000:0.0:1787893128.541369:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 110 00000100:00100000:0.0:1787893128.541379:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+40:11367:x1874741481760768:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787893128.541402:0:9515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893128.541423:0:9515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf13e6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa87c expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.541797:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf13ed lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.541829:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf13ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.541840:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf13ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893128.541854:0:9515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787893128.541961:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf13e6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa87c expref: 43 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.541979:0:9515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf13ed lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa87c expref: 42 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.541989:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:0.0:1787893128.541992:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787893128.541996:0:9515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb30800, rc 0) 00000100:00100000:0.0:1787893128.542103:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+42:11367:x1874741481760768:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 724us (1155us total) trans 4294967381 rc 0/0 00000100:00100000:0.0:1787893128.542110:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 110 00000100:00100000:3.0:1787893128.549284:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893128.549371:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481761024 00000100:00100000:1.0:1787893128.549382:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481761024 00000100:00100000:1.0:1787893128.549461:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 44 00000100:00100000:1.0:1787893128.549470:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+6:2393:x1874741481761024:12345-192.168.202.35@tcp:1:lfs.0 00010000:00010000:1.0:1787893128.549611:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e659e5a0/0x9232577658cf13fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.549643:0:8420:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ef0c62e5/0x9232577658cf13bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa867 expref: 6 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.549651:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893128.549656:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787893128.549661:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e659e5a0/0x9232577658cf13fb lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.549693:0:8420:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ef0c62e5/0x9232577658cf13bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa867 expref: 6 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.549706:0:8420:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ef0c62e5/0x9232577658cf13bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa867 expref: 6 pid: 8535 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893128.549721:0:8420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7fdd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8420:1874741493374976:192.168.202.35@tcp:104: 00000100:00100000:1.0:1787893128.549831:0:8420:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c73f9900 going to sleep for 11 seconds 00000100:00100000:3.0:1787893128.552266:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893128.552382:0:8420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7fdd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8420:1874741493374976:192.168.202.35@tcp:104: 00010000:00010000:2.0:1787893128.552406:0:8420:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e659e5a0/0x9232577658cf13fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893128.552472:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481761152 00000100:00100000:0.0:1787893128.552479:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481761152 00002000:00100000:0.0:1787893128.552554:0:8426:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9fc9e711f800 x1874741481761152/t0(0) o4->58232959-285a-4954-a3ac-571a2b817017@192.168.202.35@tcp:289/0 lens 504/0 e 0 to 0 dl 1787893139 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787893128.552563:0:8426:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc9e711f800 with x1874741481761152 ext(0->8) 00010000:00010000:0.0:1787893128.552570:0:8426:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ef0c62e5/0x9232577658cf13bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa867 expref: 7 pid: 8535 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.552598:0:8426:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ef0c62e5/0x9232577658cf13bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa867 expref: 7 pid: 8535 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787893128.552606:0:8426:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9fc9e711f800 00000100:00100000:0.0:1787893128.552635:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 1 00000100:00100000:0.0:1787893128.552643:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:58232959-285a-4954-a3ac-571a2b817017+7:2390:x1874741481761152:12345-192.168.202.35@tcp:4:lfs.0 00000100:00100000:0.0:1787893128.553905:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:58232959-285a-4954-a3ac-571a2b817017+9:2390:x1874741481761152:12345-192.168.202.35@tcp:4:lfs.0 Request processed in 1255us (1641us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787893128.553916:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 1 00002000:00100000:0.0:1787893128.553925:0:8426:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9fc9e711f800 x1874741481761152/t4294967303(0) o4->58232959-285a-4954-a3ac-571a2b817017@192.168.202.35@tcp:289/0 lens 504/448 e 0 to 0 dl 1787893139 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787893128.553935:0:8426:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc9e711f800 with x1874741481761152 ext(0->8) 00010000:00010000:0.0:1787893128.553943:0:8426:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ef0c62e5/0x9232577658cf13bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa867 expref: 9 pid: 8535 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.553958:0:8426:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ef0c62e5/0x9232577658cf13bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa867 expref: 9 pid: 8535 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787893128.553965:0:8426:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9fc9e711f800 00000100:00100000:0.0:1787893128.560950:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893128.561062:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481761280 00000100:00100000:2.0:1787893128.561072:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481761280 00010000:00010000:2.0:1787893128.561112:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ef0c62e5/0x9232577658cf13bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa867 expref: 9 pid: 8535 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893128.561163:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 68 00000100:00100000:2.0:1787893128.561174:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3efc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58232959-285a-4954-a3ac-571a2b817017+9:2391:x1874741481761280:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787893128.561188:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787893128.561206:0:6491:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787893128.561209:0:6491:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787893128 00002000:00010000:2.0:1787893128.561212:0:6491:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787893128 00002000:00010000:2.0:1787893128.561214:0:6491:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1787893128 00002000:00010000:2.0:1787893128.561216:0:6491:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1787893128.561223:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ef0c62e5/0x9232577658cf13bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa867 expref: 9 pid: 8535 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.561238:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ef0c62e5/0x9232577658cf13bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa867 expref: 9 pid: 8535 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.561261:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef0c62e5/0x9232577658cf13bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa867 expref: 9 pid: 8535 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.561291:0:6491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787893128.561295:0:6491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787893128.561301:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e659e5a0/0x9232577658cf13fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.561311:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e659e5a0/0x9232577658cf13fb lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.561350:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893128.561405:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3efc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58232959-285a-4954-a3ac-571a2b817017+8:2391:x1874741481761280:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 233us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893128.561413:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 68 00010000:00010000:1.0:1787893128.561960:0:8420:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e659e5a0/0x9232577658cf13fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.561970:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e659e5a0/0x9232577658cf13fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.561992:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e659e5a0/0x9232577658cf13fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.562013:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e659e5a0/0x9232577658cf13fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.562021:0:8420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e659e5a0/0x9232577658cf13fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.562037:0:8420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540e00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:1.0:1787893128.562041:0:8420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e659e5a0/0x9232577658cf13fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.562049:0:8420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e659e5a0/0x9232577658cf13fb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.562062:0:8420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e659e5a0/0x9232577658cf13fb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.562068:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e659e5a0/0x9232577658cf13fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893128.562135:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+7:2393:x1874741481761024:12345-192.168.202.35@tcp:1:lfs.0 Request processed in 12665us (12860us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893128.562151:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 44 00000100:00100000:0.0:1787893128.566392:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893128.566821:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481761536 00000100:00100000:1.0:1787893128.566832:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481761536 00000100:00100000:0.0:1787893128.567010:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 26 00000100:00100000:0.0:1787893128.567029:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5feec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+42:11367:x1874741481761536:12345-192.168.202.35@tcp:35:lfs.0 00000004:00010000:0.0:1787893128.567113:0:6507:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf13ed lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa87c expref: 42 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787893128.567311:0:6507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:0.0:1787893128.567345:0:6507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1787893128.568020:0:6507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:0.0:1787893128.568330:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1402 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.568348:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fc00/0x9232577658cf13a7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa859 expref: 46 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.568356:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1402 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.568395:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fc00/0x9232577658cf13a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa859 expref: 46 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.568409:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fc00/0x9232577658cf13a7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa859 expref: 46 pid: 6506 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893128.568423:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6507:1874741493375104:192.168.202.35@tcp:104: 00000100:00100000:0.0:1787893128.568786:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d023cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787893128.572557:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893128.572937:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481761664 00000100:00100000:1.0:1787893128.572960:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481761664 00010000:00010000:1.0:1787893128.572998:0:6490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fc00/0x9232577658cf13a7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa859 expref: 47 pid: 6506 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893128.573046:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 69 00000100:00100000:1.0:1787893128.573057:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+47:2390:x1874741481761664:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893128.573070:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893128.573076:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fc00/0x9232577658cf13a7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa859 expref: 47 pid: 6506 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.573089:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fc00/0x9232577658cf13a7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa859 expref: 47 pid: 6506 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.573110:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:1.0:1787893128.573116:0:6490:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1402 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.573125:0:6490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1402 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.573132:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1402 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.573161:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893128.573263:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+47:2390:x1874741481761664:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 207us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893128.573271:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 69 00010000:00010000:0.0:1787893128.573877:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fc00/0x9232577658cf13a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa859 expref: 46 pid: 6506 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893128.573896:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6507:1874741493375104:192.168.202.35@tcp:104: 00010000:00010000:0.0:1787893128.573921:0:6507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1402 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.573942:0:6507:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1402 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.573948:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1402 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787893128.574059:0:6507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:0.0:1787893128.574249:0:6507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:0.0:1787893128.574339:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6507:1874741493375232:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787893128.574393:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893128.574465:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d7e300 going to sleep for 11 seconds 00000100:00100000:1.0:1787893128.575932:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493375232 00000100:00100000:1.0:1787893128.575945:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493375232 00000100:00100000:1.0:1787893128.576055:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787893128.576065:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6507:x1874741493375232:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787893128.576206:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6507:x1874741493375232:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 141us (1811us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893128.576213:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787893128.576281:0:6507:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:3.0:1787893128.576286:0:6507:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:3.0:1787893128.576308:0:6507:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fc9d15cb480, transno 4294967302 00000100:00100000:3.0:1787893128.576328:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6507:1874741493375232:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787893128.576443:0:6507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:3.0:1787893128.576538:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6507:1874741493375360:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787893128.576570:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893128.576960:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c70b8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787893128.577063:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493375360 00000100:00100000:0.0:1787893128.577069:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493375360 00000100:00100000:0.0:1787893128.577094:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787893128.577100:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6507:x1874741493375360:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787893128.577218:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6507:x1874741493375360:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 117us (647us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787893128.577225:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787893128.577289:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6507:1874741493375360:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787893128.577328:0:6507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:3.0:1787893128.577368:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1402 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893128.577378:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1402 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893128.577385:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1402 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893128.577391:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893128.577395:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1402 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893128.577402:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1402 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893128.577417:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:3.0:1787893128.577420:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787893128.577424:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1402 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893128.577430:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1402 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787893128.577534:0:6507:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787893128.577577:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1787893128.577586:0:6507:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 372399094384ns, next at 373399092989ns, rc = 0 00000001:00080000:3.0:1787893128.577591:0:6507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:3.0:1787893128.577609:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:3.0:1787893128.577612:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787893128.577618:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf13ed lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa87c expref: 50 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893128.577709:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5feec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+49:11367:x1874741481761536:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 10689us (11326us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1787893128.577716:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 26 00000020:00080000:3.0:1787893128.577719:0:6507:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787893128.581043:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893128.581239:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481761792 00000100:00100000:1.0:1787893128.581248:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481761792 00000100:00100000:1.0:1787893128.581306:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 111 00000100:00100000:1.0:1787893128.581315:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+49:11367:x1874741481761792:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:1.0:1787893128.581338:0:10086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893128.581361:0:10086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1409 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa883 expref: -99 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.581416:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1409 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa883 expref: 50 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.581431:0:10086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1409 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa883 expref: 50 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.581447:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc9c3918e00) 00010000:00010000:1.0:1787893128.581450:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787893128.581453:0:10086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe540e00, rc 0) 00000100:00100000:1.0:1787893128.581685:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+50:11367:x1874741481761792:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 370us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893128.581691:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 111 00000100:00100000:0.0:1787893128.585575:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893128.585702:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481762048 00000100:00100000:3.0:1787893128.585710:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481762048 00000100:00100000:3.0:1787893128.585755:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 27 00000100:00100000:3.0:1787893128.585763:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+50:11367:x1874741481762048:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:3.0:1787893128.585966:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+51:11367:x1874741481762048:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 202us (399us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1787893128.585973:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 27 00000100:00100000:3.0:1787893128.694597:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893128.694751:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481762176 00000100:00100000:0.0:1787893128.694762:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481762176 00000100:00100000:0.0:1787893128.694828:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 112 00000100:00100000:0.0:1787893128.694838:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7f6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+51:11377:x1874741481762176:12345-192.168.202.35@tcp:34:lfs.0 00010000:00010000:0.0:1787893128.694917:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1410 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.694934:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1410 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.694960:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1410 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.694973:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1417 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.694980:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1417 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.694986:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1417 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.695106:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf141e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.695116:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf141e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.695122:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf141e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787893128.695180:0:6505:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf141e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.695193:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1410 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.695199:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1410 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.695205:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1410 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.695220:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893128.695224:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1410 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.695231:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1410 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.695243:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc9d0fd6700) 00010000:00010000:0.0:1787893128.695246:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893128.695251:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1410 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.695257:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1410 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.695272:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1417 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.695278:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1417 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.695284:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1417 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.695289:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893128.695292:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1417 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.695297:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1417 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.695316:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc8c751ac00) 00010000:00010000:0.0:1787893128.695318:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893128.695320:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1417 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.695325:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1417 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.695334:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf141e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.695339:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf141e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.695343:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf141e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.695347:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893128.695349:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf141e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.695355:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf141e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.695361:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc9c3918e00) 00010000:00010000:0.0:1787893128.695363:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893128.695366:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf141e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.695371:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf141e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893128.695463:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7f6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+51:11377:x1874741481762176:12345-192.168.202.35@tcp:34:lfs.0 Request processed in 625us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893128.695471:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 112 00000100:00100000:1.0:1787893128.739654:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893128.739924:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481762432 00000100:00100000:2.0:1787893128.739934:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481762432 00000100:00100000:2.0:1787893128.740001:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 113 00000100:00100000:2.0:1787893128.740012:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+51:11380:x1874741481762432:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:2.0:1787893128.740040:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893128.740062:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1425 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa88a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.740136:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf142c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.740161:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf142c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.740190:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf142c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.740203:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf1433 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.740210:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf1433 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.740216:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf1433 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.740322:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf143a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.740330:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf143a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.740337:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf143a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893128.740346:0:6506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787893128.740422:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf142c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.740429:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf142c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.740436:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf142c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.740441:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7e200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893128.740452:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf142c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.740460:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf142c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.740472:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc9d0fd6700) 00010000:00010000:2.0:1787893128.740485:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893128.740530:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf142c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.740538:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf142c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.740552:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf1433 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.740558:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf1433 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.740565:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf1433 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.740570:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7e800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893128.740573:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf1433 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.740578:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf1433 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.740585:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc8c751ac00) 00010000:00010000:2.0:1787893128.740587:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893128.740596:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf1433 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.740602:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf1433 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.740637:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1425 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa88a expref: 54 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.740666:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf143a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa88a expref: 53 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893128.740673:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc9c3918e00) 00010000:00010000:2.0:1787893128.740675:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787893128.740677:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7e000, rc 0) 00000100:00100000:2.0:1787893128.740742:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+53:11380:x1874741481762432:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 732us (1105us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1787893128.740749:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 113 00000100:00100000:2.0:1787893128.744731:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893128.744840:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481762560 00000100:00100000:1.0:1787893128.744866:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481762560 00000100:00100000:1.0:1787893128.744932:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 114 00000100:00100000:1.0:1787893128.744942:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+53:11380:x1874741481762560:12345-192.168.202.35@tcp:54:lfs.0 00010000:00010000:1.0:1787893128.745015:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf1448 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.745040:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf1448 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.745051:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf1448 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.745086:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf1448 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.745093:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf1448 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.745099:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf1448 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.745105:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe541200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893128.745110:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf1448 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.745117:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf1448 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.745129:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc9c3918e00) 00010000:00010000:1.0:1787893128.745132:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787893128.745137:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf1448 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.745154:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf1448 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893128.745238:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+53:11380:x1874741481762560:12345-192.168.202.35@tcp:54:lfs.0 Request processed in 296us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893128.745245:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 114 00000100:00100000:3.0:1787893128.748747:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893128.748840:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481762816 00000100:00100000:0.0:1787893128.748850:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481762816 00000100:00100000:0.0:1787893128.748898:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 28 00000100:00100000:0.0:1787893128.748905:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7201f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+53:11380:x1874741481762816:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:0.0:1787893128.749147:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7201f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+54:11380:x1874741481762816:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 241us (407us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1787893128.749152:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 28 00000100:00100000:3.0:1787893128.857392:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893128.857525:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481763072 00000100:00100000:0.0:1787893128.857536:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481763072 00000100:00100000:0.0:1787893128.857603:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 115 00000100:00100000:0.0:1787893128.857615:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7203100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+54:11390:x1874741481763072:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:0.0:1787893128.857653:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893128.857657:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787893128.857686:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf13ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa86e expref: 54 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.857708:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc9d0fd6700) 00010000:00010000:0.0:1787893128.857714:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787893128.857727:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf144f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa891 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.857828:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1456 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.857853:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1456 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.857862:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1456 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893128.857873:0:6505:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787893128.857964:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf144f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa891 expref: 56 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.857979:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1456 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa891 expref: 55 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893128.857987:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc9c3918e00) 00010000:00010000:0.0:1787893128.857990:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787893128.857993:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb31c00, rc 0) 00000100:00100000:0.0:1787893128.858063:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7203100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+55:11390:x1874741481763072:12345-192.168.202.35@tcp:101:bash.0 Request processed in 450us (681us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1787893128.858070:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 115 00000100:00100000:2.0:1787893128.867364:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893128.867412:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893128.867531:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481763200 00000100:00100000:1.0:1787893128.867540:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481763200 00000100:00100000:1.0:1787893128.867596:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 116 00000100:00100000:1.0:1787893128.867605:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+55:11390:x1874741481763200:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:1.0:1787893128.867626:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893128.867645:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf1464 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa898 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.867677:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf146b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.867690:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf146b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.867701:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf146b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.867817:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf1464 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa898 expref: 57 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.867835:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf146b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa898 expref: 56 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.867855:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc9c3918e00) 00010000:00010000:1.0:1787893128.867859:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787893128.867863:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe540600, rc 0) 00000100:00100000:1.0:1787893128.867932:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+56:11390:x1874741481763200:12345-192.168.202.35@tcp:101:bash.0 Request processed in 328us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893128.867938:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 116 00000100:00100000:3.0:1787893128.868208:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481763328 00000100:00100000:3.0:1787893128.868214:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481763328 00000100:00100000:3.0:1787893128.868256:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 8 00000100:00100000:3.0:1787893128.868263:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58232959-285a-4954-a3ac-571a2b817017+56:2393:x1874741481763328:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893128.868272:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893128.868286:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1456 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa891 expref: 56 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893128.868297:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc9c3918e00) 00010000:00010000:3.0:1787893128.868301:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893128.868335:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58232959-285a-4954-a3ac-571a2b817017+55:2393:x1874741481763328:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 73us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893128.868342:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 8 00000100:00100000:2.0:1787893128.875905:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893128.876027:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481763584 00000100:00100000:1.0:1787893128.876037:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481763584 00000100:00100000:1.0:1787893128.876101:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 117 00000100:00100000:1.0:1787893128.876111:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+55:11390:x1874741481763584:12345-192.168.202.35@tcp:36:bash.0 00010000:00010000:1.0:1787893128.876314:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893128.876344:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf143a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa88a expref: 55 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.876363:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc9c3918e00) 00010000:00010000:1.0:1787893128.876368:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787893128.876690:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf1472 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.876705:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf1472 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.876715:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf1472 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787893128.876757:0:6504:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:1.0:1787893128.876780:0:6504:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cca60d82 reply state 0000000011c350fa transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf1472 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.876807:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf1472 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.876813:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc9c3918e00) 00010000:00010000:1.0:1787893128.876815:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787893128.876818:0:6504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787893128.876967:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+57:11390:x1874741481763584:12345-192.168.202.35@tcp:36:bash.0 Request processed in 856us (1070us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1787893128.876974:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 117 00000020:00080000:1.0:1787893128.876978:0:6504:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787893128.881896:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893128.882278:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493375488:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787893128.882347:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893128.882632:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493375488 00000100:00100000:0.0:1787893128.882647:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493375488 00000100:00100000:0.0:1787893128.882703:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787893128.882715:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493375488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787893128.882751:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787893128.882853:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493375488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 139us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893128.882861:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787893128.884012:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893128.884215:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481763712 00000100:00100000:3.0:1787893128.884223:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481763712 00000100:00100000:3.0:1787893128.884314:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 118 00000100:00100000:3.0:1787893128.884325:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+57:11390:x1874741481763712:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:3.0:1787893128.884345:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893128.884367:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771e400/0x9232577658cf1479 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa89f expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893128.884457:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf1480 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893128.884471:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf1480 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893128.884520:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf1480 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893128.884552:0:6505:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787893128.884556:0:6505:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787893128.884574:0:6505:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf1480 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893128.884599:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771e400/0x9232577658cf1479 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa89f expref: 59 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893128.884626:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf1480 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa89f expref: 58 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893128.884650:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc9c3918e00) 00010000:00010000:3.0:1787893128.884653:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787893128.884657:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c771ee00, rc 0) 00000100:00100000:3.0:1787893128.884717:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+58:11390:x1874741481763712:12345-192.168.202.35@tcp:101:bash.0 Request processed in 394us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893128.884724:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 118 00000100:00100000:2.0:1787893128.885107:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493375488:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787893128.889458:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893128.889662:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481763968 00000100:00100000:0.0:1787893128.889673:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481763968 00000100:00100000:0.0:1787893128.889728:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 29 00000100:00100000:0.0:1787893128.889738:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+58:11390:x1874741481763968:12345-192.168.202.35@tcp:35:bash.0 00000100:00100000:0.0:1787893128.889947:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+59:11390:x1874741481763968:12345-192.168.202.35@tcp:35:bash.0 Request processed in 210us (498us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1787893128.889955:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 29 00000100:00100000:0.0:1787893128.986176:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893128.986376:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481764096 00000100:00100000:1.0:1787893128.986385:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481764096 00000100:00100000:1.0:1787893128.986435:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 119 00000100:00100000:1.0:1787893128.986442:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+59:11396:x1874741481764096:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:1.0:1787893128.986461:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893128.986486:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf1487 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa8a6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.986576:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf148e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.986585:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf148e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.986594:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf148e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893128.986652:0:6506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1787893128.986656:0:6506:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787893128.986674:0:6506:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf148e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.986698:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf1487 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8a6 expref: 61 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.986715:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf148e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8a6 expref: 60 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.986724:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc9d0fd6700) 00010000:00010000:1.0:1787893128.986726:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787893128.986729:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe541c00, rc 0) 00000100:00100000:1.0:1787893128.986793:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+60:11396:x1874741481764096:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 350us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893128.986800:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 119 00000100:00100000:2.0:1787893128.992571:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893128.992818:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481764224 00000100:00100000:1.0:1787893128.992831:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481764224 00000100:00100000:1.0:1787893128.992892:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 120 00000100:00100000:1.0:1787893128.992902:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+60:11396:x1874741481764224:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:1.0:1787893128.992923:0:10086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893128.992943:0:10086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf1495 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa8ad expref: -99 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.993005:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf149c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.993046:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf149c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.993057:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf149c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.993070:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf14a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.993077:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf14a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.993083:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf14a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.993169:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728c00/0x9232577658cf14aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.993178:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728c00/0x9232577658cf14aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.993185:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728c00/0x9232577658cf14aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893128.993227:0:10086:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787893128.993231:0:10086:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787893128.993247:0:10086:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728c00/0x9232577658cf14aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.993259:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728c00/0x9232577658cf14aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.993279:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf149c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.993285:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf149c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.993291:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf149c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.993297:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe541a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893128.993301:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf149c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.993308:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf149c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.993319:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc9d0fd6700) 00010000:00010000:1.0:1787893128.993322:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893128.993326:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf149c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.993331:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf149c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.993343:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf14a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.993349:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf14a3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.993353:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf14a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.993366:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893128.993369:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf14a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.993374:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf14a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.993382:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc8c751ac00) 00010000:00010000:1.0:1787893128.993384:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893128.993386:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf14a3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.993392:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf14a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.993416:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf1495 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8ad expref: 62 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.993429:0:10086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728c00/0x9232577658cf14aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8ad expref: 61 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.993435:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc9c3918e00) 00010000:00010000:1.0:1787893128.993437:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787893128.993440:0:10086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9dd728c00, rc 0) 00000100:00100000:1.0:1787893128.993891:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+61:11396:x1874741481764224:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 988us (1328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893128.993898:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 120 00000100:00100000:3.0:1787893128.999252:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893128.999327:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481764480 00000100:00100000:1.0:1787893128.999348:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481764480 00000100:00100000:1.0:1787893128.999410:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 121 00000100:00100000:1.0:1787893128.999420:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7202a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+61:11396:x1874741481764480:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:1.0:1787893128.999440:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893128.999460:0:13436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729a00/0x9232577658cf14b1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa8b4 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.999623:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf14b8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.999637:0:13436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf1480 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa89f expref: 62 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.999645:0:13436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728c00/0x9232577658cf14aa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8ad expref: 62 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.999652:0:13436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf14b8 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.999688:0:13436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728c00/0x9232577658cf14aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8ad expref: 62 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.999702:0:13436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728c00/0x9232577658cf14aa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8ad expref: 62 pid: 10086 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893128.999715:0:13436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7fdd500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13436:1874741493375616:192.168.202.35@tcp:104: 00010000:00010000:1.0:1787893128.999816:0:13436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf1480 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa89f expref: 62 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893128.999839:0:13436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf1480 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa89f expref: 62 pid: 6505 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893128.999849:0:13436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7fdfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13436:1874741493375744:192.168.202.35@tcp:104: 00000100:00100000:1.0:1787893128.999876:0:13436:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c73f96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787893129.004432:0:13436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7fdd500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13436:1874741493375616:192.168.202.35@tcp:104: 00000100:00100000:3.0:1787893129.005730:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893129.005952:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481764608 00000100:00100000:1.0:1787893129.005961:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481764608 00010000:00010000:1.0:1787893129.006031:0:6490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728c00/0x9232577658cf14aa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8ad expref: 63 pid: 10086 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893129.006073:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 70 00000100:00100000:1.0:1787893129.006084:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7201500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+63:2391:x1874741481764608:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893129.006096:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893129.006104:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728c00/0x9232577658cf14aa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8ad expref: 63 pid: 10086 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.006116:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728c00/0x9232577658cf14aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8ad expref: 63 pid: 10086 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.006137:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728c00/0x9232577658cf14aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8ad expref: 63 pid: 10086 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.006155:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc9c3918e00) 00010000:00010000:1.0:1787893129.006159:0:6490:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf14b8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.006177:0:6490:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf14b8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.006183:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893129.006244:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7201500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+62:2391:x1874741481764608:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 161us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893129.006252:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 70 00000100:00080000:0.0:1787893129.006380:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787893129.011002:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893129.011114:0:13436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7fdfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13436:1874741493375744:192.168.202.35@tcp:104: 00010000:00010000:1.0:1787893129.011153:0:13436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf14b8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893129.011408:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481764736 00000100:00100000:3.0:1787893129.011416:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481764736 00010000:00010000:3.0:1787893129.011454:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf1480 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa89f expref: 62 pid: 6505 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893129.011605:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 71 00000100:00100000:1.0:1787893129.011615:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d017f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58232959-285a-4954-a3ac-571a2b817017+62:2392:x1874741481764736:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893129.011629:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893129.011637:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf1480 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa89f expref: 62 pid: 6505 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.011660:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf1480 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa89f expref: 62 pid: 6505 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.011682:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf1480 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa89f expref: 62 pid: 6505 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.011711:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc9c3918e00) 00010000:00010000:1.0:1787893129.011716:0:6492:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf14b8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.011744:0:6492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf14b8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.011752:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf14b8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.011771:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893129.011828:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d017f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58232959-285a-4954-a3ac-571a2b817017+61:2392:x1874741481764736:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 214us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893129.011835:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 71 00010000:00010000:0.0:1787893129.013539:0:13436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf14b8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.013556:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf14b8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893129.013581:0:13436:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787893129.013740:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729a00/0x9232577658cf14b1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8b4 expref: 62 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.013761:0:13436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf14b8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8b4 expref: 61 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.013770:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc9c3918e00) 00010000:00010000:0.0:1787893129.013773:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787893129.013775:0:13436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9dd729200, rc 0) 00000100:00100000:0.0:1787893129.013856:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7202a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+61:11396:x1874741481764480:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 14437us (14612us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1787893129.013881:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 121 00000100:00100000:0.0:1787893129.018149:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893129.018359:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481764992 00000100:00100000:1.0:1787893129.018367:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481764992 00000100:00100000:1.0:1787893129.018529:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 9 00000100:00100000:1.0:1787893129.018540:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d017dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+61:11396:x1874741481764992:12345-192.168.202.35@tcp:103:lfs.0 00010000:00010000:1.0:1787893129.018554:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893129.018578:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1409 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa883 expref: 61 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.018597:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc9c3918e00) 00010000:00010000:1.0:1787893129.018602:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893129.018667:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d017dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+60:11396:x1874741481764992:12345-192.168.202.35@tcp:103:lfs.0 Request processed in 128us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893129.018675:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 9 00000100:00100000:3.0:1787893129.020872:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893129.020962:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481765120 00000100:00100000:0.0:1787893129.020972:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481765120 00000100:00100000:0.0:1787893129.021042:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 122 00000100:00100000:0.0:1787893129.021053:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7200380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+60:11396:x1874741481765120:12345-192.168.202.35@tcp:58:lfs.0 00010000:00010000:0.0:1787893129.021170:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf14c6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.021187:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf14c6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.021199:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf14c6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787893129.021311:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1787893129.021386:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7200380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+60:11396:x1874741481765120:12345-192.168.202.35@tcp:58:lfs.0 Request processed in 334us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893129.021394:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 122 00000100:00100000:0.0:1787893129.024886:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893129.025355:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481765248 00000100:00100000:3.0:1787893129.025366:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481765248 00000100:00100000:3.0:1787893129.025425:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 123 00000100:00100000:3.0:1787893129.025436:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d0f51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+60:11396:x1874741481765248:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:3.0:1787893129.025455:0:10086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893129.025484:0:10086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771e400/0x9232577658cf14cd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa8bb expref: -99 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.025932:0:10086:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf14c6 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.025944:0:10086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771e400/0x9232577658cf14cd lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8bb expref: 61 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.025980:0:10086:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf14c6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.025994:0:10086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771e400/0x9232577658cf14cd lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8bb expref: 61 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.026009:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc9c3918e00) 00010000:00010000:3.0:1787893129.026013:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787893129.026028:0:10086:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771e400/0x9232577658cf14cd lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8bb expref: 61 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.026038:0:10086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c771e400, rc 0) 00000100:00100000:3.0:1787893129.026206:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d0f51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+61:11396:x1874741481765248:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 772us (1332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893129.026213:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 123 00000040:00080000:2.0:1787893129.073753:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787893129.073763:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787893129.073789:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1787893129.073804:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787893129.073932:0:13786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7d49500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13786:1874741493375872:192.168.202.35@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787893129.074056:0:13786:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fe374e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787893129.083758:0:13786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7d49500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13786:1874741493375872:192.168.202.35@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787893129.089645:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893129.092881:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481765376 00000100:00100000:3.0:1787893129.092897:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481765376 00000100:00100000:3.0:1787893129.093056:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 124 00000100:00100000:3.0:1787893129.093069:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d0f53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+61:11397:x1874741481765376:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787893129.093102:0:6505:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787893129.093244:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d0f53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+61:11397:x1874741481765376:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 Request processed in 177us (3606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893129.093252:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 124 00000100:00100000:0.0:1787893129.100114:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893129.100297:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481765504 00000100:00100000:1.0:1787893129.100307:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481765504 00000100:00100000:1.0:1787893129.100415:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 125 00000100:00100000:1.0:1787893129.100426:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d0f50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+61:11397:x1874741481765504:12345-192.168.202.35@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787893129.100775:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728c00/0x9232577658cf14d4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.100791:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728c00/0x9232577658cf14d4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.100802:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728c00/0x9232577658cf14d4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.100819:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729a00/0x9232577658cf14db lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.100826:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729a00/0x9232577658cf14db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.100832:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729a00/0x9232577658cf14db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.100854:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf14e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.100863:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf14e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.100870:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf14e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893129.100915:0:6506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787893129.100919:0:6506:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787893129.100932:0:6506:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf14e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.100943:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728c00/0x9232577658cf14d4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.100956:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728c00/0x9232577658cf14d4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.100963:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728c00/0x9232577658cf14d4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.100969:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd728c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893129.100974:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728c00/0x9232577658cf14d4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.100981:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728c00/0x9232577658cf14d4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.100993:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fc9d5c29800) 00010000:00010000:1.0:1787893129.100996:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893129.101000:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728c00/0x9232577658cf14d4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.101007:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728c00/0x9232577658cf14d4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.101033:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729a00/0x9232577658cf14db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.101039:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729a00/0x9232577658cf14db lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.101045:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729a00/0x9232577658cf14db lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.101051:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd729a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893129.101060:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729a00/0x9232577658cf14db lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.101067:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729a00/0x9232577658cf14db lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.101075:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9fc9c3918c00) 00010000:00010000:1.0:1787893129.101077:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893129.101080:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729a00/0x9232577658cf14db lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.101086:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729a00/0x9232577658cf14db lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.101099:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf14e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.101106:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf14e2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.101112:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf14e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.101116:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893129.101119:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf14e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.101125:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf14e2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.101430:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc9c3918e00) 00010000:00010000:1.0:1787893129.101434:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893129.101445:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf14e2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.101452:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf14e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893129.101746:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d0f50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+61:11397:x1874741481765504:12345-192.168.202.35@tcp:34:lhsmtool_posix.0 Request processed in 1319us (1638us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893129.101755:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 125 00000100:00100000:1.0:1787893129.105443:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893129.105802:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481765760 00000100:00100000:2.0:1787893129.105812:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481765760 00000100:00100000:2.0:1787893129.105907:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 126 00000100:00100000:2.0:1787893129.105918:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+61:11397:x1874741481765760:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787893129.105939:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893129.105960:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf14e9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa8c2 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.106071:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf14f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.106088:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf14f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.106099:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf14f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893129.106111:0:6504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787893129.106196:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf14f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.106203:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf14f0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.106440:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf14f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.106464:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7e600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893129.106468:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf14f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.106635:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf14f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.106650:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc9c3918e00) 00010000:00010000:2.0:1787893129.106653:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787893129.106657:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf14f0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.106663:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf14f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.106709:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf14e9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8c2 expref: 63 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.106720:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fc9d5c29800) 00010000:00010000:2.0:1787893129.106722:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787893129.106726:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf14e9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8c2 expref: 63 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.106735:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7f400, rc 0) 00000100:00100000:2.0:1787893129.106790:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+62:11397:x1874741481765760:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 874us (1358us total) trans 4294967399 rc 301/301 00000100:00100000:2.0:1787893129.106798:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 126 00000100:00100000:0.0:1787893129.110096:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893129.110227:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481765888 00000100:00100000:1.0:1787893129.110237:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481765888 00000100:00100000:1.0:1787893129.110295:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 127 00000100:00100000:1.0:1787893129.110306:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d0f51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+62:11397:x1874741481765888:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787893129.110339:0:13436:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787893129.110485:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d0f51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+62:11397:x1874741481765888:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 Request processed in 181us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893129.110514:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 127 00000100:00100000:0.0:1787893129.114674:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893129.116420:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481766144 00000100:00100000:2.0:1787893129.116450:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481766144 00000100:00100000:2.0:1787893129.116539:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 128 00000100:00100000:2.0:1787893129.116550:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+62:11397:x1874741481766144:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787893129.116573:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893129.116576:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787893129.116603:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf148e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8a6 expref: 62 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.116624:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc9d0fd6700) 00010000:00010000:2.0:1787893129.116629:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787893129.116654:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf14fe lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa8c9 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787893129.117049:0:6504:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:2.0:1787893129.117632:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf1505 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.117691:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf1505 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.117702:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf1505 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.117758:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf14fe lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8c9 expref: 64 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.117775:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf1505 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8c9 expref: 63 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.117797:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fc8c6614500) 00010000:00010000:2.0:1787893129.117800:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787893129.117803:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7e200, rc 0) 00000100:00100000:2.0:1787893129.117864:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+63:11397:x1874741481766144:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 1317us (3200us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1787893129.117872:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 128 00000100:00100000:1.0:1787893129.122856:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893129.122945:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481766400 00000100:00100000:3.0:1787893129.122959:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481766400 00000100:00100000:3.0:1787893129.123065:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 129 00000100:00100000:3.0:1787893129.123091:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+63:11397:x1874741481766400:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787893129.123163:0:10086:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893129.123190:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf1505 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8c9 expref: 63 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.123210:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fc8c6614500) 00010000:00010000:3.0:1787893129.123220:0:10086:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787893129.123241:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf1513 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.123254:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf1513 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.123263:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf1513 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.123314:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf151a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x371bcf40 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.123323:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf151a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x371bcf40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.123330:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf151a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x371bcf40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.123376:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf1513 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.123383:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf1513 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.123401:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf1513 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.123407:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c771ee00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893129.123412:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf1513 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.123421:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf1513 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.123429:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc9d0fd6700) 00010000:00010000:3.0:1787893129.123432:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893129.123435:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf1513 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.123441:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf1513 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.123463:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf151a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x371bcf40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.123470:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf151a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x371bcf40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.123488:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf151a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x371bcf40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.123513:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c771fa00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893129.123516:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf151a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x371bcf40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.123533:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf151a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x371bcf40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.123541:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x371bcf40 (ffff9fc9d0fd6d00) 00010000:00010000:3.0:1787893129.123544:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893129.123547:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf151a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x371bcf40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.123552:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf151a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x371bcf40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893129.123632:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+62:11397:x1874741481766400:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 Request processed in 543us (786us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787893129.123803:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 129 00000100:00100000:1.0:1787893129.128203:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893129.128333:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481766528 00000100:00100000:3.0:1787893129.128343:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481766528 00000100:00100000:3.0:1787893129.128399:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 130 00000100:00100000:3.0:1787893129.128409:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+62:11397:x1874741481766528:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787893129.128429:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893129.128451:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf1521 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa8d0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.128622:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1528 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.128637:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1528 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.128805:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1528 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.129290:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf1521 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8d0 expref: 64 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.129322:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1528 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8d0 expref: 63 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.129330:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fc9d0fd6000) 00010000:00010000:2.0:1787893129.129334:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787893129.129337:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9c0030800, rc 0) 00000100:00100000:2.0:1787893129.129445:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+63:11397:x1874741481766528:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 1037us (1251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893129.129453:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 130 00000100:00100000:0.0:1787893129.134648:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893129.134894:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481766784 00000100:00100000:2.0:1787893129.134905:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481766784 00000100:00100000:2.0:1787893129.134994:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 131 00000100:00100000:2.0:1787893129.135005:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+63:11397:x1874741481766784:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787893129.135092:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf152f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.135127:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf152f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.135150:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf152f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787893129.135318:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:2.0:1787893129.135364:0:6504:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b658f5e reply state 0000000094546b4c transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf152f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.135377:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf152f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.135384:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fc9d0fd6000) 00010000:00010000:2.0:1787893129.135387:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787893129.135390:0:6504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787893129.135638:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+65:11397:x1874741481766784:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 Request processed in 634us (998us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1787893129.135645:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 131 00000100:00100000:1.0:1787893129.138562:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893129.138650:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481766912 00000100:00100000:0.0:1787893129.138669:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481766912 00000100:00100000:0.0:1787893129.138722:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 132 00000100:00100000:0.0:1787893129.138745:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+65:11397:x1874741481766912:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787893129.138769:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893129.138791:0:13436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf1536 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa8d7 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.138846:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf1536 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8d7 expref: 66 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.138858:0:13436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf1536 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8d7 expref: 66 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.138875:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fc9d0fd6000) 00010000:00010000:0.0:1787893129.138878:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787893129.138881:0:13436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb31000, rc 0) 00000100:00100000:0.0:1787893129.138939:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+66:11397:x1874741481766912:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 196us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893129.138946:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 132 00000100:00100000:1.0:1787893129.146119:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893129.146206:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481767040 00000100:00100000:2.0:1787893129.146216:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481767040 00000100:00100000:2.0:1787893129.146289:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 45 00000100:00100000:2.0:1787893129.146300:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7fdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58232959-285a-4954-a3ac-571a2b817017+8:2390:x1874741481767040:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787893129.146554:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7fdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58232959-285a-4954-a3ac-571a2b817017+9:2390:x1874741481767040:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 Request processed in 255us (444us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787893129.146562:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 45 00000100:00080000:0.0:1787893129.147081:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787893129.150169:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893129.150262:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481767296 00000100:00100000:0.0:1787893129.150274:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481767296 00000100:00100000:0.0:1787893129.150336:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 30 00000100:00100000:0.0:1787893129.150347:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+66:11397:x1874741481767296:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787893129.150616:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+67:11397:x1874741481767296:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 Request processed in 271us (457us total) trans 4294967402 rc 0/0 00000100:00100000:0.0:1787893129.150624:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 30 00000100:00100000:3.0:1787893129.153567:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893129.153831:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481767552 00000100:00100000:1.0:1787893129.153844:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481767552 00000100:00100000:1.0:1787893129.153910:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 133 00000100:00100000:1.0:1787893129.153920:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+67:11397:x1874741481767552:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787893129.154036:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+67:11397:x1874741481767552:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 Request processed in 117us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893129.154058:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 133 00000100:00100000:2.0:1787893129.156751:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893129.156836:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481767680 00000100:00100000:3.0:1787893129.156845:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481767680 00000100:00100000:3.0:1787893129.156902:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 134 00000100:00100000:3.0:1787893129.156912:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+67:11397:x1874741481767680:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787893129.156930:0:9515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893129.156951:0:9515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030c00/0x9232577658cf153d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa8de expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.157026:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf1544 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.157040:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf1544 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.157052:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf1544 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893129.157097:0:9515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787893129.157115:0:9515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf1544 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.157155:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030c00/0x9232577658cf153d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8de expref: 69 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.157185:0:9515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf1544 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8de expref: 68 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.157212:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fc9d0fd6000) 00010000:00010000:3.0:1787893129.157214:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787893129.157217:0:9515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9c0031400, rc 0) 00000100:00100000:3.0:1787893129.157280:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+68:11397:x1874741481767680:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 369us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893129.157287:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 134 00000100:00100000:0.0:1787893129.160278:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893129.160376:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481767808 00000100:00100000:3.0:1787893129.160387:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481767808 00000100:00100000:3.0:1787893129.160451:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 46 00000100:00100000:3.0:1787893129.160461:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58232959-285a-4954-a3ac-571a2b817017+9:2392:x1874741481767808:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787893129.160510:0:8419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893129.160532:0:8419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e77079f5/0x9232577658cf154b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa8e5 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787893129.160558:0:8419:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a911589, blocks: 0x0 00010000:00010000:3.0:1787893129.160576:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=372s v=(0 0) 00010000:00010000:3.0:1787893129.160580:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893129.160590:0:8419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e77079f5/0x9232577658cf154b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8e5 expref: 10 pid: 8419 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.160605:0:8419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e77079f5/0x9232577658cf154b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8e5 expref: 10 pid: 8419 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.160617:0:8419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c771f400, rc 0) 00000100:00100000:3.0:1787893129.160731:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58232959-285a-4954-a3ac-571a2b817017+10:2392:x1874741481767808:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 271us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893129.160738:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 46 00000100:00100000:1.0:1787893129.169096:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893129.169272:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481768064 00000100:00100000:3.0:1787893129.169285:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481768064 00000100:00100000:3.0:1787893129.169401:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 135 00000100:00100000:3.0:1787893129.169413:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+68:11397:x1874741481768064:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787893129.169575:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+68:11397:x1874741481768064:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 Request processed in 163us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893129.169584:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 135 00000100:00100000:2.0:1787893129.173825:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893129.174034:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481768192 00000100:00100000:3.0:1787893129.174045:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481768192 00000100:00100000:3.0:1787893129.174100:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 47 00000100:00100000:3.0:1787893129.174110:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58232959-285a-4954-a3ac-571a2b817017+10:11397:x1874741481768192:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787893129.174129:0:8421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893129.174155:0:8421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e727c74a/0x9232577658cf1552 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa8ec expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.174188:0:8421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e77079f5/0x9232577658cf154b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8e5 expref: 11 pid: 8419 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.174197:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893129.174202:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893129.174207:0:8421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e727c74a/0x9232577658cf1552 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8ec expref: 11 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.174256:0:8421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e77079f5/0x9232577658cf154b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8e5 expref: 11 pid: 8419 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.174271:0:8421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e77079f5/0x9232577658cf154b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8e5 expref: 11 pid: 8419 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893129.174286:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8421:1874741493376000:192.168.202.35@tcp:104: 00000100:00100000:3.0:1787893129.174384:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c70b83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787893129.178783:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8421:1874741493376000:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787893129.178825:0:8421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e727c74a/0x9232577658cf1552 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8ec expref: 11 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.178847:0:8421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c771fa00, rc 0) 00000100:00100000:3.0:1787893129.178912:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58232959-285a-4954-a3ac-571a2b817017+11:11397:x1874741481768192:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 4803us (5097us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893129.178922:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 47 00000100:00100000:2.0:1787893129.183041:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893129.183395:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481768320 00000100:00100000:3.0:1787893129.183406:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481768320 00010000:00010000:3.0:1787893129.183447:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e77079f5/0x9232577658cf154b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8e5 expref: 11 pid: 8419 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893129.183541:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 72 00000100:00100000:3.0:1787893129.183551:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58232959-285a-4954-a3ac-571a2b817017+11:2391:x1874741481768320:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893129.183583:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893129.183604:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 00000000e77079f5/0x9232577658cf154b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8e5 expref: 11 pid: 8419 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.183619:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e77079f5/0x9232577658cf154b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8e5 expref: 11 pid: 8419 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.183920:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e77079f5/0x9232577658cf154b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8e5 expref: 11 pid: 8419 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.183936:0:6492:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787893129.183940:0:6492:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893129.183949:0:6492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e727c74a/0x9232577658cf1552 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8ec expref: 10 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.183959:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e727c74a/0x9232577658cf1552 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8ec expref: 10 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.184632:0:6492:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e727c74a/0x9232577658cf1552 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8ec expref: 10 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893129.184761:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb99c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6492:1874741493376128:192.168.202.35@tcp:105: 00000100:00100000:0.0:1787893129.184877:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d7ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1787893129.192515:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893129.192859:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb99c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6492:1874741493376128:192.168.202.35@tcp:105: 00010000:00010000:0.0:1787893129.192883:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893129.192945:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58232959-285a-4954-a3ac-571a2b817017+10:2391:x1874741481768320:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 9394us (9913us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893129.192956:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 72 00000100:00100000:1.0:1787893129.193084:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481768448 00000100:00100000:1.0:1787893129.193091:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481768448 00002000:00100000:1.0:1787893129.193142:0:8424:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9fc9ffbded80 x1874741481768448/t0(0) o4->58232959-285a-4954-a3ac-571a2b817017@192.168.202.35@tcp:290/0 lens 504/0 e 0 to 0 dl 1787893140 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787893129.193152:0:8424:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc9ffbded80 with x1874741481768448 ext(0->12) 00002000:00010000:1.0:1787893129.193157:0:8424:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fc9ffbded80 00000100:00100000:1.0:1787893129.193184:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 2 00000100:00100000:1.0:1787893129.193194:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:58232959-285a-4954-a3ac-571a2b817017+10:2390:x1874741481768448:12345-192.168.202.35@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787893129.195143:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:58232959-285a-4954-a3ac-571a2b817017+12:2390:x1874741481768448:12345-192.168.202.35@tcp:4:lhsmtool_posix.0 Request processed in 1933us (2649us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787893129.195155:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 2 00002000:00100000:1.0:1787893129.195166:0:8424:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9fc9ffbded80 x1874741481768448/t4294967309(0) o4->58232959-285a-4954-a3ac-571a2b817017@192.168.202.35@tcp:290/0 lens 504/448 e 0 to 0 dl 1787893140 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787893129.195175:0:8424:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc9ffbded80 with x1874741481768448 ext(0->12) 00002000:00010000:1.0:1787893129.195180:0:8424:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fc9ffbded80 00000100:00100000:3.0:1787893129.198159:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893129.198227:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481768576 00000100:00100000:1.0:1787893129.198237:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481768576 00000100:00100000:1.0:1787893129.198304:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 136 00000100:00100000:1.0:1787893129.198315:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+68:11397:x1874741481768576:12345-192.168.202.35@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787893129.200329:0:6484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:3.0:1787893129.200375:0:6484:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:3.0:1787893129.200404:0:6484:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fc8c70b8180 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1787893129.200410:0:6484:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fc9fd041c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fc8c70b8000 00000020:00080000:3.0:1787893129.200413:0:6484:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fc9fd041900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fc8c7ea1a00 00000004:00080000:3.0:1787893129.200455:0:6484:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1787893129.200522:0:6484:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fc8c7d57000 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1787893129.200526:0:6484:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fc9ffb83700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fc8c7d57b40 00000020:00080000:3.0:1787893129.200529:0:6484:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fc9ffb83b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fc8c770a200 00000100:00100000:1.0:1787893129.200935:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+22:11397:x1874741481768576:12345-192.168.202.35@tcp:44:lhsmtool_posix.0 Request processed in 2616us (2782us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893129.200955:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 136 00000100:00100000:2.0:1787893129.201150:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493376256:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787893129.201201:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893129.201239:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787893129.201246:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493376384:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787893129.201269:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893129.201364:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493376256 00000100:00100000:1.0:1787893129.201372:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493376256 00000100:00080000:2.0:1787893129.201467:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787893129.201516:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493376384 00000100:00100000:1.0:1787893129.201520:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493376384 00000100:00080000:2.0:1787893129.201575:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787893129.202173:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1257 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.202187:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1257 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.202194:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1257 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.202201:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c0031000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893129.202206:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1257 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.202214:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1257 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.202234:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fc9d0fd6900) 00010000:00010000:0.0:1787893129.202237:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893129.202242:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1257 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.202259:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1257 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.202298:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf12ff lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.202305:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf12ff lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.202311:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf12ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.202316:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893129.202319:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf12ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.202324:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf12ff lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.202332:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc8c6614000) 00010000:00010000:0.0:1787893129.202334:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893129.202337:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf12ff lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.202344:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf12ff lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.202361:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf137d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.202368:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf137d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.202380:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf137d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.202385:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893129.202388:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf137d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.202395:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf137d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.202403:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc8c751ac00) 00010000:00010000:0.0:1787893129.202406:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893129.202409:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf137d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.202415:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf137d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.202427:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf13a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.202433:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf13a0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.202438:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf13a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.202444:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7fa00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893129.202446:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf13a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.202462:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf13a0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.202470:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc8c751ac00) 00000020:00080000:2.0:1787893129.202650:0:6536:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1787893129.202726:0:6536:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:0.0:1787893129.202804:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893129.202810:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf13a0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.202817:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf13a0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.202835:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf1472 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.202841:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf1472 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.202847:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf1472 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.202852:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe541600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893129.202855:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf1472 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.202861:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf1472 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.202871:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc9c3918e00) 00010000:00010000:0.0:1787893129.202873:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893129.202876:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf1472 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.202892:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf1472 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.202904:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf152f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.202910:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf152f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.202915:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf152f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.202920:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7e000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893129.202923:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf152f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.202929:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf152f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.202937:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fc9d0fd6000) 00010000:00010000:0.0:1787893129.202939:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787893129.202942:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf152f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.202947:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf152f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893129.203765:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787893129.203878:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3630:x1874741493376256:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787893129.203911:0:8535:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:2.0:1787893129.203943:0:8535:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a911588, atime: 0x6a911588, ctime: 0x6a911588, blocks: 0x8 00010000:00010000:2.0:1787893129.203950:0:8535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007afcdc65/0x9232577658cf1559 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.203967:0:8535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=373s v=(0 0) 00010000:00010000:2.0:1787893129.203972:0:8535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893129.203978:0:8535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007afcdc65/0x9232577658cf1559 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.203993:0:8535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007afcdc65/0x9232577658cf1559 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.204002:0:8535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007afcdc65/0x9232577658cf1559 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.204034:0:8535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007afcdc65/0x9232577658cf1559 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.204057:0:8535:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787893129.204230:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3630:x1874741493376256:12345-0@lo:6:osp-syn-0-0.0 Request processed in 454us (3028us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787893129.204238:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787893129.204260:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787893129.204267:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3630:x1874741493376384:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787893129.204280:0:8535:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:2.0:1787893129.204292:0:8535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a929ac94/0x9232577658cf1560 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.204306:0:8535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000028870c7f/0x9232577658cf130d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa844 expref: 11 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.204313:0:8535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787893129.204316:0:8535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787893129.204320:0:8535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a929ac94/0x9232577658cf1560 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.204351:0:8535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000028870c7f/0x9232577658cf130d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa844 expref: 11 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.204366:0:8535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000028870c7f/0x9232577658cf130d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa844 expref: 11 pid: 8535 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893129.204388:0:8535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7d4b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8535:1874741493376512:192.168.202.35@tcp:104: 00000100:00100000:2.0:1787893129.204461:0:8535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c11ca540 going to sleep for 11 seconds 00000004:00080000:2.0:1787893129.204537:0:3630:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fc9ffc9a300/2, rc 0, transno 4294967305 00000100:00100000:2.0:1787893129.204543:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493376256:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1787893129.205875:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787893129.205888:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007afcdc65/0x9232577658cf1559 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.205901:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7f800 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:3.0:1787893129.205906:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007afcdc65/0x9232577658cf1559 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.205916:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007afcdc65/0x9232577658cf1559 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.205934:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007afcdc65/0x9232577658cf1559 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.205940:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007afcdc65/0x9232577658cf1559 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.205963:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893129.205965:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893129.205966:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893129.207360:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893129.208564:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893129.209107:0:10383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481768832 00000100:00100000:2.0:1787893129.209117:0:10383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481768832 00010000:00010000:2.0:1787893129.209163:0:10383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000028870c7f/0x9232577658cf130d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa844 expref: 12 pid: 8535 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893129.209204:0:10383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 73 00000100:00100000:2.0:1787893129.209212:0:10383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3efdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58232959-285a-4954-a3ac-571a2b817017+12:2390:x1874741481768832:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787893129.209225:0:10383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893129.209230:0:10383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000028870c7f/0x9232577658cf130d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa844 expref: 12 pid: 8535 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.209243:0:10383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000028870c7f/0x9232577658cf130d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa844 expref: 12 pid: 8535 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.209266:0:10383:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787893129.209270:0:10383:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787893129.209276:0:10383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a929ac94/0x9232577658cf1560 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.209286:0:10383:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a929ac94/0x9232577658cf1560 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.209315:0:10383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893129.209365:0:10383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3efdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58232959-285a-4954-a3ac-571a2b817017+12:2390:x1874741481768832:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 153us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893129.209372:0:10383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 73 00000100:00100000:2.0:1787893129.209426:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481768704 00000100:00100000:2.0:1787893129.209430:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481768704 00000100:00100000:2.0:1787893129.209452:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 50 00000100:00100000:2.0:1787893129.209457:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58232959-285a-4954-a3ac-571a2b817017+12:2390:x1874741481768704:12345-192.168.202.35@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1787893129.209745:0:8535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028870c7f/0x9232577658cf130d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa844 expref: 12 pid: 8535 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893129.209761:0:8535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7d4b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8535:1874741493376512:192.168.202.35@tcp:104: 00010000:00010000:2.0:1787893129.209778:0:8535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a929ac94/0x9232577658cf1560 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.209788:0:8535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a929ac94/0x9232577658cf1560 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.209796:0:8535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a929ac94/0x9232577658cf1560 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.209806:0:8535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a929ac94/0x9232577658cf1560 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.209825:0:8535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a929ac94/0x9232577658cf1560 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.209850:0:8535:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787893129.211839:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3630:x1874741493376384:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7566us (10562us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787893129.211851:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:2.0:1787893129.211908:0:3630:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fc9ffc9a680/2, rc 0, transno 4294967310 00000100:00100000:2.0:1787893129.211921:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493376384:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1787893129.212102:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893129.212112:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a929ac94/0x9232577658cf1560 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.212124:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7fc00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:1.0:1787893129.212128:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a929ac94/0x9232577658cf1560 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.212147:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a929ac94/0x9232577658cf1560 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.212166:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a929ac94/0x9232577658cf1560 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.212173:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a929ac94/0x9232577658cf1560 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.212196:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893129.212199:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893129.212201:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787893129.213180:0:9497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1787893129.213198:0:9497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:2.0:1787893129.213385:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58232959-285a-4954-a3ac-571a2b817017+6:2390:x1874741481768704:12345-192.168.202.35@tcp:16:lhsmtool_posix.0 Request processed in 3922us (6030us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893129.213395:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 50 00000100:00100000:3.0:1787893129.217146:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893129.217332:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481769088 00000100:00100000:0.0:1787893129.217342:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481769088 00000100:00100000:0.0:1787893129.217405:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 137 00000100:00100000:0.0:1787893129.217416:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+16:11397:x1874741481769088:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787893129.217524:0:9515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893129.217556:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf1544 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8de expref: 16 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.217591:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fc9d0fd6000) 00010000:00010000:0.0:1787893129.217595:0:9515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787893129.217627:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf1567 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.217651:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf1567 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.217662:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf1567 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787893129.217781:0:9515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cb6a82ec reply state 000000008a9b26f3 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf1567 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.217793:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf1567 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.217800:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fc9d0fd6000) 00010000:00010000:0.0:1787893129.217802:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787893129.217805:0:9515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787893129.217902:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+17:11397:x1874741481769088:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 Request processed in 487us (776us total) trans 4294967403 rc 0/0 00000100:00100000:0.0:1787893129.217908:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 137 00000100:00100000:3.0:1787893129.222190:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893129.222540:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481769216 00000100:00100000:1.0:1787893129.222552:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481769216 00000100:00100000:1.0:1787893129.222614:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 51 00000100:00100000:1.0:1787893129.222624:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+6:2391:x1874741481769216:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787893129.222958:0:8420:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787893129.222963:0:8420:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787893129 00002000:00010000:1.0:1787893129.222966:0:8420:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787893128 00002000:00010000:1.0:1787893129.222968:0:8420:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1787893129 -> 1787893129 00002000:00010000:1.0:1787893129.222970:0:8420:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1787893129.223042:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+7:2391:x1874741481769216:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 Request processed in 418us (861us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787893129.223049:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 51 00000100:00100000:2.0:1787893129.225996:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893129.226108:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481769472 00000100:00100000:1.0:1787893129.226118:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481769472 00000100:00100000:1.0:1787893129.226189:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 138 00000100:00100000:1.0:1787893129.226199:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+17:11397:x1874741481769472:12345-192.168.202.35@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787893129.226262:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf156e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.226279:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1528 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8d0 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.226289:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf156e lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.226323:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1528 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8d0 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.226336:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1528 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8d0 expref: 17 pid: 6505 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893129.226371:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc99880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6504:1874741493376640:192.168.202.35@tcp:104: 00000100:00100000:1.0:1787893129.226457:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c73f9840 going to sleep for 11 seconds 00000100:00100000:3.0:1787893129.230047:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893129.230157:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481769600 00000100:00100000:2.0:1787893129.230167:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481769600 00010000:00010000:2.0:1787893129.230206:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1528 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8d0 expref: 18 pid: 6505 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893129.230250:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 74 00000100:00100000:2.0:1787893129.230261:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58232959-285a-4954-a3ac-571a2b817017+18:2391:x1874741481769600:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787893129.230275:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893129.230281:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1528 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8d0 expref: 18 pid: 6505 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.230295:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1528 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8d0 expref: 18 pid: 6505 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.230333:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fc9d0fd6000) 00010000:00010000:2.0:1787893129.230339:0:6491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf156e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.230349:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf156e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.230357:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf156e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.230374:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893129.230434:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58232959-285a-4954-a3ac-571a2b817017+18:2391:x1874741481769600:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 175us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893129.230442:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 74 00010000:00010000:1.0:1787893129.231782:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1528 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8d0 expref: 17 pid: 6505 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893129.231820:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc99880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6504:1874741493376640:192.168.202.35@tcp:104: 00010000:00010000:1.0:1787893129.231841:0:6504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf156e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.231850:0:6504:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf156e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.231856:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf156e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.231894:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf156e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.231902:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf156e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.231909:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf156e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.231915:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe541a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893129.231920:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf156e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.231946:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf156e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.231962:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fc9d0fd6000) 00010000:00010000:1.0:1787893129.231965:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787893129.231969:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf156e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.231975:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf156e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893129.232058:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+16:11397:x1874741481769472:12345-192.168.202.35@tcp:55:lhsmtool_posix.0 Request processed in 5859us (6075us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787893129.232068:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 138 00000100:00100000:0.0:1787893129.234833:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893129.234951:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481769728 00000100:00100000:2.0:1787893129.234963:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481769728 00000100:00100000:2.0:1787893129.235063:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 52 00000100:00100000:2.0:1787893129.235074:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58232959-285a-4954-a3ac-571a2b817017+7:2391:x1874741481769728:12345-192.168.202.35@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787893129.235118:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a929ac94/0x9232577658cf1575 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.235147:0:8421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e727c74a/0x9232577658cf1552 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8ec expref: 7 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.235158:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893129.235162:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787893129.235166:0:8421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a929ac94/0x9232577658cf1575 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.235210:0:8421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e727c74a/0x9232577658cf1552 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8ec expref: 7 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893129.235223:0:8421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e727c74a/0x9232577658cf1552 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8ec expref: 7 pid: 8421 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893129.235238:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7d49880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8421:1874741493376768:192.168.202.35@tcp:104: 00000100:00100000:2.0:1787893129.235317:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c5c9f000 going to sleep for 11 seconds 00000100:00100000:2.0:1787893129.238925:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893129.239029:0:10383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481769856 00000100:00100000:0.0:1787893129.239038:0:10383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481769856 00010000:00010000:0.0:1787893129.239088:0:10383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e727c74a/0x9232577658cf1552 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8ec expref: 8 pid: 8421 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893129.239139:0:10383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 75 00000100:00100000:0.0:1787893129.239150:0:10383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58232959-285a-4954-a3ac-571a2b817017+8:2391:x1874741481769856:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893129.239164:0:10383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893129.239185:0:10383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e727c74a/0x9232577658cf1552 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8ec expref: 8 pid: 8421 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.239199:0:10383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e727c74a/0x9232577658cf1552 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8ec expref: 8 pid: 8421 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.239224:0:10383:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787893129.239228:0:10383:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787893129.239234:0:10383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a929ac94/0x9232577658cf1575 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.239244:0:10383:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a929ac94/0x9232577658cf1575 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.239264:0:10383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893129.239318:0:10383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58232959-285a-4954-a3ac-571a2b817017+8:2391:x1874741481769856:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 170us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893129.239327:0:10383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 75 00010000:00010000:3.0:1787893129.240006:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e727c74a/0x9232577658cf1552 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8ec expref: 7 pid: 8421 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893129.240035:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7d49880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8421:1874741493376768:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787893129.240055:0:8421:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a929ac94/0x9232577658cf1575 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.240066:0:8421:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a929ac94/0x9232577658cf1575 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.240073:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a929ac94/0x9232577658cf1575 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.240095:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a929ac94/0x9232577658cf1575 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.240103:0:8421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a929ac94/0x9232577658cf1575 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.240111:0:8421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a929ac94/0x9232577658cf1575 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.240143:0:8421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7fc00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:3.0:1787893129.240148:0:8421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a929ac94/0x9232577658cf1575 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.240158:0:8421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a929ac94/0x9232577658cf1575 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.240172:0:8421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a929ac94/0x9232577658cf1575 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.240180:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a929ac94/0x9232577658cf1575 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893129.240242:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58232959-285a-4954-a3ac-571a2b817017+6:2391:x1874741481769728:12345-192.168.202.35@tcp:1:lhsmtool_posix.0 Request processed in 5170us (5416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893129.240251:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 52 00000100:00100000:2.0:1787893129.243760:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893129.243861:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481770112 00000100:00100000:0.0:1787893129.243870:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481770112 00000100:00100000:0.0:1787893129.243935:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 139 00000100:00100000:0.0:1787893129.243962:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+16:11397:x1874741481770112:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787893129.244050:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf157c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.244067:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf146b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa898 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.244077:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf157c lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.244116:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf146b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa898 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.244130:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf146b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa898 expref: 16 pid: 6506 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893129.244154:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6505:1874741493376896:192.168.202.35@tcp:104: 00000100:00100000:0.0:1787893129.244235:0:6505:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d7ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1787893129.247630:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893129.247848:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481770240 00000100:00100000:3.0:1787893129.247857:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481770240 00010000:00010000:3.0:1787893129.247897:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf146b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa898 expref: 17 pid: 6506 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893129.247943:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 76 00000100:00100000:3.0:1787893129.247954:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58232959-285a-4954-a3ac-571a2b817017+17:2390:x1874741481770240:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893129.247968:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893129.247988:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf146b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa898 expref: 17 pid: 6506 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.248002:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf146b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa898 expref: 17 pid: 6506 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.248036:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc9c3918e00) 00010000:00010000:3.0:1787893129.248042:0:6491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771e400/0x9232577658cf14cd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8bb expref: 17 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.248054:0:6491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf157c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.248062:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf157c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.248070:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf157c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.248090:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893129.248153:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58232959-285a-4954-a3ac-571a2b817017+17:2390:x1874741481770240:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 201us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893129.248161:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 76 00010000:00010000:0.0:1787893129.248909:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf146b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa898 expref: 16 pid: 6506 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893129.248927:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6505:1874741493376896:192.168.202.35@tcp:104: 00010000:00010000:0.0:1787893129.248949:0:6505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf157c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.248958:0:6505:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf157c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.248977:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf157c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.249165:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1583 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.249177:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf1536 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8d7 expref: 16 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.249184:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1583 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.249214:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf1536 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8d7 expref: 16 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.249228:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf1536 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8d7 expref: 16 pid: 13436 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893129.249242:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6505:1874741493377024:192.168.202.35@tcp:104: 00000100:00100000:0.0:1787893129.249310:0:6505:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d7e300 going to sleep for 11 seconds 00000100:00100000:2.0:1787893129.253300:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893129.253394:0:10383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481770368 00000100:00100000:1.0:1787893129.253404:0:10383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481770368 00010000:00010000:1.0:1787893129.253442:0:10383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf1536 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8d7 expref: 17 pid: 13436 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893129.253520:0:10383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 77 00000100:00100000:1.0:1787893129.253531:0:10383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58232959-285a-4954-a3ac-571a2b817017+17:2390:x1874741481770368:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893129.253546:0:10383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893129.253553:0:10383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf1536 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8d7 expref: 17 pid: 13436 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.253565:0:10383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf1536 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8d7 expref: 17 pid: 13436 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.253604:0:10383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fc9d0fd6000) 00010000:00010000:1.0:1787893129.253609:0:10383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1583 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.253618:0:10383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1583 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.253625:0:10383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1583 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.253654:0:10383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893129.253701:0:10383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58232959-285a-4954-a3ac-571a2b817017+17:2390:x1874741481770368:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 172us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893129.253708:0:10383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 77 00010000:00010000:0.0:1787893129.254786:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf1536 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8d7 expref: 16 pid: 13436 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893129.254805:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6505:1874741493377024:192.168.202.35@tcp:104: 00010000:00010000:0.0:1787893129.254826:0:6505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1583 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.254835:0:6505:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1583 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.254852:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1583 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787893129.254949:0:6505:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1787893129.255077:0:6505:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:0.0:1787893129.255112:0:6505:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1787893129.255199:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6505:1874741493377152:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787893129.255252:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893129.255282:0:6505:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c395c600 going to sleep for 11 seconds 00000100:00100000:2.0:1787893129.255441:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493377152 00000100:00100000:2.0:1787893129.255447:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493377152 00000100:00100000:2.0:1787893129.255519:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787893129.255529:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6505:x1874741493377152:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787893129.255611:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6505:x1874741493377152:12345-0@lo:1000:mdt00_001.0 Request processed in 84us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893129.255618:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787893129.255877:0:6505:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:1.0:1787893129.255883:0:6505:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:1.0:1787893129.255901:0:6505:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9fc9ffc9a680 x1874741493376384/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787893145 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893129.255911:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6505:1874741493377152:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1787893129.256049:0:6505:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:1.0:1787893129.256093:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc99880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6505:1874741493377280:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787893129.256124:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893129.256159:0:6505:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c73f9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787893129.256225:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493377280 00000100:00100000:3.0:1787893129.256230:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493377280 00000100:00100000:3.0:1787893129.256264:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787893129.256272:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6505:x1874741493377280:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787893129.256389:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6505:x1874741493377280:12345-0@lo:1000:mdt00_001.0 Request processed in 117us (264us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787893129.256406:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787893129.256790:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc99880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6505:1874741493377280:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1787893129.256825:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1583 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.256843:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1583 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.256851:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1583 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.256856:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893129.256861:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1583 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.256868:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1583 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.256884:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fc9d0fd6000) 00010000:00010000:1.0:1787893129.256886:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787893129.256890:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1583 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.256897:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf1583 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.256918:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf14c6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.256923:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf14c6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.256929:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf14c6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.256933:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893129.256940:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf14c6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.256947:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf14c6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.256954:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc9c3918e00) 00010000:00010000:1.0:1787893129.256956:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787893129.256962:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771e400/0x9232577658cf14cd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8bb expref: 19 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.256973:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771e400/0x9232577658cf14cd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8bb expref: 19 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.256983:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771e400/0x9232577658cf14cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8bb expref: 19 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.257006:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771e400/0x9232577658cf14cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8bb expref: 19 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893129.257027:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc9bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6505:1874741493377408:192.168.202.35@tcp:105: 00000100:00100000:1.0:1787893129.257090:0:6505:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9dd7209c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787893129.260688:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc9bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6505:1874741493377408:192.168.202.35@tcp:105: 00010000:00010000:1.0:1787893129.260716:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf14c6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.260726:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf14c6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.260773:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf158a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.260786:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf158a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.260797:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf158a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.260808:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf158a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.260814:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf158a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.260820:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf158a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.260825:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe541a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893129.260830:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf158a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.260836:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf158a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.260846:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc9c3918e00) 00010000:00010000:1.0:1787893129.260849:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893129.260852:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf158a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.260857:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf158a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.260874:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf157c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.260881:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf157c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.260887:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf157c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.260891:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893129.260895:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf157c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.260901:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf157c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.260908:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc9c3918e00) 00010000:00010000:1.0:1787893129.260911:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787893129.260913:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf157c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893129.260918:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf157c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893129.261086:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+19:11397:x1874741481770112:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 Request processed in 17125us (17334us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1787893129.261096:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 139 00000020:00080000:1.0:1787893129.261101:0:6505:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787893129.261298:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787893129.261303:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787893129.261814:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787893129.261824:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787893129.264293:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893129.264412:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481770624 00000100:00100000:3.0:1787893129.264422:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481770624 00000100:00100000:3.0:1787893129.264481:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 31 00000100:00100000:3.0:1787893129.264524:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+19:11397:x1874741481770624:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787893129.264774:0:6508:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787893129.264804:0:6508:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:3.0:1787893129.264837:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf1591 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.264853:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf1591 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.264864:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf1591 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.264872:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf1591 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.264879:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf1591 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.264884:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf1591 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.264907:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787893129.264989:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+21:11397:x1874741481770624:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 Request processed in 499us (705us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1787893129.264997:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 31 00000020:00080000:3.0:1787893129.265027:0:6508:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787893129.265110:0:8435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893129.265117:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf1591 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.265125:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c771fa00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893129.265140:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf1591 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.265149:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf1591 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.265162:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fc9d0fd6000) 00010000:00010000:0.0:1787893129.265165:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787893129.265170:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf1591 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.265176:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf1591 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.265202:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893129.265210:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893129.265212:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893129.269237:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893129.269324:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481770752 00000100:00100000:0.0:1787893129.269334:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481770752 00000100:00100000:0.0:1787893129.269390:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 32 00000100:00100000:0.0:1787893129.269400:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fecc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+21:11396:x1874741481770752:12345-192.168.202.35@tcp:49:lfs.0 00000100:00100000:0.0:1787893129.269577:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fecc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+21:11396:x1874741481770752:12345-192.168.202.35@tcp:49:lfs.0 Request processed in 177us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893129.269584:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 32 00000100:00100000:2.0:1787893129.272946:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893129.273055:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481771008 00000100:00100000:0.0:1787893129.273066:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481771008 00000100:00100000:0.0:1787893129.273130:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 140 00000100:00100000:0.0:1787893129.273140:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+21:11396:x1874741481771008:12345-192.168.202.35@tcp:58:lfs.0 00000040:00080000:0.0:1787893129.273320:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1787893129.273400:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+21:11396:x1874741481771008:12345-192.168.202.35@tcp:58:lfs.0 Request processed in 261us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893129.273408:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 140 00000100:00100000:2.0:1787893129.307563:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893129.307821:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481771136 00000100:00100000:3.0:1787893129.307830:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481771136 00000100:00100000:3.0:1787893129.307892:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 141 00000100:00100000:3.0:1787893129.307902:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+21:11399:x1874741481771136:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:3.0:1787893129.307921:0:10086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893129.307939:0:10086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf1598 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa8f3 expref: -99 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.307996:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf159f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.308010:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf159f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.308031:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf159f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.308046:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf15a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.308053:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf15a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.308058:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf15a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.308127:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ec00/0x9232577658cf15ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.308139:0:10086:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf14b8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8b4 expref: 22 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.308154:0:10086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ec00/0x9232577658cf15ad lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.308184:0:10086:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf14b8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8b4 expref: 22 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.308198:0:10086:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf14b8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8b4 expref: 22 pid: 13436 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893129.308213:0:10086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10086:1874741493377536:192.168.202.35@tcp:104: 00000100:00100000:3.0:1787893129.308315:0:10086:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c70b8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787893129.312330:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893129.312466:0:10086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10086:1874741493377536:192.168.202.35@tcp:104: 00010000:00010000:1.0:1787893129.312547:0:10086:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ec00/0x9232577658cf15ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893129.312690:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481771392 00000100:00100000:0.0:1787893129.312697:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481771392 00000100:00100000:0.0:1787893129.312755:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 33 00000100:00100000:0.0:1787893129.312765:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+23:6162:x1874741481771392:12345-192.168.202.35@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787893129.312975:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+24:6162:x1874741481771392:12345-192.168.202.35@tcp:35:ldlm_bl.0 Request processed in 211us (657us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1787893129.312983:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 33 00000100:00100000:2.0:1787893129.316064:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893129.316152:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481771520 00000100:00100000:3.0:1787893129.316162:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481771520 00010000:00010000:3.0:1787893129.316203:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf14b8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8b4 expref: 24 pid: 13436 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893129.316243:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 78 00000100:00100000:3.0:1787893129.316253:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58232959-285a-4954-a3ac-571a2b817017+24:2392:x1874741481771520:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893129.316265:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893129.316272:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf14b8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8b4 expref: 24 pid: 13436 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.316284:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf14b8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8b4 expref: 24 pid: 13436 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.316329:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf14b8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8b4 expref: 24 pid: 13436 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.316345:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc9c3918e00) 00010000:00010000:3.0:1787893129.316349:0:6491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ec00/0x9232577658cf15ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.316358:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ec00/0x9232577658cf15ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.316365:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ec00/0x9232577658cf15ad lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893129.316398:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893129.316454:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58232959-285a-4954-a3ac-571a2b817017+23:2392:x1874741481771520:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 202us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893129.316462:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 78 00010000:00010000:0.0:1787893129.317259:0:10086:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ec00/0x9232577658cf15ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.317284:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ec00/0x9232577658cf15ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893129.317340:0:10086:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787893129.317345:0:10086:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787893129.317364:0:10086:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ec00/0x9232577658cf15ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.317379:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ec00/0x9232577658cf15ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.317388:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf159f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.317394:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf159f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.317402:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf159f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.317409:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c771ee00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893129.317412:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf159f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.317419:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf159f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.317430:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc9d0fd6700) 00010000:00010000:0.0:1787893129.317432:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893129.317436:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf159f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.317451:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf159f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.317735:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf15a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.317743:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf15a6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.317748:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf15a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.317753:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c771fa00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893129.317756:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf15a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.317761:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf15a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.317769:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc9cab65600) 00010000:00010000:0.0:1787893129.317772:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893129.317775:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf15a6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.317780:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fa00/0x9232577658cf15a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.317820:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf1598 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8f3 expref: 23 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.317848:0:10086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ec00/0x9232577658cf15ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8f3 expref: 22 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893129.317855:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc9c3918e00) 00010000:00010000:0.0:1787893129.317858:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787893129.317860:0:10086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c771ec00, rc 0) 00000100:00100000:0.0:1787893129.318082:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+22:11399:x1874741481771136:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 10180us (10526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893129.318090:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 141 00000100:00100000:1.0:1787893129.906345:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787893129.906368:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493377664:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787893129.906436:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893129.908255:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493377664 00000100:00100000:3.0:1787893129.908269:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493377664 00000100:00100000:3.0:1787893129.908334:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787893129.908344:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493377664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787893129.908377:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1787893129.908448:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493377664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (2011us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893129.908455:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787893129.908762:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493377664:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787893129.912104:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787893130.018827:0:14301:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787893130.018836:0:14301:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787893130.018875:0:14301:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787893130.018883:0:14301:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1787893130.289730:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787893130.289739:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787893130.289767:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787893130.289776:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787893130.289904:0:13786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7201f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13786:1874741493377792:192.168.202.35@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787893130.290055:0:13786:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c5c9f000 going to sleep for 11 seconds 00000100:00100000:3.0:1787893130.292192:0:13786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7201f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13786:1874741493377792:192.168.202.35@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787893130.293639:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893130.293730:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481771648 00000100:00100000:1.0:1787893130.293738:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481771648 00000100:00100000:1.0:1787893130.293796:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 142 00000100:00100000:1.0:1787893130.293806:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7201500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+22:11411:x1874741481771648:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787893130.293841:0:6506:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787893130.293945:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7201500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+22:11411:x1874741481771648:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 Request processed in 139us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893130.293954:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 142 00000100:00100000:2.0:1787893130.297141:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893130.299061:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481771904 00000100:00100000:0.0:1787893130.299076:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481771904 00000100:00100000:2.0:1787893130.303416:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 143 00000100:00100000:2.0:1787893130.303430:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7201f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+22:11411:x1874741481771904:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787893130.303451:0:9515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893130.303482:0:9515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf15b4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa8fa expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893130.303607:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf15bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893130.303621:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf15bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893130.303635:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf15bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893130.303646:0:9515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787893130.303745:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf15b4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8fa expref: 25 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893130.303761:0:9515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf15bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8fa expref: 24 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893130.303782:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc9c3918e00) 00010000:00010000:2.0:1787893130.303785:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787893130.303788:0:9515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7e600, rc 0) 00000100:00100000:2.0:1787893130.303861:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7201f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+24:11411:x1874741481771904:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 434us (6730us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1787893130.303868:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 143 00000100:00100000:3.0:1787893130.307600:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893130.307659:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481772160 00000100:00100000:0.0:1787893130.307670:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481772160 00000100:00100000:0.0:1787893130.307731:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 144 00000100:00100000:0.0:1787893130.307742:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+24:11411:x1874741481772160:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787893130.307814:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf15c9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893130.307831:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf15c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893130.307842:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf15c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893130.307982:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf15c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893130.308018:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf15c9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893130.308025:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf15c9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893130.308031:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893130.308035:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf15c9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893130.308043:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf15c9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893130.308055:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc9c3918e00) 00010000:00010000:0.0:1787893130.308058:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787893130.308063:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf15c9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893130.308070:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf15c9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893130.308185:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+25:11411:x1874741481772160:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 Request processed in 444us (595us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1787893130.308193:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 144 00000040:00080000:3.0:1787893130.308272:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787893130.308277:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787893130.308787:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787893130.308797:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787893130.309819:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893130.309967:0:10383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481772288 00000100:00100000:1.0:1787893130.309976:0:10383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481772288 00000100:00100000:1.0:1787893130.310093:0:10383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 10 00000100:00100000:1.0:1787893130.310105:0:10383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58232959-285a-4954-a3ac-571a2b817017+25:2392:x1874741481772288:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893130.310118:0:10383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893130.310141:0:10383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf15bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8fa expref: 25 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893130.310158:0:10383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc9c3918e00) 00010000:00010000:1.0:1787893130.310162:0:10383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893130.310218:0:10383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58232959-285a-4954-a3ac-571a2b817017+24:2392:x1874741481772288:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 117us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893130.310239:0:10383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 10 00000100:00100000:0.0:1787893130.313707:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893130.313814:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481772544 00000100:00100000:3.0:1787893130.313825:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481772544 00000100:00100000:3.0:1787893130.313885:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 34 00000100:00100000:3.0:1787893130.313895:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+24:11411:x1874741481772544:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787893130.314180:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+25:11411:x1874741481772544:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 Request processed in 285us (487us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1787893130.314189:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 34 00000004:00080000:0.0:1787893130.418363:0:10004:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 374239868804ns, next at 375239866064ns, rc = 0 00000100:00100000:1.0:1787893130.418465:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493377920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787893130.418574:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893130.420145:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493377920 00000100:00100000:0.0:1787893130.420158:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493377920 00000100:00100000:0.0:1787893130.420225:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787893130.420235:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3633:x1874741493377920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787893130.420273:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1787893130.420339:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3633:x1874741493377920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (1766us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893130.420346:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787893130.420480:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787893130.420513:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493378048:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787893130.420560:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893130.420636:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493377920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787893130.420671:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493378432:0@lo:400:kworker.0 00000100:00100000:1.0:1787893130.420707:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893130.420735:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c6e6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1874741493378944:0@lo:400:kworker.0 00000100:00100000:1.0:1787893130.420761:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893130.420790:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d0f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1874741493379456:0@lo:400:kworker.0 00000100:00100000:1.0:1787893130.420810:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893130.420829:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787893130.420834:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874741493378304:0@lo:400:kworker.0 00000100:00100000:1.0:1787893130.420854:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893130.420871:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1874741493378816:0@lo:400:kworker.0 00000100:00100000:1.0:1787893130.420890:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893130.420908:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c6e6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1874741493379328:0@lo:400:kworker.0 00000100:00100000:1.0:1787893130.420928:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893130.420953:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493378944 00000100:00100000:1.0:1787893130.420957:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493378944 00000100:00100000:1.0:1787893130.420985:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493379456 00000100:00100000:1.0:1787893130.420988:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493379456 00000100:00100000:1.0:1787893130.421021:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493378304 00000100:00100000:1.0:1787893130.421024:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493378304 00000100:00100000:1.0:1787893130.421034:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493378816 00000100:00100000:1.0:1787893130.421036:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493378816 00000100:00100000:1.0:1787893130.421044:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493379328 00000100:00100000:1.0:1787893130.421046:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493379328 00000100:00100000:1.0:1787893130.421058:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1787893130.421065:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1874741493378944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893130.421104:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1787893130.421106:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1874741493378944:12345-0@lo:400:kworker.0 Request processed in 40us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893130.421118:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1787893130.421119:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1874741493379456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893130.421136:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1787893130.421143:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1874741493378304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893130.421172:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1874741493379456:12345-0@lo:400:kworker.0 Request processed in 58us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893130.421180:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1787893130.421185:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1874741493378304:12345-0@lo:400:kworker.0 Request processed in 41us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893130.421193:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1787893130.421198:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1787893130.421207:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1874741493378816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893130.421212:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1787893130.421222:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1874741493379328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893130.421236:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1874741493378816:12345-0@lo:400:kworker.0 Request processed in 30us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893130.421242:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1787893130.421256:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1874741493379328:12345-0@lo:400:kworker.0 Request processed in 36us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893130.421263:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1787893130.421290:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493378176:0@lo:400:kworker.0 00000100:00100000:1.0:1787893130.421315:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893130.421346:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493378688:0@lo:400:kworker.0 00000100:00100000:3.0:1787893130.421361:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493378176 00000100:00100000:3.0:1787893130.421366:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493378176 00000100:00100000:1.0:1787893130.421371:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893130.421392:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c6e6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493379200:0@lo:400:kworker.0 00000100:00100000:3.0:1787893130.421401:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1787893130.421411:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+24:3631:x1874741493378176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893130.421433:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893130.421450:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+24:3631:x1874741493378176:12345-0@lo:400:kworker.0 Request processed in 40us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893130.421457:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1787893130.421468:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493378176:0@lo:400:kworker.0 00000100:00100000:1.0:1787893130.421481:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787893130.421529:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1874741493378560:0@lo:400:kworker.0 00000100:00100000:1.0:1787893130.421552:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893130.421564:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c6e6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493379072:0@lo:400:kworker.0 00000100:00100000:1.0:1787893130.421582:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893130.421607:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493378432 00000100:00100000:1.0:1787893130.421611:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493378432 00000100:00100000:3.0:1787893130.421617:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493378560 00000100:00100000:3.0:1787893130.421623:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493378560 00000100:00100000:1.0:1787893130.421639:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493378688 00000100:00100000:1.0:1787893130.421644:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493378688 00000100:00100000:3.0:1787893130.421654:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1787893130.421663:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1874741493378560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893130.421667:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787893130.421678:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493378432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893130.421702:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1874741493378560:12345-0@lo:400:kworker.0 Request processed in 41us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893130.421709:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1787893130.421724:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493378432:12345-0@lo:400:kworker.0 Request processed in 47us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893130.421732:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787893130.421741:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1874741493378560:0@lo:400:kworker.0 00000100:00100000:1.0:1787893130.421749:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787893130.421758:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe349180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493378688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893130.421795:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe349180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493378688:12345-0@lo:400:kworker.0 Request processed in 40us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893130.421801:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787893130.421818:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493379200 00000100:00100000:1.0:1787893130.421822:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493379200 00000100:00100000:1.0:1787893130.421840:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493379072 00000100:00100000:1.0:1787893130.421842:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493379072 00000100:00100000:3.0:1787893130.421867:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493378688:0@lo:400:kworker.0 00000100:00100000:1.0:1787893130.421867:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787893130.421878:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3631:x1874741493379200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893130.421903:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787893130.421913:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493379072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893130.421920:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3631:x1874741493379200:12345-0@lo:400:kworker.0 Request processed in 43us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893130.421928:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787893130.421953:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493379072:12345-0@lo:400:kworker.0 Request processed in 41us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893130.421961:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874741493378304:0@lo:400:kworker.0 00000100:00100000:3.0:1787893130.421962:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787893130.421978:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1874741493378816:0@lo:400:kworker.0 00000100:00100000:1.0:1787893130.421993:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c6e6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1874741493379328:0@lo:400:kworker.0 00000100:00100000:3.0:1787893130.421999:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c6e6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493379072:0@lo:400:kworker.0 00010000:00080000:1.0:1787893130.422024:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9c6e6f480 x1874741493378944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893130.422025:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c6e6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493379200:0@lo:400:kworker.0 00000100:00100000:1.0:1787893130.422041:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c6e6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1874741493378944:0@lo:400:kworker.0 00010000:00080000:1.0:1787893130.422057:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9d0f52a00 x1874741493379456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893130.422065:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d0f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1874741493379456:0@lo:400:kworker.0 00000100:00100000:1.0:1787893130.422072:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493378432:0@lo:400:kworker.0 00000100:00100000:2.0:1787893130.422340:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493378048 00000100:00100000:2.0:1787893130.422346:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493378048 00000100:00100000:2.0:1787893130.422384:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787893130.422392:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493378048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787893130.422406:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:2.0:1787893130.422462:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493378048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (1892us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893130.422469:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:2.0:1787893130.422526:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787893130.422530:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493378048:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787893130.422531:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787893130.422536:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787893130.422538:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787893130.931111:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893131.291990:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893131.292038:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893131.292062:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893131.292090:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893131.294792:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893131.294855:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893131.294891:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481772800 00000100:00100000:3.0:1787893131.298237:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481772800 00000100:00100000:3.0:1787893131.298330:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481773312 00000100:00100000:3.0:1787893131.298335:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481773312 00000100:00100000:3.0:1787893131.298352:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481772928 00000100:00100000:3.0:1787893131.298355:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481772928 00000100:00100000:3.0:1787893131.298379:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 327 00000100:00100000:3.0:1787893131.298389:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d0f53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+25:2390:x1874741481772800:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893131.298471:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d0f53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+25:2390:x1874741481772800:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 83us (6491us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893131.298479:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 327 00000100:00100000:3.0:1787893131.298510:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 328 00000100:00100000:3.0:1787893131.298517:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d0f52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481773312:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893131.298687:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d0f52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481773312:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 169us (6622us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893131.298694:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 328 00000100:00100000:3.0:1787893131.298708:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 329 00000100:00100000:3.0:1787893131.298715:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481772928:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893131.298738:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481772928:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 24us (3956us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893131.298761:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 329 00000100:00100000:3.0:1787893131.298791:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481772672 00000100:00100000:3.0:1787893131.298795:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481772672 00000100:00100000:3.0:1787893131.298819:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 389 00000100:00100000:3.0:1787893131.298825:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2390:x1874741481772672:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893131.298847:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2390:x1874741481772672:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 23us (6757us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893131.298853:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 389 00000100:00100000:3.0:1787893131.298879:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481773056 00000100:00100000:3.0:1787893131.298883:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481773056 00000100:00100000:3.0:1787893131.298910:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481773184 00000100:00100000:3.0:1787893131.298913:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481773184 00000100:00100000:3.0:1787893131.298934:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 123 00000100:00100000:3.0:1787893131.298940:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d0f51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58232959-285a-4954-a3ac-571a2b817017+7:2390:x1874741481773056:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893131.298965:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d0f51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58232959-285a-4954-a3ac-571a2b817017+7:2390:x1874741481773056:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 25us (6927us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893131.298971:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 123 00000100:00100000:3.0:1787893131.298981:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 124 00000100:00100000:3.0:1787893131.298986:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58232959-285a-4954-a3ac-571a2b817017+6:2390:x1874741481773184:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893131.299019:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58232959-285a-4954-a3ac-571a2b817017+6:2390:x1874741481773184:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 32us (4163us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893131.299025:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 124 00000100:00080000:3.0:1787893131.299040:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787893131.299044:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787893131.299047:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787893131.299056:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787893131.307187:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893131.307417:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481773440 00000100:00100000:0.0:1787893131.307427:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481773440 00000100:00100000:0.0:1787893131.307533:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 330 00000100:00100000:0.0:1787893131.307553:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481773440:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893131.307624:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481773440:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 83us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893131.307632:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 330 00000100:00080000:3.0:1787893131.307799:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:3.0:1787893131.915688:0:14352:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787893131.915697:0:14352:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787893131.915729:0:14352:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787893131.915738:0:14352:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787893131.954888:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893132.232401:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893132.232637:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481773696 00000100:00100000:0.0:1787893132.232656:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481773696 00000100:00100000:0.0:1787893132.232718:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 145 00000100:00100000:0.0:1787893132.232729:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+25:11431:x1874741481773696:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787893132.232748:0:10086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893132.232767:0:10086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf15d0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa901 expref: -99 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893132.232872:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf15d7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893132.232885:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf15d7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893132.233047:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf15d7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893132.233078:0:10086:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787893132.233193:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf15d0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa901 expref: 28 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893132.233212:0:10086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf15d7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa901 expref: 27 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893132.233221:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc9c3918e00) 00010000:00010000:0.0:1787893132.233223:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787893132.233226:0:10086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb31c00, rc 0) 00000100:00100000:0.0:1787893132.233293:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+27:11431:x1874741481773696:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 565us (900us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1787893132.233300:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 145 00000100:00100000:3.0:1787893132.238366:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893132.238433:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481773824 00000100:00100000:0.0:1787893132.238443:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481773824 00000100:00100000:0.0:1787893132.238529:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 146 00000100:00100000:0.0:1787893132.238540:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+27:11431:x1874741481773824:12345-192.168.202.35@tcp:54:lfs.0 00010000:00010000:0.0:1787893132.238604:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf15e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893132.238620:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf15e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893132.238632:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf15e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893132.239121:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf15e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893132.239214:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf15e5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893132.239221:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf15e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893132.239226:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893132.239231:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf15e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893132.239238:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf15e5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893132.239251:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc9c3918e00) 00010000:00010000:0.0:1787893132.239254:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787893132.239258:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf15e5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893132.239264:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf15e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893132.239344:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+27:11431:x1874741481773824:12345-192.168.202.35@tcp:54:lfs.0 Request processed in 805us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893132.239352:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 146 00000040:00080000:3.0:1787893132.337714:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787893132.337724:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787893132.337743:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787893132.337753:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787893132.360059:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893132.360147:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481773952 00000100:00100000:3.0:1787893132.360158:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481773952 00000100:00100000:3.0:1787893132.360217:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 53 00000100:00100000:3.0:1787893132.360227:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58232959-285a-4954-a3ac-571a2b817017+6:2392:x1874741481773952:12345-192.168.202.35@tcp:101:cat.0 00010000:00010000:3.0:1787893132.360243:0:8421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893132.360264:0:8421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e727c74a/0x9232577658cf15ec lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa908 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787893132.360300:0:8421:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a911589, atime: 0x6a911588, ctime: 0x6a911589, blocks: 0x8 00010000:00010000:3.0:1787893132.360320:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=376s v=(0 0) 00010000:00010000:3.0:1787893132.360325:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893132.360335:0:8421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e727c74a/0x9232577658cf15ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa908 expref: 7 pid: 8421 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893132.360356:0:8421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e727c74a/0x9232577658cf15ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa908 expref: 7 pid: 8421 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893132.360386:0:8421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c771fa00, rc 0) 00000100:00100000:3.0:1787893132.360448:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58232959-285a-4954-a3ac-571a2b817017+7:2392:x1874741481773952:12345-192.168.202.35@tcp:101:cat.0 Request processed in 223us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893132.360455:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 53 00000100:00100000:3.0:1787893132.367810:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893132.371415:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481774080 00000100:00100000:0.0:1787893132.371430:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481774080 00002000:00100000:1.0:1787893132.371873:0:8426:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff9fc9ffc5fb80 x1874741481774080/t0(0) o3->58232959-285a-4954-a3ac-571a2b817017@192.168.202.35@tcp:293/0 lens 488/0 e 0 to 0 dl 1787893143 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787893132.371886:0:8426:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc9ffc5fb80 with x1874741481774080 ext(0->4095) 00002000:00010000:1.0:1787893132.371892:0:8426:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fc9ffc5fb80 00000100:00100000:1.0:1787893132.371966:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 3 00000100:00100000:1.0:1787893132.371976:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:58232959-285a-4954-a3ac-571a2b817017+7:2392:x1874741481774080:12345-192.168.202.35@tcp:3:cat.0 00000100:00100000:1.0:1787893132.372189:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:58232959-285a-4954-a3ac-571a2b817017+7:2392:x1874741481774080:12345-192.168.202.35@tcp:3:cat.0 Request processed in 212us (4388us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787893132.372212:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 3 00002000:00100000:1.0:1787893132.372219:0:8426:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff9fc9ffc5fb80 x1874741481774080/t0(0) o3->58232959-285a-4954-a3ac-571a2b817017@192.168.202.35@tcp:293/0 lens 488/4536 e 0 to 0 dl 1787893143 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787893132.372226:0:8426:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc9ffc5fb80 with x1874741481774080 ext(0->4095) 00002000:00010000:1.0:1787893132.372230:0:8426:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fc9ffc5fb80 00000100:00100000:2.0:1787893132.466558:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787893132.466580:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d017f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493379584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787893132.466660:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893132.466729:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493379584 00000100:00100000:2.0:1787893132.466738:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493379584 00000100:00100000:2.0:1787893132.466793:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787893132.466802:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d017dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3631:x1874741493379584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787893132.466832:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00080000:3.0:1787893132.466872:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787893132.466894:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d017dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3631:x1874741493379584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893132.466901:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787893132.466919:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d017f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493379584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787893132.469334:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787893132.469363:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493379712:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787893132.469420:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893132.469764:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493379712 00000100:00100000:1.0:1787893132.469772:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493379712 00000100:00080000:3.0:1787893132.469831:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787893132.469839:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787893132.469849:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493379712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787893132.469873:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787893132.469925:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493379712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893132.469932:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787893132.470176:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493379712:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1787893132.914575:0:13789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787893132.977818:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893134.002781:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d15c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493379840:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787893134.003340:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787893134.003577:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893134.003691:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493379840 00000100:00100000:2.0:1787893134.003701:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493379840 00000100:00100000:2.0:1787893134.003749:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787893134.003759:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493379840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787893134.003792:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787893134.003841:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493379840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893134.003848:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787893134.004191:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d15c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493379840:0@lo:41:osp-pre-1-0.0 00000001:00080000:1.0:1787893134.004768:0:8413:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:1.0:1787893134.004779:0:8413:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:3.0:1787893135.028834:0:9497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:3.0:1787893135.028848:0:9497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1787893135.028976:0:6484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000004:00080000:0.0:1787893135.028985:0:6484:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:0.0:1787893135.029019:0:6484:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fc8c73f96c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1787893135.029024:0:6484:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fc9fd038000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fc8c73f9840 00000020:00080000:0.0:1787893135.029027:0:6484:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fc9fd038500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fc8c7ea1a00 00000020:00080000:0.0:1787893135.029040:0:6484:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000100:00100000:3.0:1787893135.029082:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787893135.029103:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493379968:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787893135.029172:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787893135.029186:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf1567 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893135.029196:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf1567 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893135.029203:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf1567 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893135.029209:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893135.029213:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf1567 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893135.029220:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf1567 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893135.029236:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fc9d0fd6000) 00010000:00010000:2.0:1787893135.029239:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893135.029251:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf1567 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893135.029258:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf1567 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787893135.029287:0:6536:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1787893135.029342:0:6536:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:0.0:1787893135.029377:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493379968 00000100:00100000:0.0:1787893135.029384:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493379968 00000100:00100000:0.0:1787893135.029444:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787893135.029454:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493379968:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1787893135.029514:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1787893135.029576:0:8419:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1787893135.029580:0:8419:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1787893129 -> 1787893129 00002000:00010000:0.0:1787893135.029583:0:8419:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 1787893128 -> 1787893128 00002000:00010000:0.0:1787893135.029585:0:8419:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1787893129 -> 1787893129 00002000:00010000:0.0:1787893135.029587:0:8419:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1787893135.029630:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3632:x1874741493379968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 177us (458us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1787893135.029637:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787893135.029662:0:3632:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1787893135.029667:0:3632:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fc9ffc9a680, transno 4294967310 00000004:00080000:3.0:1787893135.029686:0:3632:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1787893135.029710:0:3632:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9fc9ffc5d500 x1874741493379968/t4294967313(4294967313) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787893151 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1787893135.029720:0:3632:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fc9ffc5d500/2, rc 0, transno 4294967313 00000100:00100000:3.0:1787893135.029725:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493379968:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1787893135.030092:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893135.030314:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d15c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493380096:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787893135.030352:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893135.030410:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493380096 00000100:00100000:2.0:1787893135.030416:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493380096 00000100:00100000:2.0:1787893135.030447:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787893135.030455:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493380096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787893135.030481:0:7865:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1787893135.030757:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493380096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 302us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893135.030765:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787893135.030825:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d15c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493380096:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787893135.537680:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493380224:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787893135.537710:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787893135.537722:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d15c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493380352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787893135.537750:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893135.537840:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493380224 00000100:00100000:0.0:1787893135.537847:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493380224 00000100:00100000:0.0:1787893135.537903:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787893135.537928:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c778ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493380224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787893135.537957:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787893135.538028:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c778ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493380224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893135.538035:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787893135.538555:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893135.538640:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493380224:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787893135.538705:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493380352 00000100:00100000:1.0:1787893135.538717:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493380352 00000100:00100000:1.0:1787893135.538749:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787893135.538756:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3633:x1874741493380352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787893135.538768:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1787893135.538800:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3633:x1874741493380352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893135.538828:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:3.0:1787893135.540262:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787893135.540272:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787893135.540295:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d017f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493380480:0@lo:400:kworker.0 00000100:00100000:2.0:1787893135.540349:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493380608:0@lo:400:kworker.0 00000100:00100000:3.0:1787893135.540353:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893135.540380:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893135.540386:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7117100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493380864:0@lo:400:kworker.0 00000100:00100000:2.0:1787893135.540399:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7114e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493381120:0@lo:400:kworker.0 00000100:00100000:3.0:1787893135.540408:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893135.540425:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493381376:0@lo:400:kworker.0 00000100:00100000:3.0:1787893135.540448:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893135.540467:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787893135.540472:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493380992:0@lo:400:kworker.0 00000100:00100000:3.0:1787893135.540523:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893135.540540:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c772c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493381504:0@lo:400:kworker.0 00000100:00100000:3.0:1787893135.540561:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893135.540587:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493380480 00000100:00100000:3.0:1787893135.540593:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493380480 00000100:00100000:3.0:1787893135.540629:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1787893135.540651:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+24:3632:x1874741493380480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893135.540695:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+24:3632:x1874741493380480:12345-0@lo:400:kworker.0 Request processed in 57us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893135.540702:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1787893135.540732:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493380608 00000100:00100000:3.0:1787893135.540735:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493380608 00000100:00100000:3.0:1787893135.540760:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493380864 00000100:00100000:3.0:1787893135.540763:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493380864 00000100:00100000:3.0:1787893135.540782:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1787893135.540788:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c772ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493380608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893135.540820:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c772ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493380608:12345-0@lo:400:kworker.0 Request processed in 33us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893135.540838:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1787893135.540852:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1787893135.540857:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493380864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893135.540887:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493380864:12345-0@lo:400:kworker.0 Request processed in 30us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893135.540892:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493380736:0@lo:400:kworker.0 00000100:00100000:3.0:1787893135.540893:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1787893135.540910:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493381376 00000100:00100000:3.0:1787893135.540914:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493381376 00000100:00100000:2.0:1787893135.540917:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893135.540935:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7115f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1874741493381248:0@lo:400:kworker.0 00000100:00100000:3.0:1787893135.540941:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493381504 00000100:00100000:3.0:1787893135.540944:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493381504 00000100:00100000:2.0:1787893135.540956:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893135.540977:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787893135.540983:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493381376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893135.540985:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c772df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1874741493381760:0@lo:400:kworker.0 00000100:00100000:2.0:1787893135.541006:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893135.541010:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493381376:12345-0@lo:400:kworker.0 Request processed in 28us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893135.541017:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787893135.541028:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787893135.541034:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d1592d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493381504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893135.541034:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493381248 00000100:00100000:2.0:1787893135.541037:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493381248 00000100:00100000:3.0:1787893135.541060:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d1592d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493381504:12345-0@lo:400:kworker.0 Request processed in 27us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893135.541065:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493381760 00000100:00100000:3.0:1787893135.541066:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787893135.541067:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493381760 00000100:00100000:2.0:1787893135.541080:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1787893135.541086:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c71b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1874741493381248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893135.541194:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c71b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1874741493381248:12345-0@lo:400:kworker.0 Request processed in 107us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893135.541200:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1787893135.541214:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1787893135.541220:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1874741493381760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893135.541247:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1874741493381760:12345-0@lo:400:kworker.0 Request processed in 28us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893135.541251:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1787893135.541269:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493380992 00000100:00100000:2.0:1787893135.541272:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493380992 00000100:00100000:2.0:1787893135.541292:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493380736 00000100:00100000:2.0:1787893135.541294:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493380736 00000100:00100000:2.0:1787893135.541304:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787893135.541309:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d1593100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493380992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893135.541338:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d1593100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493380992:12345-0@lo:400:kworker.0 Request processed in 29us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893135.541343:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787893135.541353:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787893135.541358:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c71b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493380736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893135.541382:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c71b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493380736:12345-0@lo:400:kworker.0 Request processed in 25us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893135.541387:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787893135.541409:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893135.541598:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493380992:0@lo:400:kworker.0 00000100:00100000:3.0:1787893135.541610:0:3632:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1787893135.541616:0:3632:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:3.0:1787893135.541634:0:3632:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fc9ffc9a300, transno 4294967305 00000100:00100000:3.0:1787893135.543151:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c772c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493381504:0@lo:400:kworker.0 00000100:00100000:3.0:1787893135.543196:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7117100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493380864:0@lo:400:kworker.0 00000100:00100000:3.0:1787893135.543208:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493381376:0@lo:400:kworker.0 00000100:00100000:3.0:1787893135.543218:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d017f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493380480:0@lo:400:kworker.0 00000100:00100000:2.0:1787893135.543251:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c772e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1874741493381632:0@lo:400:kworker.0 00000100:00100000:3.0:1787893135.543265:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493381120 00000100:00100000:3.0:1787893135.543270:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493381120 00000100:00100000:2.0:1787893135.543295:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893135.543309:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493381632 00000100:00100000:3.0:1787893135.543311:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493381632 00000100:00100000:3.0:1787893135.543329:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1787893135.543329:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493380608:0@lo:400:kworker.0 00000100:00100000:3.0:1787893135.543336:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493381120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893135.543360:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493380736:0@lo:400:kworker.0 00010000:00080000:2.0:1787893135.543373:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9e7115f80 x1874741493381248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893135.543383:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493381120:12345-0@lo:400:kworker.0 Request processed in 47us (1973us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893135.543384:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7115f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1874741493381248:0@lo:400:kworker.0 00000100:00100000:3.0:1787893135.543390:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00010000:00080000:2.0:1787893135.543395:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c772df80 x1874741493381760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893135.543403:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c772df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1874741493381760:0@lo:400:kworker.0 00000100:00100000:3.0:1787893135.543405:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1787893135.543411:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874741493381632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893135.543438:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874741493381632:12345-0@lo:400:kworker.0 Request processed in 27us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893135.543444:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1787893135.543449:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7114e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493381120:0@lo:400:kworker.0 00000100:00100000:2.0:1787893135.543458:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c772e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1874741493381632:0@lo:400:kworker.0 00000100:00080000:3.0:1787893135.543463:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787893135.543466:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787893135.543469:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787893135.545257:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d15c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493380352:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787893136.049744:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893136.419670:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893136.419722:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893136.419760:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893136.419797:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893136.419830:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893136.419849:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893136.419889:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893136.419912:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481774464 00000100:00100000:1.0:1787893136.419912:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481774720 00000100:00100000:3.0:1787893136.419921:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481774464 00000100:00100000:1.0:1787893136.419921:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481774720 00000100:00100000:2.0:1787893136.420018:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481774976 00000100:00100000:2.0:1787893136.420023:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481774976 00000100:00100000:3.0:1787893136.420080:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481774336 00000100:00100000:3.0:1787893136.420083:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481774336 00000100:00100000:0.0:1787893136.420136:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481774208 00000100:00100000:0.0:1787893136.420141:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481774208 00000100:00100000:0.0:1787893136.420174:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 391 00000100:00100000:0.0:1787893136.420184:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2390:x1874741481774208:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893136.420248:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2390:x1874741481774208:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 66us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893136.420255:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 391 00000100:00100000:0.0:1787893136.420372:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481774848 00000100:00100000:0.0:1787893136.420377:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481774848 00000100:00100000:1.0:1787893136.424288:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481774592 00000100:00100000:1.0:1787893136.424303:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481774592 00000100:00100000:1.0:1787893136.424344:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 127 00000100:00100000:1.0:1787893136.424355:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58232959-285a-4954-a3ac-571a2b817017+6:2390:x1874741481774720:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893136.424436:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58232959-285a-4954-a3ac-571a2b817017+6:2390:x1874741481774720:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 83us (4674us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893136.424444:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 127 00000100:00100000:1.0:1787893136.424461:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 128 00000100:00100000:1.0:1787893136.424468:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c772df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481774592:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893136.424514:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c772df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481774592:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 47us (4663us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893136.424520:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 128 00000100:00100000:2.0:1787893136.425590:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 337 00000100:00100000:2.0:1787893136.425601:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d1591f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481774464:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893136.425643:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d1591f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+5:2390:x1874741481774464:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 45us (5921us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893136.425650:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 337 00000100:00100000:2.0:1787893136.425666:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 338 00000100:00100000:2.0:1787893136.425673:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d017f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481774976:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893136.425696:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d017f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481774976:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 24us (5899us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893136.425714:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 338 00000100:00080000:2.0:1787893136.425758:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787893136.425763:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787893136.425765:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787893136.425767:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787893136.429632:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 339 00000100:00100000:3.0:1787893136.429646:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c772e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+13:2390:x1874741481774336:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893136.429721:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c772e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+13:2390:x1874741481774336:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 79us (9890us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893136.429728:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 339 00000100:00100000:0.0:1787893136.435574:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 340 00000100:00100000:0.0:1787893136.435587:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c772c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481774848:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893136.435669:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c772c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481774848:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 85us (15779us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893136.435676:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 340 00010000:00010000:3.0:1787893137.074608:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893137.590470:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787893137.593894:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893137.594121:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481775104 00000100:00100000:2.0:1787893137.594131:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481775104 00000100:00100000:2.0:1787893137.594191:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 147 00000100:00100000:2.0:1787893137.594203:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7115f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+13:11076:x1874741481775104:12345-192.168.202.35@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787893137.594620:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7115f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+13:11076:x1874741481775104:12345-192.168.202.35@tcp:60:lhsmtool_posix.0 Request processed in 417us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893137.594628:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 147 00000100:00100000:1.0:1787893137.596615:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493381888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787893137.596735:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893137.596817:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7114e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493382016:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787893137.596845:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893137.597154:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493381888 00000100:00100000:3.0:1787893137.597163:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493381888 00000100:00100000:3.0:1787893137.597228:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493382016 00000100:00100000:3.0:1787893137.597232:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493382016 00000100:00100000:3.0:1787893137.597249:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787893137.597256:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7788700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493381888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787893137.597283:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787893137.597329:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7788700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493381888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893137.597336:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787893137.597362:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787893137.597368:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493382016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787893137.597379:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787893137.597406:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493382016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893137.597442:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:1.0:1787893137.598611:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787893137.598667:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493381888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787893137.598682:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7114e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493382016:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787893137.604919:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893137.605038:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481775232 00000100:00100000:3.0:1787893137.605049:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481775232 00000100:00100000:3.0:1787893137.605118:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 148 00000100:00100000:3.0:1787893137.605129:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7db1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+5:11076:x1874741481775232:12345-192.168.202.35@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787893137.605231:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7db1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+5:11076:x1874741481775232:12345-192.168.202.35@tcp:60:lhsmtool_posix.0 Request processed in 104us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893137.605238:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 148 00000100:00100000:2.0:1787893137.613432:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893137.613888:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481775488 00000100:00100000:3.0:1787893137.615213:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481775488 00000100:00100000:2.0:1787893137.615626:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 35 00000100:00100000:2.0:1787893137.616190:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+13:11076:x1874741481775488:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787893137.617337:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+14:11076:x1874741481775488:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 Request processed in 1689us (3904us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1787893137.617352:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 35 00000100:00100000:0.0:1787893138.029470:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893138.030588:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481775616 00000100:00100000:3.0:1787893138.030605:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481775616 00000100:00100000:3.0:1787893138.030782:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 149 00000100:00100000:3.0:1787893138.030797:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:11890:x1874741481775616:12345-192.168.202.35@tcp:101:lsof.0 00010000:00010000:3.0:1787893138.030826:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893138.030995:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf15f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa90f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893138.031079:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf15fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893138.031093:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf15fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893138.031107:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf15fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893138.031157:0:6506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787893138.031176:0:6506:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787893138.031240:0:6506:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf15fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893138.031268:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf15f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa90f expref: 7 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893138.031292:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf15fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa90f expref: 6 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893138.031302:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9d0fd6b00) 00010000:00010000:3.0:1787893138.031306:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787893138.031309:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c771f400, rc 0) 00000100:00100000:3.0:1787893138.031391:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c50492c-5fef-4e80-9bbb-0b2782d59443+6:11890:x1874741481775616:12345-192.168.202.35@tcp:101:lsof.0 Request processed in 598us (1936us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893138.031400:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 149 00000100:00080000:1.0:1787893138.032710:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787893138.100103:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893139.122042:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d15c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493382144:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787893139.122148:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893139.124388:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493382144 00000100:00100000:2.0:1787893139.124411:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493382144 00000100:00100000:2.0:1787893139.124536:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787893139.124550:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7db0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493382144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787893139.124602:0:7865:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787893139.124841:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7db0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493382144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 282us (2680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893139.124872:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787893139.125537:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d15c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493382144:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787893139.126341:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893140.145864:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893140.147439:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787893140.147483:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d15cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493382272:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787893140.147633:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893140.148191:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493382272 00000100:00100000:2.0:1787893140.148204:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493382272 00000100:00100000:2.0:1787893140.148274:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787893140.148286:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7115500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493382272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787893140.148330:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1787893140.148398:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7115500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493382272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893140.148413:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787893140.149275:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d15cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493382272:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787893140.657722:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493382784:0@lo:400:kworker.0 00000100:00100000:1.0:1787893140.657856:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893140.658007:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874741493382912:0@lo:400:kworker.0 00000100:00100000:2.0:1787893140.658046:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893140.658069:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1874741493383296:0@lo:400:kworker.0 00000100:00100000:2.0:1787893140.658084:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493383424:0@lo:400:kworker.0 00000100:00100000:1.0:1787893140.658095:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893140.658108:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893140.658126:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8481880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493383936:0@lo:400:kworker.0 00000100:00100000:1.0:1787893140.658126:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8481f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1874741493383808:0@lo:400:kworker.0 00000100:00100000:2.0:1787893140.658148:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893140.658148:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893140.658166:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787893140.658169:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 5 async RPCs [1->0] 00000100:00100000:1.0:1787893140.658172:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874741493382656:0@lo:400:kworker.0 00000100:00100000:2.0:1787893140.658173:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d29f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493382400:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787893140.658193:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893140.658194:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893140.658209:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493382528:0@lo:400:kworker.0 00000100:00100000:1.0:1787893140.658210:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1874741493383168:0@lo:400:kworker.0 00000100:00100000:3.0:1787893140.658315:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493382912 00000100:00100000:3.0:1787893140.658325:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493382912 00000100:00100000:3.0:1787893140.658577:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493383296 00000100:00100000:3.0:1787893140.658582:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493383296 00000100:00100000:3.0:1787893140.658618:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493383808 00000100:00100000:3.0:1787893140.658621:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493383808 00000100:00100000:3.0:1787893140.658636:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493382656 00000100:00100000:3.0:1787893140.658639:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493382656 00000100:00100000:3.0:1787893140.658716:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1787893140.658727:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874741493382912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893140.658831:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1787893140.658855:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893140.658856:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893140.658879:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493383040:0@lo:400:kworker.0 00000100:00100000:1.0:1787893140.658883:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1874741493383680:0@lo:400:kworker.0 00000100:00100000:2.0:1787893140.658907:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893140.658907:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893140.658929:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787893140.658932:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493383552:0@lo:400:kworker.0 00000100:00100000:1.0:1787893140.658936:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d15cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493384192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787893140.658975:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893140.659020:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493382784 00000100:00100000:1.0:1787893140.659025:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493382784 00000100:00100000:1.0:1787893140.659054:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493383040 00000100:00100000:1.0:1787893140.659057:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493383040 00000100:00100000:1.0:1787893140.659073:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787893140.659079:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8451500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493382784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893140.659135:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8451500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493382784:12345-0@lo:400:kworker.0 Request processed in 56us (1280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893140.659143:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787893140.659165:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787893140.659171:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493383040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893140.659201:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493383040:12345-0@lo:400:kworker.0 Request processed in 31us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893140.659207:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787893140.659248:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493382784:0@lo:400:kworker.0 00000100:00100000:2.0:1787893140.659249:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893140.659303:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493383424 00000100:00100000:1.0:1787893140.659307:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493383424 00000100:00100000:1.0:1787893140.659336:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493383936 00000100:00100000:1.0:1787893140.659339:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493383936 00000100:00100000:2.0:1787893140.659347:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493384064:0@lo:400:kworker.0 00000100:00100000:1.0:1787893140.659353:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493383552 00000100:00100000:1.0:1787893140.659355:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493383552 00000100:00100000:1.0:1787893140.659367:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787893140.659369:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893140.659374:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493383424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893140.659390:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493383040:0@lo:400:kworker.0 00000100:00100000:1.0:1787893140.659422:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493383424:12345-0@lo:400:kworker.0 Request processed in 48us (1312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893140.659429:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787893140.659446:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493384064 00000100:00100000:1.0:1787893140.659449:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493384064 00000100:00100000:1.0:1787893140.659466:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787893140.659471:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8483480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493383936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893140.659480:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493383424:0@lo:400:kworker.0 00000100:00100000:1.0:1787893140.659531:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8483480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493383936:12345-0@lo:400:kworker.0 Request processed in 59us (1381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893140.659537:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787893140.659549:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787893140.659555:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8482d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493383552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893140.659584:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8482d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493383552:12345-0@lo:400:kworker.0 Request processed in 29us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893140.659588:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8481880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493383936:0@lo:400:kworker.0 00000100:00100000:1.0:1787893140.659591:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787893140.659601:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493383552:0@lo:400:kworker.0 00000100:00100000:1.0:1787893140.659601:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787893140.659607:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3630:x1874741493384064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893140.659643:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3630:x1874741493384064:12345-0@lo:400:kworker.0 Request processed in 36us (273us total) trans 0 rc 0/0 00000100:00080000:2.0:1787893140.659647:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787893140.659649:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:2.0:1787893140.659652:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787893140.659655:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787893140.659666:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493382400 00000100:00100000:2.0:1787893140.659669:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493382400 00000100:00100000:1.0:1787893140.659669:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493383168 00000100:00100000:1.0:1787893140.659671:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493383168 00000100:00100000:1.0:1787893140.659692:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493383680 00000100:00100000:2.0:1787893140.659693:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493384192 00000100:00100000:2.0:1787893140.659695:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493384192 00000100:00100000:1.0:1787893140.659695:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493383680 00000100:00100000:2.0:1787893140.659706:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787893140.659706:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1787893140.659712:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493382400:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787893140.659712:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8453800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1874741493383808:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1787893140.659738:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1787893140.659748:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8453800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1874741493383808:12345-0@lo:400:kworker.0 Request processed in 37us (1599us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893140.659754:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1787893140.659767:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1787893140.659768:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493382400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (1573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893140.659774:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787893140.659778:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8451c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1874741493382656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893140.659786:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787893140.659791:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8451f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3633:x1874741493384192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787893140.659799:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1787893140.659806:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8451c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1874741493382656:12345-0@lo:400:kworker.0 Request processed in 29us (1612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893140.659812:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1787893140.659818:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8451f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3633:x1874741493384192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 27us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893140.659823:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787893140.659823:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1787893140.659828:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8453100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1874741493383168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893140.659849:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1787893140.659857:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8450e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1874741493383680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893140.659858:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8453100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1874741493383168:12345-0@lo:400:kworker.0 Request processed in 30us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893140.659863:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00080000:1.0:1787893140.659880:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787893140.659885:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8450e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1874741493383680:12345-0@lo:400:kworker.0 Request processed in 29us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893140.659891:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1787893140.659926:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d15cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493384192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787893140.659937:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d29f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493382400:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787893140.659938:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874741493382656:0@lo:400:kworker.0 00000100:00100000:1.0:1787893140.659949:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1874741493383168:0@lo:400:kworker.0 00000100:00100000:1.0:1787893140.659959:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1874741493383680:0@lo:400:kworker.0 00010000:00080000:1.0:1787893140.659972:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c8481f80 x1874741493383808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893140.659982:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8481f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1874741493383808:0@lo:400:kworker.0 00000100:00100000:2.0:1787893140.660187:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493384064:0@lo:400:kworker.0 00000100:00100000:2.0:1787893140.660220:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493382528 00000100:00100000:2.0:1787893140.660225:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493382528 00000100:00100000:2.0:1787893140.660332:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1787893140.660342:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+24:3630:x1874741493382528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893140.660386:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+24:3630:x1874741493382528:12345-0@lo:400:kworker.0 Request processed in 46us (1531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893140.660392:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1787893140.660545:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8453b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1874741493383296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893140.660587:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493382528:0@lo:400:kworker.0 00000100:00100000:0.0:1787893140.660602:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8453b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1874741493383296:12345-0@lo:400:kworker.0 Request processed in 65us (2506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893140.660609:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00010000:00080000:2.0:1787893140.660621:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb74380 x1874741493383296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893140.660630:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1874741493383296:0@lo:400:kworker.0 00000100:00100000:3.0:1787893140.665346:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874741493382912:12345-0@lo:400:kworker.0 Request processed in 6606us (7283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893140.665365:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1787893140.665852:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874741493382912:0@lo:400:kworker.0 00010000:00010000:1.0:1787893141.170111:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787893141.173918:0:9497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:3.0:1787893141.176052:0:6484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:3.0:1787893141.176076:0:6484:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1787893141.176152:0:6536:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1787893141.176165:0:6536:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1787893141.544667:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893141.544715:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893141.544751:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893141.544779:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893141.544799:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893141.544820:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893141.544866:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893141.544899:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481776256 00000100:00100000:1.0:1787893141.544921:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481776256 00000100:00100000:3.0:1787893141.544951:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481775744 00000100:00100000:3.0:1787893141.544958:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481775744 00000100:00100000:1.0:1787893141.544993:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481776128 00000100:00100000:1.0:1787893141.544997:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481776128 00000100:00100000:3.0:1787893141.545012:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 393 00000100:00100000:1.0:1787893141.545025:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 133 00000100:00100000:3.0:1787893141.545036:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2392:x1874741481775744:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893141.545038:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8452300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58232959-285a-4954-a3ac-571a2b817017+6:2392:x1874741481776256:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893141.545129:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481776000 00000100:00100000:2.0:1787893141.545134:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481776000 00000100:00100000:2.0:1787893141.545171:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481776512 00000100:00100000:2.0:1787893141.545173:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481776512 00000100:00100000:2.0:1787893141.545189:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481775872 00000100:00100000:2.0:1787893141.545191:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481775872 00000100:00100000:2.0:1787893141.545202:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481776384 00000100:00100000:2.0:1787893141.545204:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481776384 00000100:00100000:2.0:1787893141.545216:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 347 00000100:00100000:2.0:1787893141.545222:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8451880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+5:2392:x1874741481776000:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893141.545287:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8452300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58232959-285a-4954-a3ac-571a2b817017+6:2392:x1874741481776256:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 253us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893141.545295:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 133 00000100:00100000:1.0:1787893141.545314:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 134 00000100:00100000:1.0:1787893141.545319:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8453480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58232959-285a-4954-a3ac-571a2b817017+5:2392:x1874741481776128:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893141.546510:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2392:x1874741481775744:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 1452us (1827us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893141.546525:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 393 00000100:00100000:3.0:1787893141.546603:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 348 00000100:00100000:3.0:1787893141.546617:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8452680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2392:x1874741481776512:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893141.546663:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8452680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2392:x1874741481776512:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 51us (1883us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893141.546670:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 348 00000100:00100000:3.0:1787893141.546690:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 349 00000100:00100000:3.0:1787893141.546698:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8450000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+13:2392:x1874741481775872:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893141.546731:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8450000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+13:2392:x1874741481775872:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 35us (1931us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893141.546737:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 349 00000100:00100000:3.0:1787893141.546749:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 350 00000100:00100000:3.0:1787893141.546765:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8450a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c50492c-5fef-4e80-9bbb-0b2782d59443+6:2392:x1874741481776384:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893141.546795:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8450a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c50492c-5fef-4e80-9bbb-0b2782d59443+6:2392:x1874741481776384:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 31us (1928us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893141.546801:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 350 00000100:00100000:2.0:1787893141.548840:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8451880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+5:2392:x1874741481776000:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 3603us (4109us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893141.548858:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 347 00000100:00100000:1.0:1787893141.550919:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8453480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58232959-285a-4954-a3ac-571a2b817017+5:2392:x1874741481776128:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 5574us (6073us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893141.550937:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 134 00000100:00080000:1.0:1787893141.551019:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787893141.551026:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787893141.551031:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787893141.551034:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1787893142.132171:0:13789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787893142.195649:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787893142.245758:0:14550:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 00:59:00 (1787893140) 00000040:00080000:2.0:1787893142.577665:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787893142.577674:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787893142.577777:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1787893142.577799:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787893142.705769:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e7117100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493384320:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787893142.705838:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893142.706306:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493384320 00000100:00100000:0.0:1787893142.706314:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493384320 00000100:00100000:0.0:1787893142.706387:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787893142.706397:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8450380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493384320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787893142.706426:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1787893142.706488:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787893142.707401:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787893142.707414:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493384448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787893142.707458:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893142.707512:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493384448 00000100:00100000:2.0:1787893142.707517:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493384448 00000100:00080000:3.0:1787893142.707538:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787893142.707553:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787893142.707560:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493384448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787893142.707575:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787893142.707619:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493384448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893142.707626:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787893142.707661:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493384448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787893142.707845:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8450380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493384320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1448us (2005us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893142.707852:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787893142.708007:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e7117100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493384320:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787893143.217771:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893143.536845:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893143.536942:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481776768 00000100:00100000:3.0:1787893143.536951:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481776768 00000100:00100000:3.0:1787893143.537035:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 150 00000100:00100000:3.0:1787893143.537047:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+13:12157:x1874741481776768:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787893143.537068:0:9515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893143.537089:0:9515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf1601 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa916 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893143.537155:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1608 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893143.537169:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1608 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893143.537181:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1608 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893143.537251:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf160f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893143.537259:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf160f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893143.537279:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf160f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893143.537368:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1616 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893143.537377:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1616 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893143.537385:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1616 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893143.537394:0:9515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1787893143.537467:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1608 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893143.537476:0:9515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1608 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893143.537483:0:9515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1608 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893143.537521:0:9515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c0030800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893143.537527:0:9515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1608 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893143.537536:0:9515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1608 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893143.537547:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fc9d5c29600) 00010000:00010000:3.0:1787893143.537550:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893143.537560:0:9515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1608 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893143.537567:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1608 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893143.537583:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf160f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893143.537589:0:9515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf160f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893143.537595:0:9515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf160f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893143.537600:0:9515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c0031400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893143.537603:0:9515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf160f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893143.537610:0:9515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf160f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893143.537617:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9fc9cab65800) 00010000:00010000:3.0:1787893143.537619:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893143.537622:0:9515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf160f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893143.537628:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf160f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893143.537883:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf1601 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa916 expref: 16 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893143.537923:0:9515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1616 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa916 expref: 15 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893143.537932:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fc9d5c29800) 00010000:00010000:3.0:1787893143.537935:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893143.537937:0:9515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9c0031000, rc 0) 00000100:00100000:3.0:1787893143.538006:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+15:12157:x1874741481776768:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 959us (1169us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1787893143.538015:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 150 00000100:00080000:0.0:1787893143.542868:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787893143.543604:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893143.544021:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481776896 00000100:00100000:2.0:1787893143.544031:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481776896 00000100:00100000:2.0:1787893143.544096:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 151 00000100:00100000:2.0:1787893143.544107:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+15:12157:x1874741481776896:12345-192.168.202.35@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787893143.544213:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+15:12157:x1874741481776896:12345-192.168.202.35@tcp:59:lhsmtool_posix.0 Request processed in 107us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893143.544221:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 151 00000100:00100000:2.0:1787893143.545001:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893143.545058:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481777024 00000100:00100000:3.0:1787893143.545064:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481777024 00000100:00100000:3.0:1787893143.545123:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 11 00000100:00100000:3.0:1787893143.545130:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3efc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58232959-285a-4954-a3ac-571a2b817017+15:2393:x1874741481777024:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893143.545141:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893143.545165:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1616 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa916 expref: 15 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893143.545185:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fc9d5c29800) 00010000:00010000:3.0:1787893143.545189:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893143.545223:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3efc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58232959-285a-4954-a3ac-571a2b817017+14:2393:x1874741481777024:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 93us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893143.545230:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 11 00000100:00100000:0.0:1787893143.550365:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893143.550558:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481777152 00000100:00100000:1.0:1787893143.550569:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481777152 00000100:00100000:1.0:1787893143.550648:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 152 00000100:00100000:1.0:1787893143.550659:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+5:12157:x1874741481777152:12345-192.168.202.35@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1787893143.550774:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787893143.550869:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+5:12157:x1874741481777152:12345-192.168.202.35@tcp:59:lhsmtool_posix.0 Request processed in 212us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893143.550876:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 152 00000040:00080000:2.0:1787893143.601770:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787893143.601779:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787893143.602698:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787893143.602711:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1787893144.179450:0:13789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787893144.242079:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d15cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493384576:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787893144.242169:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893144.242305:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493384576 00000100:00100000:1.0:1787893144.242313:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493384576 00000100:00100000:1.0:1787893144.242361:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787893144.242369:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493384576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787893144.242400:0:7865:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787893144.242639:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493384576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 270us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893144.242647:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00010000:00010000:1.0:1787893144.242834:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893144.243143:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d15cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493384576:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787893145.267144:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893145.272812:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787893145.272844:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8452d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493384704:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787893145.272939:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893145.273019:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493384704 00000100:00100000:1.0:1787893145.273028:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493384704 00000100:00100000:1.0:1787893145.273071:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787893145.273080:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8451180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493384704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787893145.273112:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1787893145.273158:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8451180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493384704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893145.273165:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787893145.273209:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8452d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493384704:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787893145.301690:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893145.301786:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481777280 00000100:00100000:1.0:1787893145.301804:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481777280 00000100:00100000:1.0:1787893145.301996:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 153 00000100:00100000:1.0:1787893145.302008:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7114e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+14:12199:x1874741481777280:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:1.0:1787893145.302028:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893145.302051:0:13436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf1624 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa91d expref: -99 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.302111:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf162b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.302124:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf162b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.302135:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf162b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.302150:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf1632 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.302158:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf1632 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.302165:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf1632 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.302208:0:13436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf162b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.302215:0:13436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf162b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.302222:0:13436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf162b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.302234:0:13436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe541200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893145.302238:0:13436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf162b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.302246:0:13436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf162b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.302259:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9d0fd6b00) 00010000:00010000:1.0:1787893145.302262:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893145.302267:0:13436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf162b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.302273:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf162b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.302284:0:13436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf1632 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.302291:0:13436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf1632 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.302297:0:13436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf1632 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.302302:0:13436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893145.302305:0:13436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf1632 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.302311:0:13436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf1632 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.302344:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9fc9c3918b00) 00010000:00010000:1.0:1787893145.302346:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893145.302349:0:13436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf1632 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.302355:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf1632 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.302387:0:13436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf1624 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa91d expref: 15 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.302396:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9d0fd6b00) 00010000:00010000:1.0:1787893145.302398:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893145.302402:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf1624 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa91d expref: 15 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.302411:0:13436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe541600, rc 0) 00000100:00100000:1.0:1787893145.302468:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7114e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+14:12199:x1874741481777280:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 463us (785us total) trans 0 rc 301/301 00000100:00100000:1.0:1787893145.302476:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 153 00000100:00080000:0.0:1787893145.306153:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787893145.307122:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893145.307228:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481777536 00000100:00100000:0.0:1787893145.307239:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481777536 00000100:00100000:0.0:1787893145.307299:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 154 00000100:00100000:0.0:1787893145.307308:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+14:12199:x1874741481777536:12345-192.168.202.35@tcp:36:lfs.0 00010000:00010000:0.0:1787893145.307369:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893145.307397:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fe00/0x9232577658cf0f78 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa741 expref: 14 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893145.307414:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9d0fd6b00) 00010000:00010000:0.0:1787893145.307419:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787893145.307479:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1639 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893145.307524:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf15fa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa90f expref: 5 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893145.307532:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1639 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893145.307562:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf15fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa90f expref: 5 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893145.307574:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf15fa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa90f expref: 5 pid: 6506 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893145.307589:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d15c9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6505:1874741493384832:192.168.202.35@tcp:104: 00000100:00100000:0.0:1787893145.307668:0:6505:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d7ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1787893145.311663:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d15c9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6505:1874741493384832:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787893145.311692:0:6505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1639 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893145.314301:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893145.314606:0:10383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481777664 00000100:00100000:1.0:1787893145.314616:0:10383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481777664 00010000:00010000:1.0:1787893145.314669:0:10383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf15fa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa90f expref: 6 pid: 6506 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893145.314710:0:10383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 79 00000100:00100000:1.0:1787893145.314720:0:10383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c50492c-5fef-4e80-9bbb-0b2782d59443+6:2390:x1874741481777664:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893145.314749:0:10383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893145.314756:0:10383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf15fa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa90f expref: 6 pid: 6506 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.314770:0:10383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf15fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa90f expref: 6 pid: 6506 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.314789:0:10383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf15fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa90f expref: 6 pid: 6506 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.314807:0:10383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9d0fd6b00) 00010000:00010000:1.0:1787893145.314812:0:10383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1639 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.314821:0:10383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1639 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.314829:0:10383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1639 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.314878:0:10383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893145.314926:0:10383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2390:x1874741481777664:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 208us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893145.314933:0:10383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 79 00010000:00010000:1.0:1787893145.314969:0:6505:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1639 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.314976:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1639 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.315018:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf1640 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.315027:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf1640 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.315033:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf1640 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.315675:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf1647 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.315687:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf1647 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.315695:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf1647 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787893145.315712:0:6505:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b9f11da5 reply state 00000000c6d28f3a transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf1647 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.315722:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf1647 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.315728:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc9c3918700) 00010000:00010000:1.0:1787893145.315731:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787893145.315734:0:6505:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787893145.315739:0:6505:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1787893145.315747:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1639 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.315752:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1639 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.315764:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1639 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.315769:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893145.315774:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1639 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.315780:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1639 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.315788:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9d0fd6b00) 00010000:00010000:1.0:1787893145.315791:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893145.315794:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1639 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.315799:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1639 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787893145.315814:0:6505:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b9f11da5 reply state 00000000c6d28f3a transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf1640 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.315821:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf1640 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.315826:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9fc9c3918100) 00010000:00010000:1.0:1787893145.315828:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787893145.315830:0:6505:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1787893145.315896:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+15:12199:x1874741481777536:12345-192.168.202.35@tcp:36:lfs.0 Request processed in 8588us (8779us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1787893145.315903:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 154 00000100:00080000:3.0:1787893145.316842:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787893145.418594:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893145.418769:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481777792 00000100:00100000:2.0:1787893145.418780:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481777792 00000100:00100000:2.0:1787893145.418894:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 155 00000100:00100000:2.0:1787893145.418905:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+15:12207:x1874741481777792:12345-192.168.202.35@tcp:101:lctl.0 00010000:00010000:2.0:1787893145.418929:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893145.418951:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fe00/0x9232577658cf164e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa924 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893145.419014:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f800/0x9232577658cf1655 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893145.419026:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f800/0x9232577658cf1655 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893145.419037:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f800/0x9232577658cf1655 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893145.419094:0:6506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787893145.419097:0:6506:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787893145.419116:0:6506:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f800/0x9232577658cf1655 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893145.419139:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fe00/0x9232577658cf164e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa924 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893145.419158:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f800/0x9232577658cf1655 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa924 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893145.419167:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc8c6614400) 00010000:00010000:2.0:1787893145.419170:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787893145.419173:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7f800, rc 0) 00000100:00100000:2.0:1787893145.419246:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+16:12207:x1874741481777792:12345-192.168.202.35@tcp:101:lctl.0 Request processed in 343us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893145.419254:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 155 00000100:00100000:1.0:1787893145.475430:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893145.475938:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481777920 00000100:00100000:3.0:1787893145.475948:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481777920 00000100:00100000:3.0:1787893145.476012:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 156 00000100:00100000:3.0:1787893145.476022:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8452d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+16:12213:x1874741481777920:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:3.0:1787893145.476042:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893145.476064:0:13436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf165c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa92b expref: -99 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.476128:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1663 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.476141:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1663 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.476151:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1663 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.476160:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf166a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.476181:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf166a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.476187:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf166a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.476278:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030c00/0x9232577658cf1671 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.476288:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030c00/0x9232577658cf1671 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.476294:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030c00/0x9232577658cf1671 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893145.476345:0:13436:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1787893145.476349:0:13436:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787893145.476368:0:13436:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030c00/0x9232577658cf1671 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.476381:0:13436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1663 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.476387:0:13436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1663 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.476393:0:13436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1663 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.476399:0:13436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c0031000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893145.476403:0:13436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1663 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.476417:0:13436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1663 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.476429:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc8c6614400) 00010000:00010000:3.0:1787893145.476432:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893145.476436:0:13436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1663 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.476442:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf1663 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.476456:0:13436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf166a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.476462:0:13436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf166a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.476467:0:13436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf166a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.476472:0:13436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c0030800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893145.476475:0:13436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf166a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.476482:0:13436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf166a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.476549:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9fc9c3918100) 00010000:00010000:3.0:1787893145.476552:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893145.476556:0:13436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf166a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.476572:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf166a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.476603:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf165c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa92b expref: 18 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.476619:0:13436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030c00/0x9232577658cf1671 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa92b expref: 17 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.476646:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc9c3918700) 00010000:00010000:3.0:1787893145.476650:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787893145.476653:0:13436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9c0030c00, rc 0) 00000100:00100000:3.0:1787893145.476712:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8452d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+17:12213:x1874741481777920:12345-192.168.202.35@tcp:101:bash.0 Request processed in 690us (1294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893145.476719:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 156 00000100:00100000:3.0:1787893145.484903:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893145.485355:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481778176 00000100:00100000:1.0:1787893145.485366:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481778176 00000100:00100000:1.0:1787893145.485432:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 157 00000100:00100000:1.0:1787893145.485442:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+17:12213:x1874741481778176:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:1.0:1787893145.485463:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893145.485483:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf1678 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa932 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.485612:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf167f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.485623:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf167f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.485640:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf167f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.485713:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf1686 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.485721:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf1686 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.485728:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf1686 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787893145.486054:0:6504:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:1.0:1787893145.486165:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf168d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.486172:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf168d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.486183:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf168d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.486205:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf167f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.486210:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf167f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.487562:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf167f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.487568:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe541c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893145.487571:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf167f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.487578:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf167f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.487590:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc9c3918700) 00010000:00010000:1.0:1787893145.487592:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893145.487595:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf167f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.487599:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf167f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787893145.487612:0:6504:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000afa9ac89 reply state 000000002ec2af25 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf1686 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.487619:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf1686 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.487643:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc9c3918b00) 00010000:00010000:1.0:1787893145.487645:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787893145.487647:0:6504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787893145.489865:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf1678 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa932 expref: 20 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893145.489905:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf168d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa932 expref: 19 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893145.489915:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918500) 00010000:00010000:0.0:1787893145.489918:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787893145.489920:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe540e00, rc 0) 00000100:00100000:0.0:1787893145.490033:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+20:12213:x1874741481778176:12345-192.168.202.35@tcp:101:bash.0 Request processed in 4591us (5137us total) trans 4294967419 rc 0/0 00000100:00100000:0.0:1787893145.490041:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 157 00000100:00100000:1.0:1787893145.496245:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893145.496341:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481778304 00000100:00100000:2.0:1787893145.496350:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481778304 00000100:00100000:2.0:1787893145.496418:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 55 00000100:00100000:2.0:1787893145.496428:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8450700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58232959-285a-4954-a3ac-571a2b817017+5:2392:x1874741481778304:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:2.0:1787893145.496444:0:8419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893145.496461:0:8419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f7df9f3/0x9232577658cf169b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa939 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787893145.496480:0:8419:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893145.496523:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=389s v=(0 0) 00010000:00010000:2.0:1787893145.496538:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893145.496546:0:8419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f7df9f3/0x9232577658cf169b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa939 expref: 6 pid: 8419 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893145.496561:0:8419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f7df9f3/0x9232577658cf169b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa939 expref: 6 pid: 8419 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893145.496571:0:8419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7fe00, rc 0) 00000100:00100000:2.0:1787893145.496619:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8450700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58232959-285a-4954-a3ac-571a2b817017+6:2392:x1874741481778304:12345-192.168.202.35@tcp:101:bash.0 Request processed in 194us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893145.496624:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 55 00000100:00080000:3.0:1787893145.497862:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787893145.504725:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893145.505105:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481778432 00000100:00100000:2.0:1787893145.505115:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481778432 00000100:00100000:2.0:1787893145.505175:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 56 00000100:00100000:2.0:1787893145.505185:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8452a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+6:12213:x1874741481778432:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:2.0:1787893145.505202:0:8420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893145.505221:0:8420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cbd5d59/0x9232577658cf16a2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa940 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893145.505252:0:8420:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f7df9f3/0x9232577658cf169b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa939 expref: 7 pid: 8419 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893145.505260:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893145.505264:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893145.505269:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cbd5d59/0x9232577658cf16a2 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa940 expref: 7 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893145.505432:0:8420:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003f7df9f3/0x9232577658cf169b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa939 expref: 7 pid: 8419 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893145.505450:0:8420:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003f7df9f3/0x9232577658cf169b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa939 expref: 7 pid: 8419 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893145.505465:0:8420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8482a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8420:1874741493384960:192.168.202.35@tcp:104: 00000100:00100000:2.0:1787893145.505707:0:8420:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9eee583c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787893145.518657:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893145.519111:0:8420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8482a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8420:1874741493384960:192.168.202.35@tcp:104: 00010000:00010000:2.0:1787893145.519148:0:8420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cbd5d59/0x9232577658cf16a2 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa940 expref: 7 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893145.519169:0:8420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7e000, rc 0) 00000100:00100000:3.0:1787893145.519429:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481778560 00000100:00100000:3.0:1787893145.519438:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481778560 00010000:00010000:3.0:1787893145.519477:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003f7df9f3/0x9232577658cf169b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa939 expref: 8 pid: 8419 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893145.519544:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 80 00000100:00100000:3.0:1787893145.519554:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58232959-285a-4954-a3ac-571a2b817017+8:2391:x1874741481778560:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893145.519568:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787893145.519573:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8452a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+8:12213:x1874741481778432:12345-192.168.202.35@tcp:101:bash.0 Request processed in 14390us (14858us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893145.519581:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 56 00010000:00010000:3.0:1787893145.519587:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003f7df9f3/0x9232577658cf169b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa939 expref: 8 pid: 8419 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.519612:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003f7df9f3/0x9232577658cf169b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa939 expref: 7 pid: 8419 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.519635:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f7df9f3/0x9232577658cf169b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa939 expref: 7 pid: 8419 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.520429:0:6491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893145.520436:0:6491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893145.520445:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cbd5d59/0x9232577658cf16a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa940 expref: 6 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.520456:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cbd5d59/0x9232577658cf16a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa940 expref: 6 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.521072:0:6491:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005cbd5d59/0x9232577658cf16a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa940 expref: 6 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893145.521090:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7d48700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6491:1874741493385088:192.168.202.35@tcp:105: 00000100:00100000:3.0:1787893145.521172:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d023cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787893145.524469:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893145.524990:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7d48700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6491:1874741493385088:192.168.202.35@tcp:105: 00010000:00010000:3.0:1787893145.525015:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893145.525737:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481778816 00000100:00100000:2.0:1787893145.525745:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481778816 00000100:00100000:2.0:1787893145.525804:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 36 00000100:00100000:2.0:1787893145.525813:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+20:12213:x1874741481778816:12345-192.168.202.35@tcp:35:bash.0 00000100:00100000:0.0:1787893145.526082:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58232959-285a-4954-a3ac-571a2b817017+6:2391:x1874741481778560:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 6528us (7432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893145.526092:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 80 00000100:00100000:2.0:1787893145.526943:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+21:12213:x1874741481778816:12345-192.168.202.35@tcp:35:bash.0 Request processed in 1126us (2479us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1787893145.526954:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 36 00000100:00100000:0.0:1787893145.616352:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893145.616482:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481779072 00000100:00100000:1.0:1787893145.616525:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481779072 00000100:00100000:1.0:1787893145.616589:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 158 00000100:00100000:1.0:1787893145.616600:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ed560e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+21:12223:x1874741481779072:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:1.0:1787893145.616625:0:10086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893145.616663:0:10086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf16a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa947 expref: -99 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893145.616761:0:10086:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1787893145.616857:0:10086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf16a9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa947 expref: 23 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.616882:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc8c6614400) 00010000:00010000:1.0:1787893145.616885:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787893145.616890:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf16a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa947 expref: 23 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.616904:0:10086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe541600, rc 0) 00000100:00100000:1.0:1787893145.616967:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ed560e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+22:12223:x1874741481779072:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 368us (625us total) trans 4294967421 rc 301/301 00000100:00100000:1.0:1787893145.616974:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 158 00000100:00100000:1.0:1787893145.619520:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893145.619590:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481779328 00000100:00100000:3.0:1787893145.619598:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481779328 00000100:00100000:2.0:1787893145.619688:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 37 00000100:00100000:2.0:1787893145.619700:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+22:12223:x1874741481779328:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:2.0:1787893145.619916:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+23:12223:x1874741481779328:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 218us (431us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1787893145.619923:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 37 00000100:00100000:3.0:1787893145.682856:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893145.683076:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481779456 00000100:00100000:1.0:1787893145.683089:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481779456 00000100:00100000:1.0:1787893145.683167:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 159 00000100:00100000:1.0:1787893145.683180:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+23:12229:x1874741481779456:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:1.0:1787893145.683215:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893145.683243:0:13436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf16b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa94e expref: -99 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.683344:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf16be lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.683362:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf16be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.683375:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf16be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893145.683440:0:13436:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1787893145.683445:0:13436:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787893145.683472:0:13436:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf16be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.683561:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf16b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa94e expref: 25 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.683584:0:13436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf16be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa94e expref: 24 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.683595:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc9c3918700) 00010000:00010000:1.0:1787893145.683597:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787893145.683612:0:13436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe541200, rc 0) 00000100:00100000:1.0:1787893145.683688:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+24:12229:x1874741481779456:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 510us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893145.683696:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 159 00000100:00100000:3.0:1787893145.687137:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893145.688698:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481779712 00000100:00100000:1.0:1787893145.688721:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481779712 00000100:00100000:1.0:1787893145.688836:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 160 00000100:00100000:1.0:1787893145.688852:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+24:12229:x1874741481779712:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:1.0:1787893145.688894:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893145.688926:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf16c5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa955 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.689080:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf16cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.689098:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf16cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.689112:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf16cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893145.689126:0:6505:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787893145.689273:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf16c5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa955 expref: 27 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.689296:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf16cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa955 expref: 26 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.689307:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918500) 00010000:00010000:1.0:1787893145.689328:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787893145.689333:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe541a00, rc 0) 00000100:00100000:1.0:1787893145.689577:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+26:12229:x1874741481779712:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 729us (2447us total) trans 4294967423 rc 0/0 00000100:00100000:1.0:1787893145.689586:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 160 00000100:00100000:2.0:1787893145.693222:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893145.693281:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893145.693390:0:10383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481780096 00000100:00100000:1.0:1787893145.693391:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481779968 00000100:00100000:1.0:1787893145.693404:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481779968 00000100:00100000:0.0:1787893145.693413:0:10383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481780096 00000100:00100000:1.0:1787893145.693480:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 161 00000100:00100000:1.0:1787893145.693525:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+27:12229:x1874741481779968:12345-192.168.202.35@tcp:101:lfs.0 00000100:00100000:0.0:1787893145.693537:0:10383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 12 00000100:00100000:0.0:1787893145.693550:0:10383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8481500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58232959-285a-4954-a3ac-571a2b817017+27:2390:x1874741481780096:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893145.693551:0:10086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893145.693572:0:10383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893145.693577:0:10086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf16da lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa95c expref: -99 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893145.693605:0:10383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf16cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa955 expref: 28 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893145.693632:0:10383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918500) 00010000:00010000:0.0:1787893145.693639:0:10383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787893145.693689:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729a00/0x9232577658cf16e1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.693706:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729a00/0x9232577658cf16e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893145.693720:0:10383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8481500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58232959-285a-4954-a3ac-571a2b817017+27:2390:x1874741481780096:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 172us (436us total) trans 0 rc 0/0 00010000:00010000:1.0:1787893145.693721:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729a00/0x9232577658cf16e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893145.693743:0:10383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 12 00000004:00200000:1.0:1787893145.693748:0:10086:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787893145.693854:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf16da lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa95c expref: 28 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.693889:0:10086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729a00/0x9232577658cf16e1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa95c expref: 27 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.693916:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918500) 00010000:00010000:1.0:1787893145.693920:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787893145.693924:0:10086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9dd729a00, rc 0) 00000100:00100000:1.0:1787893145.693989:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+27:12229:x1874741481779968:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 499us (778us total) trans 4294967424 rc 0/0 00000100:00100000:1.0:1787893145.693996:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 161 00000100:00100000:2.0:1787893145.706026:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893145.706130:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481780224 00000100:00100000:1.0:1787893145.706140:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481780224 00000100:00100000:1.0:1787893145.706240:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 57 00000100:00100000:1.0:1787893145.706251:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58232959-285a-4954-a3ac-571a2b817017+6:2391:x1874741481780224:12345-192.168.202.35@tcp:1:lfs.0 00010000:00010000:1.0:1787893145.706309:0:8419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b76c75bd/0x9232577658cf16ef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.706330:0:8419:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cbd5d59/0x9232577658cf16a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa940 expref: 6 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.706339:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893145.706343:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787893145.706348:0:8419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b76c75bd/0x9232577658cf16ef lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.706395:0:8419:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005cbd5d59/0x9232577658cf16a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa940 expref: 6 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.706411:0:8419:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005cbd5d59/0x9232577658cf16a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa940 expref: 6 pid: 8420 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893145.706440:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8419:1874741493385216:192.168.202.35@tcp:104: 00000100:00100000:1.0:1787893145.706572:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c70b83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787893145.710113:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8419:1874741493385216:192.168.202.35@tcp:104: 00000100:00100000:0.0:1787893145.710125:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00010000:00010000:1.0:1787893145.710156:0:8419:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b76c75bd/0x9232577658cf16ef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893145.710274:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481780352 00000100:00100000:3.0:1787893145.710281:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481780352 00002000:00100000:3.0:1787893145.710316:0:8425:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9fc9ed563b80 x1874741481780352/t0(0) o4->58232959-285a-4954-a3ac-571a2b817017@192.168.202.35@tcp:306/0 lens 504/0 e 0 to 0 dl 1787893156 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787893145.710331:0:8425:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc9ed563b80 with x1874741481780352 ext(0->12) 00010000:00010000:3.0:1787893145.710337:0:8425:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005cbd5d59/0x9232577658cf16a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa940 expref: 7 pid: 8420 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.710346:0:8425:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005cbd5d59/0x9232577658cf16a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa940 expref: 7 pid: 8420 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787893145.710351:0:8425:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9fc9ed563b80 00000100:00100000:3.0:1787893145.710383:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 2 00000100:00100000:3.0:1787893145.710392:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ed563b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:58232959-285a-4954-a3ac-571a2b817017+7:2391:x1874741481780352:12345-192.168.202.35@tcp:4:lfs.0 00000100:00100000:3.0:1787893145.711082:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ed563b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:58232959-285a-4954-a3ac-571a2b817017+9:2391:x1874741481780352:12345-192.168.202.35@tcp:4:lfs.0 Request processed in 689us (970us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787893145.711091:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 2 00002000:00100000:3.0:1787893145.711100:0:8425:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9fc9ed563b80 x1874741481780352/t4294967306(0) o4->58232959-285a-4954-a3ac-571a2b817017@192.168.202.35@tcp:306/0 lens 504/448 e 0 to 0 dl 1787893156 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787893145.711108:0:8425:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc9ed563b80 with x1874741481780352 ext(0->12) 00010000:00010000:3.0:1787893145.711114:0:8425:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005cbd5d59/0x9232577658cf16a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa940 expref: 9 pid: 8420 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.711125:0:8425:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005cbd5d59/0x9232577658cf16a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa940 expref: 9 pid: 8420 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787893145.711139:0:8425:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9fc9ed563b80 00000100:00100000:0.0:1787893145.717149:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893145.717251:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481780480 00000100:00100000:3.0:1787893145.717263:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481780480 00010000:00010000:3.0:1787893145.717305:0:6490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005cbd5d59/0x9232577658cf16a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa940 expref: 9 pid: 8420 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893145.717450:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 81 00000100:00100000:3.0:1787893145.717460:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ed562300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+9:2391:x1874741481780480:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893145.717475:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787893145.717518:0:6490:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787893145.717521:0:6490:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787893145 00002000:00010000:3.0:1787893145.717524:0:6490:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787893145 00002000:00010000:3.0:1787893145.717526:0:6490:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1787893145 00002000:00010000:3.0:1787893145.717528:0:6490:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1787893145.717535:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005cbd5d59/0x9232577658cf16a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa940 expref: 9 pid: 8420 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.717551:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005cbd5d59/0x9232577658cf16a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa940 expref: 9 pid: 8420 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.717574:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cbd5d59/0x9232577658cf16a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa940 expref: 9 pid: 8420 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.717590:0:6490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787893145.717594:0:6490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787893145.717613:0:6490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b76c75bd/0x9232577658cf16ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.717622:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b76c75bd/0x9232577658cf16ef lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.717668:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893145.717724:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ed562300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+8:2391:x1874741481780480:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 265us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893145.717732:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 81 00010000:00010000:1.0:1787893145.717792:0:8419:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b76c75bd/0x9232577658cf16ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.717801:0:8419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b76c75bd/0x9232577658cf16ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.717830:0:8419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b76c75bd/0x9232577658cf16ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.717840:0:8419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b76c75bd/0x9232577658cf16ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.717847:0:8419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b76c75bd/0x9232577658cf16ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.717853:0:8419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd728c00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:1.0:1787893145.717857:0:8419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b76c75bd/0x9232577658cf16ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.717888:0:8419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b76c75bd/0x9232577658cf16ef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.717899:0:8419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b76c75bd/0x9232577658cf16ef lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.717906:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b76c75bd/0x9232577658cf16ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893145.717952:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58232959-285a-4954-a3ac-571a2b817017+7:2391:x1874741481780224:12345-192.168.202.35@tcp:1:lfs.0 Request processed in 11703us (11937us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893145.717960:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 57 00000100:00100000:2.0:1787893145.720306:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893145.720911:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481780736 00000100:00100000:0.0:1787893145.720922:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481780736 00000100:00100000:1.0:1787893145.721141:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 38 00000100:00100000:1.0:1787893145.721153:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fed850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+27:12229:x1874741481780736:12345-192.168.202.35@tcp:35:lfs.0 00000004:00010000:1.0:1787893145.721218:0:6508:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729a00/0x9232577658cf16e1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa95c expref: 27 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787893145.721583:0:6508:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1787893145.721616:0:6508:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1787893145.722087:0:6508:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:1.0:1787893145.722127:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf16f6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.722143:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf168d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa932 expref: 31 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.722164:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf16f6 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.722201:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf168d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa932 expref: 31 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.722217:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf168d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa932 expref: 31 pid: 6504 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893145.722233:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6508:1874741493385344:192.168.202.35@tcp:104: 00000100:00100000:1.0:1787893145.722536:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c70b8000 going to sleep for 11 seconds 00000100:00100000:2.0:1787893145.726294:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893145.726398:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6508:1874741493385344:192.168.202.35@tcp:104: 00010000:00010000:1.0:1787893145.726431:0:6508:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf16f6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893145.727184:0:10383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481780864 00000100:00100000:0.0:1787893145.727195:0:10383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481780864 00010000:00010000:0.0:1787893145.727237:0:10383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf168d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa932 expref: 32 pid: 6504 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893145.727299:0:10383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 82 00000100:00100000:0.0:1787893145.727309:0:10383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8483800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58232959-285a-4954-a3ac-571a2b817017+32:2391:x1874741481780864:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893145.727333:0:10383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893145.727341:0:10383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf168d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa932 expref: 32 pid: 6504 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893145.727354:0:10383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf168d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa932 expref: 32 pid: 6504 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893145.727375:0:10383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf168d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa932 expref: 32 pid: 6504 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893145.727391:0:10383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918500) 00010000:00010000:0.0:1787893145.727397:0:10383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf16f6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893145.727406:0:10383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf16f6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893145.727414:0:10383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf16f6 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893145.727550:0:10383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893145.727599:0:10383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8483800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58232959-285a-4954-a3ac-571a2b817017+31:2391:x1874741481780864:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 291us (1314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893145.727607:0:10383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 82 00010000:00010000:1.0:1787893145.731604:0:6508:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf16f6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.731618:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf16f6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787893145.731761:0:6508:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:1.0:1787893145.731854:0:6508:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1787893145.731952:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6508:1874741493385472:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787893145.732228:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893145.732315:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c70b8480 going to sleep for 11 seconds 00000100:00100000:2.0:1787893145.732420:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493385472 00000100:00100000:2.0:1787893145.732428:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493385472 00000100:00100000:2.0:1787893145.732555:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787893145.732565:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6508:x1874741493385472:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787893145.732671:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6508:x1874741493385472:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 107us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893145.732691:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787893145.733128:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6508:1874741493385472:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787893145.733277:0:6508:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:0.0:1787893145.733400:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6508:1874741493385600:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787893145.733452:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893145.733488:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d7e300 going to sleep for 11 seconds 00000100:00100000:1.0:1787893145.733593:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493385600 00000100:00100000:1.0:1787893145.733605:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493385600 00000100:00100000:1.0:1787893145.733637:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787893145.733658:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6508:x1874741493385600:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787893145.733768:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6508:x1874741493385600:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 112us (316us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787893145.733775:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787893145.733809:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6508:1874741493385600:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787893145.733846:0:6508:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:1.0:1787893145.733890:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf16f6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.733900:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf16f6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.733908:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf16f6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.733914:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd729200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893145.733919:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf16f6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.733927:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf16f6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.733943:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918500) 00010000:00010000:1.0:1787893145.733947:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787893145.733951:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf16f6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.733957:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf16f6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787893145.734257:0:6508:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787893145.734320:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1787893145.734487:0:6508:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 389555994690ns, next at 390555992421ns, rc = 0 00000001:00080000:1.0:1787893145.734611:0:6508:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:1.0:1787893145.734776:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918500) 00010000:00010000:1.0:1787893145.734780:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787893145.734787:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729a00/0x9232577658cf16e1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa95c expref: 35 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893145.734902:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fed850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+34:12229:x1874741481780736:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 13750us (14604us total) trans 4294967433 rc 0/0 00000100:00100000:1.0:1787893145.734910:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 38 00000020:00080000:1.0:1787893145.734915:0:6508:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:3.0:1787893145.735073:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787893145.737826:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893145.737906:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481780992 00000100:00100000:1.0:1787893145.737917:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481780992 00000100:00100000:1.0:1787893145.737970:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 162 00000100:00100000:1.0:1787893145.737980:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+34:12229:x1874741481780992:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:1.0:1787893145.738001:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893145.738024:0:13436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728c00/0x9232577658cf16fd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa963 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.738078:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728c00/0x9232577658cf16fd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa963 expref: 35 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.738093:0:13436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728c00/0x9232577658cf16fd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa963 expref: 35 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.738131:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918300) 00010000:00010000:1.0:1787893145.738134:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787893145.738137:0:13436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9dd728c00, rc 0) 00000100:00100000:1.0:1787893145.738194:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+35:12229:x1874741481780992:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 216us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893145.738201:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 162 00000100:00100000:0.0:1787893145.742147:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893145.742255:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481781248 00000100:00100000:3.0:1787893145.742266:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481781248 00000100:00100000:3.0:1787893145.742364:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 39 00000100:00100000:3.0:1787893145.742375:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+35:12229:x1874741481781248:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:3.0:1787893145.742637:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+36:12229:x1874741481781248:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 262us (497us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1787893145.743158:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 39 00000100:00100000:2.0:1787893145.779828:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787893145.779850:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493385856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787893145.779926:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893145.779990:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493385856 00000100:00100000:2.0:1787893145.779996:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493385856 00000100:00100000:2.0:1787893145.780039:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787893145.780046:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8482300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493385856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787893145.780069:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787893145.780113:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8482300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493385856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893145.780118:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787893145.780149:0:3631:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:2.0:1787893145.780153:0:3631:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fc9ffc5d500, transno 4294967313 00000100:00100000:2.0:1787893145.780164:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493385856:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787893145.780185:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787893145.780287:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493385728:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787893145.780317:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893145.780459:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493385728 00000100:00100000:1.0:1787893145.780464:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493385728 00000100:00100000:1.0:1787893145.780525:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787893145.780530:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493385728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787893145.780538:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1787893145.780561:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493385728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 32us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893145.780565:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787893145.780759:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493386368:0@lo:400:kworker.0 00000100:00100000:0.0:1787893145.780782:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893145.780796:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8530e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1874741493386880:0@lo:400:kworker.0 00000100:00100000:0.0:1787893145.780811:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893145.780822:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787893145.780825:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493385984:0@lo:400:kworker.0 00000100:00100000:0.0:1787893145.780848:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893145.780877:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493386496:0@lo:400:kworker.0 00000100:00100000:0.0:1787893145.780900:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893145.780917:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8531f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1874741493387008:0@lo:400:kworker.0 00000100:00100000:0.0:1787893145.780932:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893145.780949:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493386368 00000100:00100000:0.0:1787893145.780952:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493386368 00000100:00100000:0.0:1787893145.780971:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787893145.780975:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493386368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893145.781001:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493386368:12345-0@lo:400:kworker.0 Request processed in 25us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893145.781004:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787893145.781016:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493385984 00000100:00100000:0.0:1787893145.781018:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493385984 00000100:00100000:0.0:1787893145.781041:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1787893145.781044:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edb99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+24:3630:x1874741493385984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893145.781062:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edb99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+24:3630:x1874741493385984:12345-0@lo:400:kworker.0 Request processed in 18us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893145.781066:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1787893145.781091:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493385984:0@lo:400:kworker.0 00000100:00100000:0.0:1787893145.781097:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493386368:0@lo:400:kworker.0 00000100:00100000:0.0:1787893145.781111:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493386880 00000100:00100000:0.0:1787893145.781113:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493386880 00000100:00100000:0.0:1787893145.781129:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493386496 00000100:00100000:0.0:1787893145.781130:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493386496 00000100:00100000:0.0:1787893145.781138:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493387008 00000100:00100000:0.0:1787893145.781140:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493387008 00000100:00100000:0.0:1787893145.781150:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1787893145.781154:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874741493386880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893145.781173:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874741493386880:12345-0@lo:400:kworker.0 Request processed in 19us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893145.781176:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1787893145.781183:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1787893145.781187:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8532680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493386496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893145.781200:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8532680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493386496:12345-0@lo:400:kworker.0 Request processed in 14us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893145.781203:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1787893145.781208:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1787893145.781212:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1874741493387008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893145.781235:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1874741493387008:12345-0@lo:400:kworker.0 Request processed in 22us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893145.781247:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1787893145.781275:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493386496:0@lo:400:kworker.0 00010000:00080000:0.0:1787893145.781287:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c8531f80 x1874741493387008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893145.781296:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8531f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1874741493387008:0@lo:400:kworker.0 00000100:00100000:0.0:1787893145.781305:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8530e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1874741493386880:0@lo:400:kworker.0 00000100:00100000:3.0:1787893145.781538:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493386112:0@lo:400:kworker.0 00000100:00100000:3.0:1787893145.781565:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893145.781578:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493386624:0@lo:400:kworker.0 00000100:00100000:3.0:1787893145.781595:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893145.781619:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787893145.781624:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493386240:0@lo:400:kworker.0 00000100:00100000:3.0:1787893145.781652:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893145.781664:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8533100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493386752:0@lo:400:kworker.0 00000100:00100000:3.0:1787893145.781679:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893145.781697:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493386752 00000100:00100000:3.0:1787893145.781699:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493386752 00000100:00100000:3.0:1787893145.781719:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787893145.781723:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7f6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493386752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893145.781745:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7f6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493386752:12345-0@lo:400:kworker.0 Request processed in 22us (65us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893145.781749:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787893145.781769:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493385728:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787893145.781783:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8533100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493386752:0@lo:400:kworker.0 00000100:00100000:3.0:1787893145.781793:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493386112 00000100:00100000:3.0:1787893145.781795:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493386112 00000100:00100000:3.0:1787893145.781805:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493386624 00000100:00100000:3.0:1787893145.781807:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493386624 00000100:00100000:3.0:1787893145.781813:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493386240 00000100:00100000:3.0:1787893145.781814:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493386240 00000100:00100000:3.0:1787893145.781821:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1787893145.781824:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493386112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893145.781852:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493386112:12345-0@lo:400:kworker.0 Request processed in 26us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893145.781859:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1787893145.781880:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1787893145.781886:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493386624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893145.781911:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493386624:12345-0@lo:400:kworker.0 Request processed in 26us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893145.781920:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1787893145.781929:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1787893145.781932:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7f6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493386240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893145.781950:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7f6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493386240:12345-0@lo:400:kworker.0 Request processed in 18us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893145.781953:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1787893145.781967:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493386240:0@lo:400:kworker.0 00000100:00100000:3.0:1787893145.781972:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493386112:0@lo:400:kworker.0 00010000:00080000:3.0:1787893145.781978:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c8531c00 x1874741493386624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893145.781984:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493386624:0@lo:400:kworker.0 00000100:00080000:2.0:1787893145.782073:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787893145.782077:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787893145.782078:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787893145.782079:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787893145.832594:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893145.832741:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481781504 00000100:00100000:3.0:1787893145.832750:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481781504 00000100:00100000:3.0:1787893145.832813:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 163 00000100:00100000:3.0:1787893145.832823:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+36:12239:x1874741481781504:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:3.0:1787893145.832848:0:10086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893145.832880:0:10086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf1704 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa96a expref: -99 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893145.832976:0:10086:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787893145.833073:0:10086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf1704 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa96a expref: 38 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.833087:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc8c6614400) 00010000:00010000:3.0:1787893145.833101:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787893145.833107:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf1704 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa96a expref: 38 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.833120:0:10086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9c0031400, rc 0) 00000100:00100000:3.0:1787893145.833185:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+37:12239:x1874741481781504:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 364us (600us total) trans 4294967435 rc 301/301 00000100:00100000:3.0:1787893145.833192:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 163 00000100:00100000:2.0:1787893145.837950:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893145.838620:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481781632 00000100:00100000:1.0:1787893145.838629:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481781632 00000100:00100000:1.0:1787893145.838694:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 164 00000100:00100000:1.0:1787893145.838703:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+37:12239:x1874741481781632:12345-192.168.202.35@tcp:34:lfs.0 00010000:00010000:1.0:1787893145.838772:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf1712 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.838784:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf1712 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.838793:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf1712 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.838814:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729a00/0x9232577658cf1719 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.838818:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729a00/0x9232577658cf1719 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.838822:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729a00/0x9232577658cf1719 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.838915:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1720 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.838924:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1720 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.838930:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1720 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787893145.838971:0:9515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1720 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.838982:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf1712 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.838990:0:9515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf1712 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.838997:0:9515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf1712 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.839003:0:9515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd729200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893145.839007:0:9515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf1712 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.839020:0:9515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf1712 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.839032:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc9c3918700) 00010000:00010000:1.0:1787893145.839035:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893145.839039:0:9515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf1712 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.839046:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf1712 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.839057:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729a00/0x9232577658cf1719 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.839063:0:9515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729a00/0x9232577658cf1719 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.839069:0:9515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729a00/0x9232577658cf1719 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.839074:0:9515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd729a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893145.839077:0:9515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729a00/0x9232577658cf1719 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.839082:0:9515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729a00/0x9232577658cf1719 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.839088:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc9c3918b00) 00010000:00010000:1.0:1787893145.839090:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893145.839093:0:9515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729a00/0x9232577658cf1719 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.839106:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729a00/0x9232577658cf1719 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.839115:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1720 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.839120:0:9515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1720 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.839127:0:9515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1720 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.839132:0:9515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893145.839135:0:9515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1720 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.839140:0:9515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1720 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.839146:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918300) 00010000:00010000:1.0:1787893145.839148:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893145.839151:0:9515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1720 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893145.839156:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1720 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893145.839562:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+37:12239:x1874741481781632:12345-192.168.202.35@tcp:34:lfs.0 Request processed in 857us (1620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893145.839571:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 164 00000100:00100000:1.0:1787893145.845766:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893145.845992:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481781888 00000100:00100000:0.0:1787893145.846003:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481781888 00000100:00100000:0.0:1787893145.846098:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 40 00000100:00100000:0.0:1787893145.846108:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+37:12239:x1874741481781888:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:0.0:1787893145.846342:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+38:12239:x1874741481781888:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 234us (583us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1787893145.846349:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 40 00000100:00100000:2.0:1787893145.879613:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893145.879710:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481782144 00000100:00100000:0.0:1787893145.879720:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481782144 00000100:00100000:0.0:1787893145.879825:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 165 00000100:00100000:0.0:1787893145.879841:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+38:12242:x1874741481782144:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787893145.879876:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893145.879897:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf1727 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa971 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893145.879976:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf172e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893145.879990:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf172e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893145.880016:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf172e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893145.880028:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1735 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893145.880035:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1735 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893145.880040:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1735 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893145.880129:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf173c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893145.880135:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf173c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893145.880139:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf173c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893145.880145:0:6506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787893145.880201:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf172e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893145.880206:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf172e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893145.880210:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf172e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893145.880214:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893145.880222:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf172e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893145.880227:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf172e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893145.880236:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc9c3918700) 00010000:00010000:0.0:1787893145.880238:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893145.880241:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf172e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893145.880245:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf172e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893145.880254:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1735 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893145.880257:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1735 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893145.880260:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1735 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893145.880263:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893145.880265:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1735 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893145.880268:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1735 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893145.880272:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc9c3918b00) 00010000:00010000:0.0:1787893145.880273:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893145.880278:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1735 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893145.880281:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1735 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893145.880308:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf1727 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa971 expref: 41 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893145.880316:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf173c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa971 expref: 40 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893145.880321:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918300) 00010000:00010000:0.0:1787893145.880323:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787893145.880325:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb30600, rc 0) 00000100:00100000:0.0:1787893145.880442:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+40:12242:x1874741481782144:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 601us (838us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1787893145.880450:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 165 00000100:00100000:2.0:1787893145.882311:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893145.882442:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481782272 00000100:00100000:3.0:1787893145.882449:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481782272 00000100:00100000:3.0:1787893145.882488:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 166 00000100:00100000:3.0:1787893145.882520:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+40:12242:x1874741481782272:12345-192.168.202.35@tcp:54:lfs.0 00010000:00010000:3.0:1787893145.882571:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf174a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.882583:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf174a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.882590:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf174a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.882612:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf174a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.882617:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf174a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.882621:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf174a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.882624:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c0031400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893145.882636:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf174a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.882642:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf174a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.882652:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918300) 00010000:00010000:3.0:1787893145.882656:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787893145.882659:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf174a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893145.882665:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf174a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893145.882759:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+40:12242:x1874741481782272:12345-192.168.202.35@tcp:54:lfs.0 Request processed in 239us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893145.882765:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 166 00000100:00100000:1.0:1787893145.884487:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893145.884685:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481782528 00000100:00100000:3.0:1787893145.884694:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481782528 00000100:00100000:3.0:1787893145.884754:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 41 00000100:00100000:3.0:1787893145.884761:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+40:12242:x1874741481782528:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:3.0:1787893145.884971:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+41:12242:x1874741481782528:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 208us (486us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1787893145.884979:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 41 00000100:00100000:2.0:1787893146.147603:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893146.147771:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481782784 00000100:00100000:1.0:1787893146.147781:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481782784 00000100:00100000:1.0:1787893146.147853:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 167 00000100:00100000:1.0:1787893146.147870:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+41:12273:x1874741481782784:12345-192.168.202.35@tcp:101:cat.0 00010000:00010000:1.0:1787893146.147894:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893146.147915:0:13436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf1751 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa978 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893146.148034:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf1758 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893146.148048:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf1758 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893146.148058:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf1758 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893146.148069:0:13436:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787893146.148172:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf1751 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa978 expref: 44 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893146.148189:0:13436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf1758 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa978 expref: 43 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893146.148197:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918300) 00010000:00010000:1.0:1787893146.148199:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787893146.148203:0:13436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe541c00, rc 0) 00000100:00100000:1.0:1787893146.148276:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+43:12273:x1874741481782784:12345-192.168.202.35@tcp:101:cat.0 Request processed in 414us (683us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1787893146.148282:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 167 00000100:00100000:2.0:1787893146.154275:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893146.154344:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893146.154423:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481783168 00000100:00100000:1.0:1787893146.154433:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481783168 00000100:00100000:1.0:1787893146.154518:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 13 00000100:00100000:1.0:1787893146.154528:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58232959-285a-4954-a3ac-571a2b817017+43:2391:x1874741481783168:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893146.154541:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893146.154562:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf1758 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa978 expref: 43 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893146.154577:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918300) 00010000:00010000:1.0:1787893146.154582:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893146.154630:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58232959-285a-4954-a3ac-571a2b817017+42:2391:x1874741481783168:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 103us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893146.154636:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 13 00000100:00100000:0.0:1787893146.155537:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481783040 00000100:00100000:0.0:1787893146.155546:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481783040 00000100:00100000:0.0:1787893146.155589:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 42 00000100:00100000:0.0:1787893146.155598:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+42:12273:x1874741481783040:12345-192.168.202.35@tcp:35:cat.0 00000100:00100000:0.0:1787893146.155838:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+43:12273:x1874741481783040:12345-192.168.202.35@tcp:35:cat.0 Request processed in 241us (1571us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1787893146.156283:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 42 00000100:00100000:2.0:1787893146.224958:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893146.225469:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481783424 00000100:00100000:1.0:1787893146.225480:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481783424 00000100:00100000:1.0:1787893146.225578:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 168 00000100:00100000:1.0:1787893146.225588:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+43:12279:x1874741481783424:12345-192.168.202.35@tcp:101:dd.0 00010000:00010000:1.0:1787893146.225613:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893146.225617:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787893146.225657:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf16be lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa94e expref: 43 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893146.225676:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc9c3918700) 00010000:00010000:1.0:1787893146.225680:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787893146.225709:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf1766 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa97f expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893146.225826:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf176d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893146.225839:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf173c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa971 expref: 43 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893146.226089:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf176d lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893146.226132:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf173c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa971 expref: 43 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893146.226146:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf173c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa971 expref: 43 pid: 6506 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893146.226159:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d15cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6505:1874741493387136:192.168.202.35@tcp:104: 00000100:00100000:1.0:1787893146.226868:0:6505:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c70b8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787893146.229268:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893146.229357:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481783552 00000100:00100000:3.0:1787893146.229366:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481783552 00010000:00010000:3.0:1787893146.229406:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf173c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa971 expref: 44 pid: 6506 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893146.229440:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 83 00000100:00100000:3.0:1787893146.229464:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3efe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58232959-285a-4954-a3ac-571a2b817017+44:2391:x1874741481783552:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893146.229479:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893146.229486:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf173c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa971 expref: 44 pid: 6506 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893146.229532:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf173c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa971 expref: 44 pid: 6506 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893146.229554:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918300) 00010000:00010000:3.0:1787893146.229559:0:6492:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf176d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893146.229568:0:6492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf176d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893146.229575:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf176d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893146.229598:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893146.229650:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3efe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58232959-285a-4954-a3ac-571a2b817017+44:2391:x1874741481783552:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 187us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893146.229659:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 83 00010000:00010000:1.0:1787893146.230796:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf173c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa971 expref: 43 pid: 6506 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893146.230817:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d15cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6505:1874741493387136:192.168.202.35@tcp:104: 00010000:00010000:1.0:1787893146.230838:0:6505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf176d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893146.230858:0:6505:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf176d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893146.230889:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf176d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893146.230914:0:6505:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787893146.231178:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf1766 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa97f expref: 44 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893146.231194:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf176d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa97f expref: 43 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893146.231203:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918300) 00010000:00010000:1.0:1787893146.231206:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787893146.231209:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe541a00, rc 0) 00000100:00100000:1.0:1787893146.231313:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+43:12279:x1874741481783424:12345-192.168.202.35@tcp:101:dd.0 Request processed in 5726us (6366us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1787893146.231330:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 168 00000100:00100000:2.0:1787893146.238920:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893146.239013:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481783680 00000100:00100000:3.0:1787893146.239025:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481783680 00000100:00100000:3.0:1787893146.239080:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 169 00000100:00100000:3.0:1787893146.239090:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+43:12279:x1874741481783680:12345-192.168.202.35@tcp:101:dd.0 00010000:00010000:3.0:1787893146.239112:0:10086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893146.239132:0:10086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf177b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa986 expref: -99 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893146.239177:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1782 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893146.239190:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1782 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893146.239201:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1782 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893146.239305:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf177b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa986 expref: 45 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893146.239340:0:10086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1782 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa986 expref: 44 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893146.239348:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918300) 00010000:00010000:3.0:1787893146.239351:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787893146.239355:0:10086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9c0030800, rc 0) 00000100:00100000:3.0:1787893146.239417:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+44:12279:x1874741481783680:12345-192.168.202.35@tcp:101:dd.0 Request processed in 329us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893146.239424:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 169 00000100:00100000:2.0:1787893146.243033:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893146.243113:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481783936 00000100:00100000:1.0:1787893146.243123:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481783936 00000100:00100000:1.0:1787893146.243187:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 170 00000100:00100000:1.0:1787893146.243197:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+44:12279:x1874741481783936:12345-192.168.202.35@tcp:36:dd.0 00010000:00010000:1.0:1787893146.243429:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf1789 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893146.243444:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf1789 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893146.243456:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf1789 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787893146.243552:0:13436:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:1.0:1787893146.243577:0:13436:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ff546967 reply state 00000000e799e3ac transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf1789 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893146.243590:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf1789 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893146.243597:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918300) 00010000:00010000:1.0:1787893146.243600:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787893146.243604:0:13436:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787893146.243702:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+47:12279:x1874741481783936:12345-192.168.202.35@tcp:36:dd.0 Request processed in 506us (676us total) trans 4294967443 rc 0/0 00000100:00100000:1.0:1787893146.243709:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 170 00000020:00080000:1.0:1787893146.243713:0:13436:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787893146.290460:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893146.525135:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893146.525370:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481784064 00000100:00100000:0.0:1787893146.525379:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481784064 00000100:00100000:0.0:1787893146.525488:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 171 00000100:00100000:0.0:1787893146.525528:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8404000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+47:12292:x1874741481784064:12345-192.168.202.35@tcp:101:stat.0 00010000:00010000:0.0:1787893146.525560:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893146.525582:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf1790 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa98d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.525657:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1797 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.525672:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1797 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.525683:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1797 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.525693:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf179e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.525700:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf179e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.525706:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf179e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.525771:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf17a5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.525781:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf176d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa97f expref: 48 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.525789:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf17a5 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.525820:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf176d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa97f expref: 48 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.525838:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf176d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa97f expref: 48 pid: 6505 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893146.525852:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8530e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6506:1874741493387264:192.168.202.35@tcp:104: 00000100:00100000:0.0:1787893146.525979:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d7eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787893146.529480:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893146.529628:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481784320 00000100:00100000:1.0:1787893146.529637:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481784320 00000100:00100000:1.0:1787893146.529697:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 43 00000100:00100000:1.0:1787893146.529706:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+49:6162:x1874741481784320:12345-192.168.202.35@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787893146.529988:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+50:6162:x1874741481784320:12345-192.168.202.35@tcp:35:ldlm_bl.0 Request processed in 275us (510us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1787893146.529996:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 43 00000100:00100000:0.0:1787893146.530720:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8530e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6506:1874741493387264:192.168.202.35@tcp:104: 00010000:00010000:0.0:1787893146.530743:0:6506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf17a5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893146.533239:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893146.533554:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481784448 00000100:00100000:1.0:1787893146.533565:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481784448 00010000:00010000:1.0:1787893146.533606:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf176d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa97f expref: 50 pid: 6505 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893146.533647:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 84 00000100:00100000:1.0:1787893146.533668:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8407480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58232959-285a-4954-a3ac-571a2b817017+50:2390:x1874741481784448:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893146.533683:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893146.533690:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf176d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa97f expref: 50 pid: 6505 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893146.533703:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf176d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa97f expref: 50 pid: 6505 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893146.533724:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf176d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa97f expref: 50 pid: 6505 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893146.533739:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918300) 00010000:00010000:1.0:1787893146.533744:0:6491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf17a5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893146.533754:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf17a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893146.533761:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf17a5 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893146.533790:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893146.533836:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8407480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58232959-285a-4954-a3ac-571a2b817017+49:2390:x1874741481784448:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 169us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893146.533843:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 84 00010000:00010000:0.0:1787893146.534247:0:6506:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf17a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.534256:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf17a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893146.534320:0:6506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787893146.534325:0:6506:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787893146.534350:0:6506:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf17a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.534362:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf17a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.534370:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1797 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.534376:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1797 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.534393:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1797 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.534399:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893146.534403:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1797 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.534412:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1797 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.534422:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc9c3918700) 00010000:00010000:0.0:1787893146.534425:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893146.534429:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1797 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.534435:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1797 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.534445:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf179e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.534451:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf179e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.534457:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf179e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.534461:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893146.534464:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf179e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.534481:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf179e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.534539:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc9c3918b00) 00010000:00010000:0.0:1787893146.534542:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893146.534546:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf179e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.534551:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf179e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.534582:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf1790 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa98d expref: 49 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.534594:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf17a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa98d expref: 48 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.534602:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918300) 00010000:00010000:0.0:1787893146.534603:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787893146.534606:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb30800, rc 0) 00000100:00100000:0.0:1787893146.534651:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8404000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+48:12292:x1874741481784064:12345-192.168.202.35@tcp:101:stat.0 Request processed in 9126us (9524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893146.534658:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 171 00000100:00100000:2.0:1787893146.635236:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893146.635466:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481784704 00000100:00100000:3.0:1787893146.635476:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481784704 00000100:00100000:3.0:1787893146.635567:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 172 00000100:00100000:3.0:1787893146.635579:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8404a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+48:12299:x1874741481784704:12345-192.168.202.35@tcp:36:truncate.0 00010000:00010000:3.0:1787893146.635636:0:10086:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893146.635677:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf17a5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa98d expref: 48 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893146.635698:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918300) 00010000:00010000:3.0:1787893146.635703:0:10086:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787893146.635914:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf17ac lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893146.635930:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf17ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893146.635940:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf17ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787893146.635986:0:10086:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:3.0:1787893146.636019:0:10086:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000091cad6ac reply state 00000000da680833 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf17ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893146.636031:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf17ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893146.636037:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918300) 00010000:00010000:3.0:1787893146.636040:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787893146.636042:0:10086:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787893146.636150:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8404a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+50:12299:x1874741481784704:12345-192.168.202.35@tcp:36:truncate.0 Request processed in 573us (922us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1787893146.636157:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 172 00000020:00080000:3.0:1787893146.636162:0:10086:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787893146.653518:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893146.653621:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893146.653659:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893146.653714:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893146.653735:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893146.653758:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893146.653785:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481785344 00000100:00100000:2.0:1787893146.653794:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481785344 00000100:00100000:2.0:1787893146.653835:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481784960 00000100:00100000:2.0:1787893146.653838:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481784960 00000100:00100000:2.0:1787893146.653880:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481785472 00000100:00100000:2.0:1787893146.653883:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481785472 00000100:00100000:2.0:1787893146.653901:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 357 00000100:00100000:2.0:1787893146.653919:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8406d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2391:x1874741481785344:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893146.653995:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8406d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2391:x1874741481785344:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 87us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893146.654003:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 357 00000100:00100000:2.0:1787893146.654021:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 358 00000100:00100000:2.0:1787893146.654026:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8405180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+5:2391:x1874741481784960:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893146.654048:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8405180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+5:2391:x1874741481784960:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 22us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893146.654053:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 358 00000100:00100000:2.0:1787893146.654064:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 359 00000100:00100000:2.0:1787893146.654069:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8406a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2391:x1874741481785472:12345-192.168.202.35@tcp:400:kworker.0 00000100:00080000:0.0:1787893146.655238:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787893146.655456:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481785088 00000100:00100000:1.0:1787893146.655464:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481785088 00000100:00100000:1.0:1787893146.655531:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481785216 00000100:00100000:1.0:1787893146.655535:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481785216 00000100:00100000:1.0:1787893146.655584:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 136 00000100:00100000:1.0:1787893146.655593:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8404380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58232959-285a-4954-a3ac-571a2b817017+7:2391:x1874741481785088:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893146.655651:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8404380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58232959-285a-4954-a3ac-571a2b817017+7:2391:x1874741481785088:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 60us (2030us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893146.655657:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 136 00000100:00100000:1.0:1787893146.655672:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 137 00000100:00100000:1.0:1787893146.655678:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8404700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58232959-285a-4954-a3ac-571a2b817017+6:2391:x1874741481785216:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893146.655702:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8404700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58232959-285a-4954-a3ac-571a2b817017+6:2391:x1874741481785216:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 25us (1966us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893146.655707:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 137 00000100:00080000:1.0:1787893146.655727:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787893146.656965:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8406a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2391:x1874741481785472:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 2893us (3203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893146.656985:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 359 00000100:00100000:3.0:1787893146.661051:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481784832 00000100:00100000:3.0:1787893146.661067:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481784832 00000100:00100000:3.0:1787893146.661148:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 395 00000100:00100000:3.0:1787893146.661157:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2391:x1874741481784832:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893146.661255:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2391:x1874741481784832:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 98us (7763us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893146.661263:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 395 00000100:00100000:1.0:1787893146.829048:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893146.829301:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481785600 00000100:00100000:0.0:1787893146.829312:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481785600 00000100:00100000:0.0:1787893146.829384:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 173 00000100:00100000:0.0:1787893146.829395:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+50:12313:x1874741481785600:12345-192.168.202.35@tcp:101:stat.0 00010000:00010000:0.0:1787893146.829435:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893146.829456:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf17b3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa994 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.829868:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf17ba lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.829884:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf17ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.829895:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf17ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.829908:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf17c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.829915:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf17c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.829922:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf17c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.829991:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf17c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.830000:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf17c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.830006:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf17c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893146.830044:0:6504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1787893146.830055:0:6504:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787893146.830224:0:6504:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf17c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.830239:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf17c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.830247:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf17ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.830252:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf17ba lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.830259:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf17ba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.830264:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893146.830268:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf17ba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.830275:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf17ba lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.830287:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc9c3918700) 00010000:00010000:0.0:1787893146.830290:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893146.830294:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf17ba lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.830300:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf17ba lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.830313:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf17c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.830329:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf17c1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.830335:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf17c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.830339:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893146.830343:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf17c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.830349:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf17c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.830357:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc9c3918b00) 00010000:00010000:0.0:1787893146.830359:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893146.830362:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf17c1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.830368:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf17c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.830396:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf17b3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa994 expref: 52 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.830409:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf17c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa994 expref: 51 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.830416:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918300) 00010000:00010000:0.0:1787893146.830418:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787893146.830427:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb31000, rc 0) 00000100:00100000:0.0:1787893146.830573:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+51:12313:x1874741481785600:12345-192.168.202.35@tcp:101:stat.0 Request processed in 1178us (1534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893146.830580:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 173 00000100:00100000:2.0:1787893146.979239:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893146.979414:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481785856 00000100:00100000:0.0:1787893146.979424:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481785856 00000100:00100000:0.0:1787893146.979487:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 174 00000100:00100000:0.0:1787893146.979530:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+51:12323:x1874741481785856:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787893146.979550:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893146.979570:0:13436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf17cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa99b expref: -99 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893146.979663:0:13436:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1787893146.979761:0:13436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf17cf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa99b expref: 53 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.979776:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc8c6614400) 00010000:00010000:0.0:1787893146.979779:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787893146.979784:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf17cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa99b expref: 53 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.979797:0:13436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb30000, rc 0) 00000100:00100000:0.0:1787893146.979871:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+52:12323:x1874741481785856:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 342us (639us total) trans 4294967447 rc 301/301 00000100:00100000:0.0:1787893146.979879:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 174 00000100:00100000:2.0:1787893146.986100:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893146.986247:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481786112 00000100:00100000:1.0:1787893146.986257:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481786112 00000100:00100000:1.0:1787893146.986336:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 44 00000100:00100000:1.0:1787893146.986347:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fef450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+52:12323:x1874741481786112:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:1.0:1787893146.986586:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fef450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+53:12323:x1874741481786112:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 240us (496us total) trans 4294967448 rc 0/0 00000100:00100000:1.0:1787893146.986594:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 44 00000100:00100000:1.0:1787893147.090142:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893147.090242:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481786368 00000100:00100000:2.0:1787893147.090256:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481786368 00000100:00100000:2.0:1787893147.090357:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 175 00000100:00100000:2.0:1787893147.090369:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+53:12329:x1874741481786368:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:2.0:1787893147.090395:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893147.090417:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf17dd lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa9a2 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893147.090596:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf17e4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893147.090613:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf17c8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa994 expref: 54 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893147.090622:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf17e4 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893147.090881:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf17c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa994 expref: 54 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893147.090897:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf17c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa994 expref: 54 pid: 6504 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893147.090910:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8407b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6505:1874741493387392:192.168.202.35@tcp:104: 00000100:00100000:2.0:1787893147.091014:0:6505:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9eee58780 going to sleep for 11 seconds 00000100:00080000:1.0:1787893147.091603:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787893147.104995:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893147.105132:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481786496 00000100:00100000:3.0:1787893147.105141:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481786496 00010000:00010000:3.0:1787893147.105182:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf17c8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa994 expref: 55 pid: 6504 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893147.105224:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 85 00000100:00100000:3.0:1787893147.105233:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8407800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58232959-285a-4954-a3ac-571a2b817017+55:2391:x1874741481786496:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893147.105248:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893147.105254:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf17c8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa994 expref: 55 pid: 6504 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.105266:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf17c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa994 expref: 55 pid: 6504 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.105289:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918300) 00010000:00010000:3.0:1787893147.105294:0:6492:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf17e4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.105304:0:6492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf17e4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.105322:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf17e4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.105346:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893147.105416:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8407800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58232959-285a-4954-a3ac-571a2b817017+55:2391:x1874741481786496:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 183us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893147.105424:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 85 00010000:00010000:1.0:1787893147.108006:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf17c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa994 expref: 54 pid: 6504 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893147.108034:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8407b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6505:1874741493387392:192.168.202.35@tcp:104: 00010000:00010000:1.0:1787893147.108089:0:6505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf17e4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893147.108100:0:6505:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf17e4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893147.108106:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf17e4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893147.108130:0:6505:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1787893147.108283:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf17dd lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9a2 expref: 55 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893147.108300:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf17e4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9a2 expref: 54 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893147.108308:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918300) 00010000:00010000:1.0:1787893147.108311:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787893147.108314:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7e400, rc 0) 00000100:00100000:1.0:1787893147.108381:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+54:12329:x1874741481786368:12345-192.168.202.35@tcp:101:bash.0 Request processed in 18014us (18249us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1787893147.108389:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 175 00000100:00100000:2.0:1787893147.114140:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893147.114241:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481786752 00000100:00100000:0.0:1787893147.114252:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481786752 00000100:00100000:0.0:1787893147.114336:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 176 00000100:00100000:0.0:1787893147.114357:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+54:12329:x1874741481786752:12345-192.168.202.35@tcp:36:bash.0 00010000:00010000:0.0:1787893147.114569:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf17f2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.114583:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf17f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.114592:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf17f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787893147.114622:0:6506:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:0.0:1787893147.114635:0:6506:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce1761ea reply state 000000005f0dcb58 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf17f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.114644:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf17f2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.114649:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918300) 00010000:00010000:0.0:1787893147.114651:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787893147.114653:0:6506:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787893147.114723:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+57:12329:x1874741481786752:12345-192.168.202.35@tcp:36:bash.0 Request processed in 366us (593us total) trans 4294967451 rc 0/0 00000100:00100000:0.0:1787893147.114730:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 176 00000020:00080000:0.0:1787893147.114734:0:6506:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787893147.120454:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893147.120784:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481786880 00000100:00100000:0.0:1787893147.120796:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481786880 00000100:00100000:0.0:1787893147.120901:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 177 00000100:00100000:0.0:1787893147.120912:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+57:12329:x1874741481786880:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:0.0:1787893147.120938:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893147.120960:0:13436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf17f9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa9a9 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.121063:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf1800 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.121083:0:13436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf17e4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9a2 expref: 58 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.121092:0:13436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf1800 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.121126:0:13436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf17e4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9a2 expref: 58 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.121140:0:13436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf17e4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9a2 expref: 58 pid: 6505 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893147.121154:0:13436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8530e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13436:1874741493387520:192.168.202.35@tcp:104: 00000100:00100000:0.0:1787893147.121245:0:13436:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d7ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1787893147.127784:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893147.128123:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481787008 00000100:00100000:1.0:1787893147.128135:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481787008 00010000:00010000:1.0:1787893147.128175:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf17e4 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9a2 expref: 59 pid: 6505 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893147.128259:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 86 00000100:00100000:1.0:1787893147.128270:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58232959-285a-4954-a3ac-571a2b817017+59:2390:x1874741481787008:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893147.128298:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893147.128305:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf17e4 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9a2 expref: 59 pid: 6505 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893147.128319:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf17e4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9a2 expref: 59 pid: 6505 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893147.128341:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918300) 00010000:00010000:1.0:1787893147.128346:0:6491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf1800 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893147.128367:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf1800 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893147.128375:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf1800 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893147.128394:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893147.128453:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58232959-285a-4954-a3ac-571a2b817017+59:2390:x1874741481787008:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 184us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893147.128460:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 86 00010000:00010000:0.0:1787893147.130111:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf17e4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9a2 expref: 58 pid: 6505 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893147.130135:0:13436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8530e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13436:1874741493387520:192.168.202.35@tcp:104: 00010000:00010000:0.0:1787893147.130158:0:13436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf1800 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.130167:0:13436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf1800 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.130192:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf1800 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893147.130251:0:13436:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787893147.130256:0:13436:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787893147.130278:0:13436:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf1800 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.130323:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf17f9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9a9 expref: 58 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.130338:0:13436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf1800 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9a9 expref: 57 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.130347:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918300) 00010000:00010000:0.0:1787893147.130349:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787893147.130352:0:13436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb31600, rc 0) 00000100:00100000:0.0:1787893147.130413:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+57:12329:x1874741481786880:12345-192.168.202.35@tcp:101:bash.0 Request processed in 9503us (9968us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893147.130421:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 177 00000100:00100000:3.0:1787893147.134082:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893147.134183:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481787264 00000100:00100000:0.0:1787893147.134192:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481787264 00000100:00100000:0.0:1787893147.134303:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 45 00000100:00100000:0.0:1787893147.134323:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+57:12329:x1874741481787264:12345-192.168.202.35@tcp:35:bash.0 00000100:00100000:0.0:1787893147.134573:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+58:12329:x1874741481787264:12345-192.168.202.35@tcp:35:bash.0 Request processed in 253us (502us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1787893147.134581:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 45 00000100:00100000:1.0:1787893147.247327:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893147.247448:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481787520 00000100:00100000:3.0:1787893147.247459:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481787520 00000100:00100000:3.0:1787893147.247543:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 178 00000100:00100000:3.0:1787893147.247554:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+58:12339:x1874741481787520:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:3.0:1787893147.247576:0:9515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893147.247595:0:9515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf1807 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa9b0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893147.247686:0:9515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787893147.247775:0:9515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf1807 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9b0 expref: 60 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.247789:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc8c6614400) 00010000:00010000:3.0:1787893147.247792:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787893147.247796:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf1807 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9b0 expref: 60 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.247810:0:9515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9c0031400, rc 0) 00000100:00100000:3.0:1787893147.247874:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+59:12339:x1874741481787520:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 323us (566us total) trans 4294967453 rc 301/301 00000100:00100000:3.0:1787893147.247881:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 178 00000100:00100000:2.0:1787893147.251342:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893147.251539:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481787648 00000100:00100000:0.0:1787893147.251550:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481787648 00000100:00100000:0.0:1787893147.251612:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 179 00000100:00100000:0.0:1787893147.251621:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8407100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+59:12339:x1874741481787648:12345-192.168.202.35@tcp:34:lfs.0 00010000:00010000:0.0:1787893147.252061:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1815 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.252079:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1815 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.252092:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1815 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.252104:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf181c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.252111:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf181c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.252117:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf181c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.252193:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf1823 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.252203:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf1823 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.252209:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf1823 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787893147.252254:0:6506:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf1823 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.252281:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1815 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.252287:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1815 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.252293:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1815 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.252299:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893147.252303:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1815 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.252323:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1815 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.252335:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc9c3918700) 00010000:00010000:0.0:1787893147.252338:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893147.252342:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1815 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.252348:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1815 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.252361:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf181c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.252366:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf181c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.252372:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf181c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.252383:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893147.252386:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf181c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.252392:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf181c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.252399:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc9c3918b00) 00010000:00010000:0.0:1787893147.252401:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893147.252404:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf181c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.252409:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf181c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.252418:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf1823 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.252423:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf1823 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.252428:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf1823 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.252433:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893147.252435:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf1823 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.252441:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf1823 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.252456:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918300) 00010000:00010000:0.0:1787893147.252458:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893147.252461:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf1823 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.252466:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf1823 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893147.252974:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8407100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+59:12339:x1874741481787648:12345-192.168.202.35@tcp:34:lfs.0 Request processed in 1350us (1639us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893147.252984:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 179 00000100:00100000:2.0:1787893147.267082:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893147.267246:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481787904 00000100:00100000:1.0:1787893147.267256:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481787904 00000100:00100000:1.0:1787893147.267325:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 46 00000100:00100000:1.0:1787893147.267336:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8404e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+59:12339:x1874741481787904:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:1.0:1787893147.267622:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8404e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+60:12339:x1874741481787904:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 287us (550us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1787893147.267640:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 46 00010000:00010000:1.0:1787893147.313747:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893147.330744:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893147.330843:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481788160 00000100:00100000:3.0:1787893147.330863:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481788160 00000100:00100000:3.0:1787893147.330926:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 180 00000100:00100000:3.0:1787893147.330937:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+60:12342:x1874741481788160:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:3.0:1787893147.330975:0:10086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893147.330997:0:10086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf182a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa9b7 expref: -99 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.331075:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf1831 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.331089:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf1831 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.331100:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf1831 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.331111:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fe00/0x9232577658cf1838 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.331118:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fe00/0x9232577658cf1838 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.331125:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fe00/0x9232577658cf1838 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.331245:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf183f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.331254:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf183f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.331278:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf183f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893147.331288:0:10086:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787893147.331378:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf1831 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.331386:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf1831 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.331392:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf1831 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.331397:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c771f400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893147.331402:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf1831 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.331409:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf1831 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.331420:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc9c3918700) 00010000:00010000:3.0:1787893147.331423:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893147.331428:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf1831 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.331435:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf1831 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.331448:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fe00/0x9232577658cf1838 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.331452:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fe00/0x9232577658cf1838 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.331464:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fe00/0x9232577658cf1838 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.331470:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c771fe00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893147.331473:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fe00/0x9232577658cf1838 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.331479:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fe00/0x9232577658cf1838 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.331485:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc9c3918b00) 00010000:00010000:3.0:1787893147.331488:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893147.331551:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fe00/0x9232577658cf1838 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.331556:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fe00/0x9232577658cf1838 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.331594:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf182a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9b7 expref: 63 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.331608:0:10086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf183f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9b7 expref: 62 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.331614:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918300) 00010000:00010000:3.0:1787893147.331616:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787893147.331619:0:10086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c771ee00, rc 0) 00000100:00100000:3.0:1787893147.331673:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+62:12342:x1874741481788160:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 738us (940us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1787893147.331688:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 180 00000100:00100000:2.0:1787893147.349041:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893147.349089:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893147.349225:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481788416 00000100:00100000:0.0:1787893147.349237:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481788416 00000100:00100000:0.0:1787893147.349321:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 14 00000100:00100000:0.0:1787893147.349334:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8405880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58232959-285a-4954-a3ac-571a2b817017+62:2391:x1874741481788416:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893147.349352:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893147.349380:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf183f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9b7 expref: 62 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.349401:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918300) 00010000:00010000:0.0:1787893147.349406:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893147.349470:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8405880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58232959-285a-4954-a3ac-571a2b817017+61:2391:x1874741481788416:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 139us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893147.349478:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 14 00000100:00100000:3.0:1787893147.349994:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481788288 00000100:00100000:3.0:1787893147.350000:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481788288 00000100:00100000:3.0:1787893147.350045:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 181 00000100:00100000:3.0:1787893147.350053:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8405f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+61:12342:x1874741481788288:12345-192.168.202.35@tcp:54:lfs.0 00010000:00010000:3.0:1787893147.350113:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fe00/0x9232577658cf184d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.350128:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fe00/0x9232577658cf184d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.350140:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fe00/0x9232577658cf184d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.350177:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fe00/0x9232577658cf184d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.350183:0:9515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fe00/0x9232577658cf184d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.350190:0:9515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fe00/0x9232577658cf184d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.350195:0:9515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c771fe00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893147.350200:0:9515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fe00/0x9232577658cf184d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.350207:0:9515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fe00/0x9232577658cf184d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.350216:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918300) 00010000:00010000:3.0:1787893147.350232:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787893147.350236:0:9515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fe00/0x9232577658cf184d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.350242:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fe00/0x9232577658cf184d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893147.350294:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8405f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+61:12342:x1874741481788288:12345-192.168.202.35@tcp:54:lfs.0 Request processed in 241us (1263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893147.350301:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 181 00000100:00100000:2.0:1787893147.362902:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893147.363006:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481788672 00000100:00100000:1.0:1787893147.363016:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481788672 00000100:00100000:1.0:1787893147.363077:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 47 00000100:00100000:1.0:1787893147.363087:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+61:12342:x1874741481788672:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:1.0:1787893147.363320:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+62:12342:x1874741481788672:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 234us (427us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1787893147.363329:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 47 00000100:00100000:2.0:1787893147.668426:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893147.668533:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481788928 00000100:00100000:0.0:1787893147.668543:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481788928 00000100:00100000:0.0:1787893147.668607:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 182 00000100:00100000:0.0:1787893147.668631:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8406680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+62:12360:x1874741481788928:12345-192.168.202.35@tcp:101:cat.0 00010000:00010000:0.0:1787893147.668661:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893147.668682:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf1854 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa9be expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.668778:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf185b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.668792:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf185b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.668802:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf185b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893147.668812:0:6504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787893147.668933:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf1854 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9be expref: 65 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.669193:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf185b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9be expref: 64 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.669203:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918300) 00010000:00010000:0.0:1787893147.669207:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787893147.669210:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb30800, rc 0) 00000100:00100000:0.0:1787893147.669277:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8406680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+64:12360:x1874741481788928:12345-192.168.202.35@tcp:101:cat.0 Request processed in 648us (861us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1787893147.669285:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 182 00000001:00080000:2.0:1787893147.672862:0:6484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967457 is committed 00000004:00080000:2.0:1787893147.672912:0:6484:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1787893147.672939:0:6484:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fc8c7d7ed80 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1787893147.672944:0:6484:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fc9f6d8d000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fc8c7d7e780 00000020:00080000:2.0:1787893147.672947:0:6484:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fc9f6d8de00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fc9d0c6ce00 00000020:00080000:1.0:1787893147.673048:0:6536:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00010000:00010000:0.0:1787893147.673094:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf1640 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787893147.673113:0:6536:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1787893147.673117:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf1640 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.673125:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf1640 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.673131:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893147.673136:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf1640 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.673144:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf1640 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.673160:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9fc9c3918100) 00010000:00010000:0.0:1787893147.673163:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893147.673167:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf1640 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.673173:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf1640 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.673193:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf1647 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.673199:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf1647 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.673205:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf1647 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.673210:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893147.673218:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf1647 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.673225:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf1647 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.673233:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc9c3918700) 00010000:00010000:0.0:1787893147.673235:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893147.673238:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf1647 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.673243:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf1647 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.673257:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf1686 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893147.673983:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787893147.674002:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7d49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493387648:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787893147.674252:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893147.674311:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493387648 00000100:00100000:3.0:1787893147.674320:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493387648 00000100:00080000:1.0:1787893147.674357:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787893147.674382:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787893147.674394:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3633:x1874741493387648:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787893147.674419:0:8421:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:3.0:1787893147.674451:0:8421:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a911599, atime: 0x6a911599, ctime: 0x6a911599, blocks: 0x8 00010000:00010000:3.0:1787893147.674458:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009db7ae70/0x9232577658cf1869 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.674474:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=391s v=(0 0) 00010000:00010000:3.0:1787893147.674478:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893147.674484:0:8421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009db7ae70/0x9232577658cf1869 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.674560:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009db7ae70/0x9232577658cf1869 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.674569:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009db7ae70/0x9232577658cf1869 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.674587:0:8421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009db7ae70/0x9232577658cf1869 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.674610:0:8421:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787893147.674679:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893147.674687:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009db7ae70/0x9232577658cf1869 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893147.674695:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c771fe00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:1.0:1787893147.674701:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009db7ae70/0x9232577658cf1869 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893147.674710:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009db7ae70/0x9232577658cf1869 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893147.674738:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009db7ae70/0x9232577658cf1869 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893147.674745:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009db7ae70/0x9232577658cf1869 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893147.674766:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893147.674768:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893147.674769:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893147.675012:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3633:x1874741493387648:12345-0@lo:6:osp-syn-0-0.0 Request processed in 620us (759us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787893147.675021:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000004:00080000:1.0:1787893147.675161:0:3633:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fc8c7d49880/2, rc 0, transno 4294967308 00000100:00100000:1.0:1787893147.675168:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7d49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493387648:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1787893147.675827:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf1686 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.675835:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf1686 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.675840:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893147.675845:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf1686 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.675864:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf1686 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.675876:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc9c3918b00) 00010000:00010000:0.0:1787893147.675879:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893147.675892:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf1686 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.675898:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf1686 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.675921:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf1789 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.675927:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf1789 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.675933:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf1789 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.675938:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe541200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893147.675941:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf1789 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.675947:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf1789 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.675955:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918300) 00010000:00010000:0.0:1787893147.675957:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893147.675960:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf1789 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.675965:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf1789 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.675975:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf17ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.675981:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf17ac lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.675993:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf17ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.675998:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c0031000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893147.676001:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf17ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.676007:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf17ac lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.676015:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918300) 00010000:00010000:0.0:1787893147.676017:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893147.676020:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf17ac lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.676026:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf17ac lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.676039:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf17f2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.676045:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf17f2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.676050:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf17f2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.676054:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893147.676057:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf17f2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.676072:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf17f2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.676081:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918300) 00010000:00010000:0.0:1787893147.676083:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893147.676085:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf17f2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.676091:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf17f2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893147.712425:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893147.712602:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481789056 00000100:00100000:3.0:1787893147.712614:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481789056 00000100:00100000:3.0:1787893147.712684:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 183 00000100:00100000:3.0:1787893147.712695:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8407b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+18:12362:x1874741481789056:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:3.0:1787893147.712723:0:10086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893147.712818:0:10086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf1870 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa9c5 expref: -99 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.712921:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fe00/0x9232577658cf1877 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.712937:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fe00/0x9232577658cf1877 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.712949:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fe00/0x9232577658cf1877 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893147.712992:0:10086:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1787893147.712996:0:10086:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787893147.713014:0:10086:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fe00/0x9232577658cf1877 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.713060:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf1870 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9c5 expref: 20 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.713079:0:10086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fe00/0x9232577658cf1877 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9c5 expref: 19 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.713088:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc9c3918700) 00010000:00010000:3.0:1787893147.713090:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787893147.713094:0:10086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c771fe00, rc 0) 00000100:00100000:3.0:1787893147.713157:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8407b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+19:12362:x1874741481789056:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 464us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893147.713226:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 183 00000100:00100000:2.0:1787893147.719323:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893147.720042:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481789440 00000100:00100000:1.0:1787893147.720053:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481789440 00000100:00100000:1.0:1787893147.720171:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 48 00000100:00100000:1.0:1787893147.720182:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c846b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+19:12362:x1874741481789440:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:1.0:1787893147.720506:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c846b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+20:12362:x1874741481789440:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 309us (1186us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1787893147.720515:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 48 00000100:00100000:2.0:1787893147.732386:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893147.732523:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481789568 00000100:00100000:3.0:1787893147.732532:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481789568 00000100:00100000:3.0:1787893147.732599:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 15 00000100:00100000:3.0:1787893147.732609:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8468e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+20:12362:x1874741481789568:12345-192.168.202.35@tcp:103:lfs.0 00010000:00010000:3.0:1787893147.732625:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787893147.732650:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf1800 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9a9 expref: 20 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.732672:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf185b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9be expref: 19 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.732686:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728c00/0x9232577658cf16fd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa963 expref: 18 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.732716:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918300) 00010000:00010000:3.0:1787893147.732722:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893147.732784:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8468e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+17:12362:x1874741481789568:12345-192.168.202.35@tcp:103:lfs.0 Request processed in 176us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893147.732792:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 15 00000100:00100000:2.0:1787893147.734985:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893147.735054:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481789696 00000100:00100000:3.0:1787893147.735065:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481789696 00000100:00100000:3.0:1787893147.735121:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 184 00000100:00100000:3.0:1787893147.735132:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+17:12362:x1874741481789696:12345-192.168.202.35@tcp:58:lfs.0 00010000:00010000:3.0:1787893147.735257:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf187e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.735275:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf187e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893147.735286:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf187e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787893147.735389:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1787893147.735472:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+17:12362:x1874741481789696:12345-192.168.202.35@tcp:58:lfs.0 Request processed in 341us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893147.735479:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 184 00000100:00100000:2.0:1787893147.758328:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893147.758470:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481789824 00000100:00100000:0.0:1787893147.758482:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481789824 00000100:00100000:0.0:1787893147.758566:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 185 00000100:00100000:0.0:1787893147.758576:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+17:12364:x1874741481789824:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787893147.758598:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893147.758618:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1885 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa9cc expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.758713:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf188c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.758726:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf188c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.758737:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf188c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.758751:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1893 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.758762:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1893 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.758769:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1893 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.758834:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf189a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.758841:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf189a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.758859:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf189a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893147.758898:0:6506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787893147.758903:0:6506:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787893147.758921:0:6506:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf189a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.758932:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf189a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.758940:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf188c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.758947:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf188c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.758953:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf188c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.758969:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893147.758974:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf188c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.758981:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf188c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.758994:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc9c3918700) 00010000:00010000:0.0:1787893147.758997:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893147.759001:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf188c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.759007:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf188c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.759019:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1893 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.759024:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1893 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.759030:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1893 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.759035:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893147.759037:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1893 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.759042:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1893 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.759059:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc8c751a100) 00010000:00010000:0.0:1787893147.759061:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893147.759063:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1893 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.759068:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf1893 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.759098:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1885 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9cc expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.759110:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf189a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9cc expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.759116:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918300) 00010000:00010000:0.0:1787893147.759118:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787893147.759120:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb30800, rc 0) 00000100:00100000:0.0:1787893147.759244:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+18:12364:x1874741481789824:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 669us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893147.759251:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 185 00000100:00100000:3.0:1787893147.825834:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787893147.825893:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c846a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493387776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787893147.825979:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893147.826147:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493387776 00000100:00100000:2.0:1787893147.826156:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493387776 00000100:00100000:2.0:1787893147.826213:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787893147.826222:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ed562300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3632:x1874741493387776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787893147.826253:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787893147.826321:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ed562300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3632:x1874741493387776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893147.826329:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787893147.826554:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c846a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493387776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787893147.828915:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493387904:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787893147.828991:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893147.829088:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493387904 00000100:00100000:2.0:1787893147.829096:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493387904 00000100:00100000:2.0:1787893147.829157:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787893147.829166:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8530e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493387904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787893147.829187:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00080000:1.0:1787893147.829637:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787893147.830170:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8530e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493387904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1002us (1175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893147.830178:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787893147.830247:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493387904:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787893148.337896:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787893148.514617:0:14697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787893148.514628:0:14697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787893148.514651:0:14697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787893148.514658:0:14697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1787893148.721682:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787893148.721693:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787893148.721751:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787893148.721761:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787893148.721962:0:13786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8483800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13786:1874741493388032:192.168.202.35@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787893148.722128:0:13786:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c5c9f000 going to sleep for 11 seconds 00000100:00100000:3.0:1787893148.729236:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893148.729318:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481789952 00000100:00100000:0.0:1787893148.729328:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481789952 00000100:00100000:0.0:1787893148.729387:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 186 00000100:00100000:0.0:1787893148.729397:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+19:12376:x1874741481789952:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787893148.729440:0:13436:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787893148.729810:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+19:12376:x1874741481789952:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 Request processed in 413us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893148.729820:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 186 00000100:00100000:2.0:1787893148.730113:0:13786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8483800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13786:1874741493388032:192.168.202.35@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787893148.735744:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893148.736021:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481790080 00000100:00100000:3.0:1787893148.736031:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481790080 00000100:00100000:3.0:1787893148.736130:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 187 00000100:00100000:3.0:1787893148.736142:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+18:12376:x1874741481790080:12345-192.168.202.35@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787893148.736219:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf18a1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.736236:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf18a1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.736248:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf18a1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.736319:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf18a8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.736327:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf18a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.736352:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf18a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.736381:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf18af lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.736390:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf18af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.736397:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf18af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893148.736443:0:9515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787893148.736459:0:9515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787893148.736474:0:9515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf18af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.736485:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf18a1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.736517:0:9515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf18a1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.736523:0:9515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf18a1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.736529:0:9515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c771ee00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893148.736533:0:9515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf18a1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.736540:0:9515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf18a1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.736562:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fc9d5c29800) 00010000:00010000:3.0:1787893148.736565:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893148.736570:0:9515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf18a1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.736575:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ee00/0x9232577658cf18a1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.736590:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf18a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.736596:0:9515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf18a8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.736614:0:9515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf18a8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.736619:0:9515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c0031000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893148.736622:0:9515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf18a8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.736629:0:9515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf18a8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.736636:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9fc8c7511100) 00010000:00010000:3.0:1787893148.736639:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893148.736642:0:9515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf18a8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.736648:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031000/0x9232577658cf18a8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.736679:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf18af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.736685:0:9515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf18af lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.736691:0:9515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf18af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.736696:0:9515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c0031400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893148.736699:0:9515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf18af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.736705:0:9515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf18af lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.736713:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918300) 00010000:00010000:3.0:1787893148.736715:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893148.736718:0:9515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf18af lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.736724:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031400/0x9232577658cf18af lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893148.736828:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+18:12376:x1874741481790080:12345-192.168.202.35@tcp:34:lhsmtool_posix.0 Request processed in 687us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893148.736847:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 187 00000100:00100000:1.0:1787893148.741256:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893148.741429:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481790336 00000100:00100000:0.0:1787893148.741440:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481790336 00000100:00100000:0.0:1787893148.741950:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 188 00000100:00100000:0.0:1787893148.741972:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+18:12376:x1874741481790336:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787893148.741992:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893148.742011:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf18b6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa9d3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.742123:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf18bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.742139:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf18bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.742152:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf18bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893148.742164:0:6506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787893148.742238:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf18bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.742246:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf18bd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.742270:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf18bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.742276:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893148.742280:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf18bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.742288:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf18bd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.742312:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918300) 00010000:00010000:0.0:1787893148.742315:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787893148.742319:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf18bd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.742325:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf18bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.742364:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf18b6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9d3 expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.742373:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fc9d5c29800) 00010000:00010000:0.0:1787893148.742376:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787893148.742380:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf18b6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9d3 expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.742389:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb31600, rc 0) 00000100:00100000:0.0:1787893148.742459:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+19:12376:x1874741481790336:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 482us (1205us total) trans 4294967459 rc 301/301 00000100:00100000:0.0:1787893148.742476:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 188 00000100:00100000:3.0:1787893148.746870:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893148.747025:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481790464 00000100:00100000:1.0:1787893148.747034:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481790464 00000100:00100000:1.0:1787893148.747102:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 189 00000100:00100000:1.0:1787893148.747112:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+19:12376:x1874741481790464:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787893148.747164:0:10086:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787893148.747281:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+19:12376:x1874741481790464:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 Request processed in 170us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893148.747289:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 189 00000100:00100000:1.0:1787893148.752404:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893148.752524:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481790720 00000100:00100000:2.0:1787893148.752535:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481790720 00000100:00100000:2.0:1787893148.752594:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 190 00000100:00100000:2.0:1787893148.752615:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+19:12376:x1874741481790720:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787893148.752635:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893148.752638:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787893148.752668:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771fe00/0x9232577658cf1877 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9c5 expref: 19 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893148.752692:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc9c3918700) 00010000:00010000:2.0:1787893148.752698:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787893148.752715:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fe00/0x9232577658cf18cb lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa9da expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787893148.753152:0:6505:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:2.0:1787893148.753294:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fc00/0x9232577658cf18d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893148.753307:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fc00/0x9232577658cf18d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893148.753317:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fc00/0x9232577658cf18d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893148.753368:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fe00/0x9232577658cf18cb lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9da expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893148.753399:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fc00/0x9232577658cf18d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9da expref: 20 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893148.753407:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fc8c6614e00) 00010000:00010000:2.0:1787893148.753410:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787893148.753412:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7fc00, rc 0) 00000100:00100000:2.0:1787893148.753485:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+20:12376:x1874741481790720:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 872us (1090us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1787893148.753534:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 190 00000100:00100000:3.0:1787893148.763996:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893148.764401:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481790976 00000100:00100000:0.0:1787893148.764412:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481790976 00000100:00100000:0.0:1787893148.764478:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 191 00000100:00100000:0.0:1787893148.764512:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+20:12376:x1874741481790976:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787893148.764573:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893148.764615:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fc00/0x9232577658cf18d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9da expref: 20 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.764638:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fc8c6614e00) 00010000:00010000:0.0:1787893148.764652:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787893148.764679:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf18e0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.764693:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf18e0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.764703:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf18e0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.764765:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf18e7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x4cae0820 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.764773:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf18e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x4cae0820 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.764793:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf18e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x4cae0820 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.764867:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf18e0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.764874:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf18e0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.764880:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf18e0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.764887:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893148.764891:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf18e0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.764899:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf18e0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.764909:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc9c3918700) 00010000:00010000:0.0:1787893148.764912:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893148.764915:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf18e0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.764920:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf18e0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.764930:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf18e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x4cae0820 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.764936:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf18e7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4cae0820 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.764942:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf18e7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4cae0820 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.764954:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893148.764957:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf18e7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4cae0820 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.764963:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf18e7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4cae0820 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.764972:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x4cae0820 (ffff9fc8c751a100) 00010000:00010000:0.0:1787893148.764974:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893148.764977:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf18e7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x4cae0820 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.764982:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf18e7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x4cae0820 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893148.765075:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+19:12376:x1874741481790976:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 Request processed in 587us (1089us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787893148.765083:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 191 00000100:00100000:3.0:1787893148.768174:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893148.768264:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481791104 00000100:00100000:2.0:1787893148.768275:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481791104 00000100:00100000:2.0:1787893148.768345:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 192 00000100:00100000:2.0:1787893148.768356:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+19:12376:x1874741481791104:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787893148.768387:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893148.768411:0:13436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf18ee lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa9e1 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893148.768451:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf18f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893148.768464:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf18f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893148.768476:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf18f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893148.768714:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf18ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9e1 expref: 21 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893148.768742:0:13436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf18f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9e1 expref: 20 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893148.768751:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fc8c6614900) 00010000:00010000:2.0:1787893148.768754:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787893148.768758:0:13436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7ea00, rc 0) 00000100:00100000:2.0:1787893148.768904:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+20:12376:x1874741481791104:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 549us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893148.768911:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 192 00000100:00100000:2.0:1787893148.774544:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893148.774671:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481791360 00000100:00100000:3.0:1787893148.774683:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481791360 00000100:00100000:3.0:1787893148.774779:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 193 00000100:00100000:3.0:1787893148.774800:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c846a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+20:12376:x1874741481791360:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787893148.774898:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6a00/0x9232577658cf18fc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.774916:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6a00/0x9232577658cf18fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.774928:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6a00/0x9232577658cf18fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787893148.775103:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1787893148.775113:0:9515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 392596621387ns, next at 393596618799ns, rc = 0 00000004:00010000:3.0:1787893148.775162:0:9515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d29b11c6 reply state 000000005d00e6ba transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6a00/0x9232577658cf18fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.775174:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6a00/0x9232577658cf18fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.775182:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fc8c6614900) 00010000:00010000:3.0:1787893148.775185:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787893148.775188:0:9515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787893148.775291:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c846a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+22:12376:x1874741481791360:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 Request processed in 503us (756us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1787893148.775298:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 193 00000100:00100000:0.0:1787893148.778262:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893148.778358:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481791488 00000100:00100000:2.0:1787893148.778368:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481791488 00000100:00100000:2.0:1787893148.778426:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 194 00000100:00100000:2.0:1787893148.778437:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+22:12376:x1874741481791488:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787893148.778465:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893148.778785:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1903 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa9e8 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893148.778860:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1903 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9e8 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893148.778875:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1903 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9e8 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893148.778897:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fc8c6614900) 00010000:00010000:2.0:1787893148.778914:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787893148.778919:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7ee00, rc 0) 00000100:00100000:2.0:1787893148.779026:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+23:12376:x1874741481791488:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 590us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893148.779033:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 194 00000100:00100000:2.0:1787893148.782382:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893148.782533:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481791616 00000100:00100000:1.0:1787893148.782543:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481791616 00000100:00100000:1.0:1787893148.782622:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 59 00000100:00100000:1.0:1787893148.782634:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8468000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58232959-285a-4954-a3ac-571a2b817017+6:2390:x1874741481791616:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787893148.782870:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8468000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58232959-285a-4954-a3ac-571a2b817017+7:2390:x1874741481791616:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 Request processed in 237us (499us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787893148.782878:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 59 00000100:00080000:0.0:1787893148.782992:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787893148.786758:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893148.786866:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481791872 00000100:00100000:0.0:1787893148.786877:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481791872 00000100:00100000:0.0:1787893148.786928:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 49 00000100:00100000:0.0:1787893148.786939:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+23:12376:x1874741481791872:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787893148.787166:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+24:12376:x1874741481791872:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 Request processed in 228us (416us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1787893148.787173:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 49 00000100:00100000:2.0:1787893148.790267:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893148.790393:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481792128 00000100:00100000:0.0:1787893148.790402:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481792128 00000100:00100000:0.0:1787893148.790460:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 195 00000100:00100000:0.0:1787893148.790471:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c846b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+24:12376:x1874741481792128:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787893148.790611:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c846b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+24:12376:x1874741481792128:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 Request processed in 142us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893148.790619:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 195 00000100:00100000:2.0:1787893148.793827:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893148.793935:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481792256 00000100:00100000:0.0:1787893148.793945:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481792256 00000100:00100000:0.0:1787893148.794019:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 196 00000100:00100000:0.0:1787893148.794030:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+24:12376:x1874741481792256:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787893148.794049:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893148.794070:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf190a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa9ef expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.794141:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf1911 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.794155:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf1911 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.794166:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf1911 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893148.794209:0:6506:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787893148.794227:0:6506:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf1911 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.794253:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf190a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9ef expref: 26 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.794288:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf1911 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9ef expref: 25 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.794313:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fc8c6614900) 00010000:00010000:0.0:1787893148.794316:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787893148.794320:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb30600, rc 0) 00000100:00100000:0.0:1787893148.794379:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+25:12376:x1874741481792256:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 351us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893148.794386:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 196 00000100:00100000:1.0:1787893148.797987:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893148.798087:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481792384 00000100:00100000:2.0:1787893148.798097:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481792384 00000100:00100000:2.0:1787893148.798157:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 60 00000100:00100000:2.0:1787893148.798168:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+7:2391:x1874741481792384:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787893148.798186:0:8420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893148.798206:0:8420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f7df9f3/0x9232577658cf1918 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa9f6 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787893148.798230:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a91159c, blocks: 0x0 00010000:00010000:2.0:1787893148.798248:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=392s v=(0 0) 00010000:00010000:2.0:1787893148.798253:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893148.798263:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f7df9f3/0x9232577658cf1918 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9f6 expref: 8 pid: 8420 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893148.798278:0:8420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003f7df9f3/0x9232577658cf1918 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9f6 expref: 8 pid: 8420 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893148.798291:0:8420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7fe00, rc 0) 00000100:00100000:2.0:1787893148.798364:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+8:2391:x1874741481792384:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 197us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893148.798384:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 60 00000100:00100000:2.0:1787893148.801653:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893148.801755:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481792640 00000100:00100000:0.0:1787893148.801765:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481792640 00000100:00100000:0.0:1787893148.801822:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 197 00000100:00100000:0.0:1787893148.801832:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+25:12376:x1874741481792640:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787893148.802005:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+25:12376:x1874741481792640:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 Request processed in 174us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893148.802012:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 197 00000100:00100000:0.0:1787893148.805563:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893148.805653:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481792768 00000100:00100000:1.0:1787893148.805664:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481792768 00000100:00100000:1.0:1787893148.805762:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 61 00000100:00100000:1.0:1787893148.805773:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58232959-285a-4954-a3ac-571a2b817017+8:12376:x1874741481792768:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787893148.805791:0:8419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893148.805808:0:8419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b608035/0x9232577658cf191f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fa9fd expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.805849:0:8419:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003f7df9f3/0x9232577658cf1918 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9f6 expref: 9 pid: 8420 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.805877:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893148.805882:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893148.805887:0:8419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b608035/0x9232577658cf191f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9fd expref: 9 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.805919:0:8419:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003f7df9f3/0x9232577658cf1918 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9f6 expref: 9 pid: 8420 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.805932:0:8419:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003f7df9f3/0x9232577658cf1918 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9f6 expref: 9 pid: 8420 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893148.805946:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7cd7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8419:1874741493388160:192.168.202.35@tcp:104: 00000100:00100000:1.0:1787893148.806047:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c70b83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787893148.811039:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893148.811629:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481792896 00000100:00100000:0.0:1787893148.811653:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481792896 00010000:00010000:0.0:1787893148.811704:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003f7df9f3/0x9232577658cf1918 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9f6 expref: 10 pid: 8420 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893148.811746:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 87 00000100:00100000:0.0:1787893148.811756:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c846ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58232959-285a-4954-a3ac-571a2b817017+10:2390:x1874741481792896:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893148.811790:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893148.811814:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003f7df9f3/0x9232577658cf1918 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9f6 expref: 10 pid: 8420 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.811829:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003f7df9f3/0x9232577658cf1918 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9f6 expref: 10 pid: 8420 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.811866:0:6492:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787893148.811871:0:6492:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787893148.811881:0:6492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000b608035/0x9232577658cf191f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9fd expref: 10 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.811892:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b608035/0x9232577658cf191f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9fd expref: 10 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.811930:0:6492:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000b608035/0x9232577658cf191f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9fd expref: 10 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893148.811944:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8530700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6492:1874741493388288:192.168.202.35@tcp:105: 00000100:00100000:0.0:1787893148.812046:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d7ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1787893148.814594:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8530700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6492:1874741493388288:192.168.202.35@tcp:105: 00010000:00010000:3.0:1787893148.814621:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893148.814693:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c846ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58232959-285a-4954-a3ac-571a2b817017+10:2390:x1874741481792896:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 2937us (3663us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893148.814720:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 87 00010000:00010000:1.0:1787893148.817428:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f7df9f3/0x9232577658cf1918 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9f6 expref: 9 pid: 8420 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893148.817453:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7cd7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8419:1874741493388160:192.168.202.35@tcp:104: 00010000:00010000:1.0:1787893148.817482:0:8419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000b608035/0x9232577658cf191f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9fd expref: 8 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.817763:0:8419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe541c00, rc 0) 00000100:00100000:1.0:1787893148.817830:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58232959-285a-4954-a3ac-571a2b817017+8:12376:x1874741481792768:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 12057us (12278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893148.817862:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 61 00000100:00100000:3.0:1787893148.822429:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893148.822524:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481793024 00000100:00100000:2.0:1787893148.822534:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481793024 00002000:00100000:2.0:1787893148.822587:0:8424:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9fc8c7ce3480 x1874741481793024/t0(0) o4->58232959-285a-4954-a3ac-571a2b817017@192.168.202.35@tcp:309/0 lens 504/0 e 0 to 0 dl 1787893159 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787893148.822600:0:8424:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc8c7ce3480 with x1874741481793024 ext(0->8) 00002000:00010000:2.0:1787893148.822606:0:8424:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fc8c7ce3480 00000100:00100000:2.0:1787893148.822634:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 4 00000100:00100000:2.0:1787893148.822643:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:58232959-285a-4954-a3ac-571a2b817017+8:2390:x1874741481793024:12345-192.168.202.35@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787893148.824304:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:58232959-285a-4954-a3ac-571a2b817017+10:2390:x1874741481793024:12345-192.168.202.35@tcp:4:lhsmtool_posix.0 Request processed in 1646us (1870us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1787893148.824317:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 4 00002000:00100000:2.0:1787893148.824328:0:8424:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9fc8c7ce3480 x1874741481793024/t4294967315(0) o4->58232959-285a-4954-a3ac-571a2b817017@192.168.202.35@tcp:309/0 lens 504/448 e 0 to 0 dl 1787893159 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787893148.824338:0:8424:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc8c7ce3480 with x1874741481793024 ext(0->8) 00002000:00010000:2.0:1787893148.824343:0:8424:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fc8c7ce3480 00000100:00100000:3.0:1787893148.828154:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893148.828317:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481793152 00000100:00100000:0.0:1787893148.828328:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481793152 00000100:00100000:0.0:1787893148.828394:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 198 00000100:00100000:0.0:1787893148.828406:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+25:12376:x1874741481793152:12345-192.168.202.35@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787893148.831518:0:6484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:0.0:1787893148.831545:0:6484:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:0.0:1787893148.831568:0:6484:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:0.0:1787893148.831712:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+20:12376:x1874741481793152:12345-192.168.202.35@tcp:44:lhsmtool_posix.0 Request processed in 3304us (3563us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893148.831723:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 198 00000020:00080000:3.0:1787893148.831808:0:6536:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1787893148.831819:0:6536:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1787893148.832453:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787893148.832473:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493388416:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787893148.832561:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893148.832649:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493388416 00000100:00100000:1.0:1787893148.832657:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493388416 00000100:00100000:1.0:1787893148.832721:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787893148.832731:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493388416:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787893148.832874:0:8420:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787893148.832878:0:8420:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787893149 00002000:00010000:1.0:1787893148.832881:0:8420:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787893148.832883:0:8420:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1787893148 -> 1787893149 00002000:00010000:1.0:1787893148.832885:0:8420:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1787893148.832926:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3630:x1874741493388416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 196us (364us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787893148.832933:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:1.0:1787893148.832978:0:3630:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fc8c7cd7b80/2, rc 0, transno 4294967316 00000100:00100000:1.0:1787893148.832985:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493388416:0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1787893148.833440:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787893148.835300:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6a00/0x9232577658cf18fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893148.835320:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6a00/0x9232577658cf18fc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893148.835328:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6a00/0x9232577658cf18fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893148.835352:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c84f6a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893148.835358:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6a00/0x9232577658cf18fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893148.835366:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6a00/0x9232577658cf18fc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893148.835385:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fc8c6614900) 00010000:00010000:2.0:1787893148.835388:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787893148.835394:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6a00/0x9232577658cf18fc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893148.835400:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6a00/0x9232577658cf18fc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893148.836918:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893148.837017:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481793280 00000100:00100000:3.0:1787893148.837028:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481793280 00000100:00100000:3.0:1787893148.837093:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 63 00000100:00100000:3.0:1787893148.837105:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58232959-285a-4954-a3ac-571a2b817017+10:2390:x1874741481793280:12345-192.168.202.35@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1787893148.839404:0:9497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:2.0:1787893148.839419:0:9497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:3.0:1787893148.839622:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58232959-285a-4954-a3ac-571a2b817017+7:2390:x1874741481793280:12345-192.168.202.35@tcp:16:lhsmtool_posix.0 Request processed in 2515us (2708us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893148.839633:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 63 00000100:00100000:1.0:1787893148.843132:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893148.843233:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481793536 00000100:00100000:0.0:1787893148.843242:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481793536 00000100:00100000:0.0:1787893148.843314:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 199 00000100:00100000:0.0:1787893148.843324:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+19:12376:x1874741481793536:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787893148.843382:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893148.843408:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf1911 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9ef expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.843429:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fc8c6614900) 00010000:00010000:0.0:1787893148.843434:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787893148.843460:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf1926 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.843474:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf1926 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.843484:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf1926 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787893148.843649:0:6506:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000058cf2d14 reply state 00000000ad4ad97e transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf1926 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.843662:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf1926 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.843685:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fc8c6614900) 00010000:00010000:0.0:1787893148.843687:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787893148.843690:0:6506:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787893148.844132:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+20:12376:x1874741481793536:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 Request processed in 807us (1010us total) trans 4294967463 rc 0/0 00000100:00100000:0.0:1787893148.844140:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 199 00000100:00100000:0.0:1787893148.848380:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893148.848472:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481793664 00000100:00100000:1.0:1787893148.848482:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481793664 00000100:00100000:1.0:1787893148.848683:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 64 00000100:00100000:1.0:1787893148.848694:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+7:2391:x1874741481793664:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787893148.849126:0:8420:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787893148.849130:0:8420:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1787893149 -> 1787893147 00002000:00010000:1.0:1787893148.849133:0:8420:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787893145 00002000:00010000:1.0:1787893148.849136:0:8420:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1787893149 -> 1787893147 00002000:00010000:1.0:1787893148.849138:0:8420:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1787893148.849220:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+8:2391:x1874741481793664:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 Request processed in 526us (848us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1787893148.849228:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 64 00000100:00100000:2.0:1787893148.852166:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893148.852566:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481793920 00000100:00100000:0.0:1787893148.852575:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481793920 00000100:00100000:0.0:1787893148.852669:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 200 00000100:00100000:0.0:1787893148.852681:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+20:12376:x1874741481793920:12345-192.168.202.35@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787893148.852754:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf192d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.852772:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf18f5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9e1 expref: 20 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.852793:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf192d lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.852831:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf18f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9e1 expref: 20 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.852854:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf18f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9e1 expref: 20 pid: 13436 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893148.852868:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8530380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6504:1874741493388544:192.168.202.35@tcp:104: 00000100:00100000:0.0:1787893148.853092:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d7ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787893148.858314:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893148.859537:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481794048 00000100:00100000:3.0:1787893148.859550:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481794048 00010000:00010000:3.0:1787893148.859599:0:6490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf18f5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9e1 expref: 21 pid: 13436 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893148.859654:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 88 00000100:00100000:3.0:1787893148.859664:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3efd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+21:2391:x1874741481794048:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893148.859682:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893148.859689:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf18f5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9e1 expref: 21 pid: 13436 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.859723:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf18f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9e1 expref: 21 pid: 13436 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.859747:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fc8c6614900) 00010000:00010000:3.0:1787893148.859753:0:6490:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf192d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.859763:0:6490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf192d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.859771:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf192d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.860045:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893148.860110:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3efd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+21:2391:x1874741481794048:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 447us (1805us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893148.860118:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 88 00010000:00010000:2.0:1787893148.862354:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf18f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9e1 expref: 20 pid: 13436 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893148.862380:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8530380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6504:1874741493388544:192.168.202.35@tcp:104: 00010000:00010000:2.0:1787893148.862401:0:6504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf192d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.862652:0:6504:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf192d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.862661:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf192d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.862708:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf192d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.862715:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf192d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.862723:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf192d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.862729:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893148.862733:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf192d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.862740:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf192d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.862755:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fc8c6614900) 00010000:00010000:0.0:1787893148.862758:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787893148.862762:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf192d lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.862769:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf192d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893148.863075:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+19:12376:x1874741481793920:12345-192.168.202.35@tcp:55:lhsmtool_posix.0 Request processed in 10394us (10915us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787893148.863086:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 200 00000100:00100000:0.0:1787893148.867721:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893148.867888:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481794176 00000100:00100000:1.0:1787893148.867899:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481794176 00000100:00100000:1.0:1787893148.868051:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 65 00000100:00100000:1.0:1787893148.868064:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8530380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58232959-285a-4954-a3ac-571a2b817017+8:2390:x1874741481794176:12345-192.168.202.35@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787893148.868111:0:8419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000060f5eadb/0x9232577658cf1934 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.868132:0:8419:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000b608035/0x9232577658cf191f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9fd expref: 8 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.868140:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893148.868145:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787893148.868149:0:8419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060f5eadb/0x9232577658cf1934 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.868188:0:8419:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000b608035/0x9232577658cf191f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9fd expref: 8 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.868202:0:8419:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000b608035/0x9232577658cf191f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9fd expref: 8 pid: 8419 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893148.868216:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7cd5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8419:1874741493388672:192.168.202.35@tcp:104: 00000100:00100000:1.0:1787893148.868315:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c70b83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787893148.872868:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893148.872901:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7cd5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8419:1874741493388672:192.168.202.35@tcp:104: 00010000:00010000:2.0:1787893148.872930:0:8419:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000060f5eadb/0x9232577658cf1934 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893148.872970:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481794304 00000100:00100000:3.0:1787893148.872977:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481794304 00010000:00010000:3.0:1787893148.873014:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000b608035/0x9232577658cf191f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9fd expref: 9 pid: 8419 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893148.873051:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 89 00000100:00100000:3.0:1787893148.873061:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58232959-285a-4954-a3ac-571a2b817017+9:2391:x1874741481794304:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893148.873076:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893148.873097:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000b608035/0x9232577658cf191f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9fd expref: 9 pid: 8419 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.873116:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000b608035/0x9232577658cf191f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9fd expref: 9 pid: 8419 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.873134:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b608035/0x9232577658cf191f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9fd expref: 9 pid: 8419 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.873145:0:6492:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787893148.873148:0:6492:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787893148.873152:0:6492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000060f5eadb/0x9232577658cf1934 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.873158:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060f5eadb/0x9232577658cf1934 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.873180:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787893148.873201:0:8419:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000060f5eadb/0x9232577658cf1934 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893148.873209:0:8419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060f5eadb/0x9232577658cf1934 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893148.873228:0:8419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000060f5eadb/0x9232577658cf1934 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893148.873236:0:8419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060f5eadb/0x9232577658cf1934 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893148.873245:0:8419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060f5eadb/0x9232577658cf1934 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893148.873252:0:8419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540600 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787893148.873257:0:8419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060f5eadb/0x9232577658cf1934 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893148.873266:0:8419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060f5eadb/0x9232577658cf1934 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893148.873279:0:8419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060f5eadb/0x9232577658cf1934 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893148.873309:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060f5eadb/0x9232577658cf1934 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893148.873336:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58232959-285a-4954-a3ac-571a2b817017+8:2391:x1874741481794304:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 275us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893148.873343:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 89 00000100:00100000:2.0:1787893148.873355:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8530380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58232959-285a-4954-a3ac-571a2b817017+7:2390:x1874741481794176:12345-192.168.202.35@tcp:1:lhsmtool_posix.0 Request processed in 5295us (5645us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893148.873363:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 65 00000100:00100000:0.0:1787893148.875717:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893148.875793:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481794560 00000100:00100000:3.0:1787893148.875803:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481794560 00000100:00100000:3.0:1787893148.875860:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 201 00000100:00100000:3.0:1787893148.875868:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+19:12376:x1874741481794560:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787893148.875929:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7200/0x9232577658cf193b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.875941:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1782 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa986 expref: 19 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.875957:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7200/0x9232577658cf193b lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.875982:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1782 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa986 expref: 19 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.875991:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1782 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa986 expref: 19 pid: 10086 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893148.876001:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6505:1874741493388800:192.168.202.35@tcp:104: 00000100:00100000:3.0:1787893148.876117:0:6505:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c3aa90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787893148.879536:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893148.879720:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6505:1874741493388800:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787893148.879748:0:6505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7200/0x9232577658cf193b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893148.879910:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481794688 00000100:00100000:1.0:1787893148.879917:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481794688 00010000:00010000:0.0:1787893148.879996:0:6490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1782 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa986 expref: 20 pid: 10086 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893148.880081:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 90 00000100:00100000:0.0:1787893148.880092:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8531180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+20:2391:x1874741481794688:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893148.880105:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893148.880110:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1782 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa986 expref: 20 pid: 10086 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.880119:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1782 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa986 expref: 20 pid: 10086 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.880135:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030800/0x9232577658cf1782 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa986 expref: 20 pid: 10086 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.880148:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918300) 00010000:00010000:0.0:1787893148.880152:0:6490:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7200/0x9232577658cf193b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.880159:0:6490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7200/0x9232577658cf193b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.880178:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7200/0x9232577658cf193b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.880199:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893148.880240:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8531180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+19:2391:x1874741481794688:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 150us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893148.880256:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 90 00010000:00010000:3.0:1787893148.880303:0:6505:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7200/0x9232577658cf193b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.880309:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7200/0x9232577658cf193b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.880561:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7400/0x9232577658cf1942 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.880573:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1903 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9e8 expref: 19 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.880581:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7400/0x9232577658cf1942 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.880616:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1903 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9e8 expref: 19 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.880629:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1903 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9e8 expref: 19 pid: 6504 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893148.880652:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6505:1874741493388928:192.168.202.35@tcp:104: 00000100:00100000:3.0:1787893148.880706:0:6505:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c2d2dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787893148.883587:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893148.883713:0:10383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481794816 00000100:00100000:1.0:1787893148.883723:0:10383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481794816 00010000:00010000:1.0:1787893148.883764:0:10383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1903 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9e8 expref: 20 pid: 6504 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893148.883889:0:10383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 91 00000100:00100000:1.0:1787893148.883901:0:10383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8468700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58232959-285a-4954-a3ac-571a2b817017+20:2390:x1874741481794816:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893148.883916:0:10383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893148.883924:0:10383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1903 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9e8 expref: 20 pid: 6504 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.883938:0:10383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1903 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9e8 expref: 20 pid: 6504 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.883970:0:10383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fc8c6614900) 00010000:00010000:1.0:1787893148.883976:0:10383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7400/0x9232577658cf1942 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.883985:0:10383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7400/0x9232577658cf1942 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.883993:0:10383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7400/0x9232577658cf1942 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.884012:0:10383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893148.884065:0:10383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8468700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58232959-285a-4954-a3ac-571a2b817017+20:2390:x1874741481794816:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 166us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893148.884090:0:10383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 91 00010000:00010000:3.0:1787893148.885385:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1903 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9e8 expref: 19 pid: 6504 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893148.885403:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6505:1874741493388928:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787893148.885482:0:6505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7400/0x9232577658cf1942 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.885609:0:6505:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7400/0x9232577658cf1942 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893148.885617:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7400/0x9232577658cf1942 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787893148.885724:0:6505:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:0.0:1787893148.885939:0:6505:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:0.0:1787893148.886030:0:6505:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:0.0:1787893148.886092:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8531c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6505:1874741493389056:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787893148.886138:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893148.886228:0:6505:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d7ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1787893148.886344:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493389056 00000100:00100000:2.0:1787893148.886351:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493389056 00000100:00100000:2.0:1787893148.886479:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787893148.886522:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8532a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6505:x1874741493389056:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787893148.886596:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8532a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6505:x1874741493389056:12345-0@lo:1000:mdt00_001.0 Request processed in 109us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893148.886603:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787893148.886698:0:6505:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:1.0:1787893148.886704:0:6505:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fc8c7cd7b80, transno 4294967316 00000100:00100000:1.0:1787893148.886716:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8531c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6505:1874741493389056:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1787893148.886846:0:6505:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:1.0:1787893148.886889:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7cd4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6505:1874741493389184:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787893148.886937:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893148.887405:0:6505:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c70b8240 going to sleep for 11 seconds 00000100:00100000:0.0:1787893148.887621:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493389184 00000100:00100000:0.0:1787893148.887626:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493389184 00000100:00100000:0.0:1787893148.887652:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787893148.887660:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6505:x1874741493389184:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787893148.887772:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6505:x1874741493389184:12345-0@lo:1000:mdt00_001.0 Request processed in 113us (834us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1787893148.887791:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787893148.887933:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7cd4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6505:1874741493389184:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1787893148.887982:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7400/0x9232577658cf1942 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.887992:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7400/0x9232577658cf1942 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.888000:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7400/0x9232577658cf1942 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.888005:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c84f7400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893148.888008:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7400/0x9232577658cf1942 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.888013:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7400/0x9232577658cf1942 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.888025:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fc8c6614900) 00010000:00010000:1.0:1787893148.888027:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787893148.888030:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7400/0x9232577658cf1942 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.888041:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7400/0x9232577658cf1942 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.888059:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf187e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.888063:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf187e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.888066:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf187e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.888069:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c771f400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893148.888071:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf187e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.888074:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf187e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.888078:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918300) 00010000:00010000:1.0:1787893148.888080:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787893148.888081:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf187e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.888084:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f400/0x9232577658cf187e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.888099:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1949 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.888109:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf189a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9cc expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.888118:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1949 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.888136:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf189a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9cc expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.888145:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf189a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9cc expref: 22 pid: 6506 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893148.888154:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7cd7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6505:1874741493389312:192.168.202.35@tcp:104: 00000100:00100000:1.0:1787893148.888209:0:6505:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d7ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787893148.892171:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7cd7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6505:1874741493389312:192.168.202.35@tcp:104: 00000100:00100000:0.0:1787893148.892184:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00010000:00010000:1.0:1787893148.892199:0:6505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1949 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893148.892242:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481794944 00000100:00100000:3.0:1787893148.892255:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481794944 00010000:00010000:3.0:1787893148.892284:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf189a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9cc expref: 23 pid: 6506 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893148.892311:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 92 00000100:00100000:3.0:1787893148.892318:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8531500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58232959-285a-4954-a3ac-571a2b817017+23:2391:x1874741481794944:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893148.892330:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893148.892336:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf189a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9cc expref: 23 pid: 6506 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.892359:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf189a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9cc expref: 23 pid: 6506 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.892378:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf189a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa9cc expref: 23 pid: 6506 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.892389:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918300) 00010000:00010000:3.0:1787893148.892392:0:6491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1949 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.892399:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1949 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.892404:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1949 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893148.892429:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787893148.892447:0:6505:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1949 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.892453:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1949 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.892474:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1949 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893148.892476:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8531500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58232959-285a-4954-a3ac-571a2b817017+22:2391:x1874741481794944:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 157us (292us total) trans 0 rc 0/0 00010000:00010000:1.0:1787893148.892482:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1949 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893148.892483:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 92 00010000:00010000:1.0:1787893148.892507:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1949 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.892520:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893148.892525:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1949 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.892531:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1949 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.892541:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918300) 00010000:00010000:1.0:1787893148.892543:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893148.892548:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1949 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.892554:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1949 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.892564:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7200/0x9232577658cf193b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.892570:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7200/0x9232577658cf193b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.892576:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7200/0x9232577658cf193b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.892581:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c84f7200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893148.892584:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7200/0x9232577658cf193b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.892590:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7200/0x9232577658cf193b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.892622:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc9c3918300) 00010000:00010000:1.0:1787893148.892624:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787893148.892627:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7200/0x9232577658cf193b lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.892633:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7200/0x9232577658cf193b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893148.893183:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+21:12376:x1874741481794560:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 Request processed in 17313us (17473us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1787893148.893192:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 201 00000020:00080000:1.0:1787893148.893197:0:6505:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787893148.894102:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787893148.894109:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787893148.894515:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1787893148.894524:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787893148.896713:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893148.896935:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481795200 00000100:00100000:2.0:1787893148.896946:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481795200 00000100:00100000:2.0:1787893148.897066:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 50 00000100:00100000:2.0:1787893148.897075:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fefc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+21:12376:x1874741481795200:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787893148.897401:0:6508:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787893148.897433:0:6508:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:2.0:1787893148.897472:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fe00/0x9232577658cf1950 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893148.897698:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fe00/0x9232577658cf1950 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893148.897724:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fe00/0x9232577658cf1950 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893148.897734:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fe00/0x9232577658cf1950 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893148.897739:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fe00/0x9232577658cf1950 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893148.897745:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fe00/0x9232577658cf1950 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893148.897867:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787893148.897870:0:8435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893148.897877:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fe00/0x9232577658cf1950 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.897884:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7fe00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:1.0:1787893148.897887:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fe00/0x9232577658cf1950 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.897895:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fe00/0x9232577658cf1950 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.897907:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fc8c6614900) 00010000:00010000:1.0:1787893148.897910:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787893148.897914:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fe00/0x9232577658cf1950 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.897919:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fe00/0x9232577658cf1950 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893148.897940:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893148.897941:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893148.897943:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893148.897997:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fefc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+23:12376:x1874741481795200:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 Request processed in 921us (1290us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1787893148.898007:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 50 00000020:00080000:2.0:1787893148.898012:0:6508:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787893149.361717:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893149.362097:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8533100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493389440:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787893149.362181:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893149.362382:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493389440 00000100:00100000:0.0:1787893149.362390:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493389440 00000100:00100000:0.0:1787893149.362445:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787893149.362456:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493389440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787893149.362513:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787893149.362571:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493389440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893149.362578:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787893149.363001:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8533100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493389440:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787893150.386649:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c846b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493389568:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787893150.386719:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893150.386860:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493389568 00000100:00100000:2.0:1787893150.386868:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493389568 00000100:00100000:2.0:1787893150.386914:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787893150.386923:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493389568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787893150.386954:0:7865:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00010000:00010000:0.0:1787893150.387736:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893150.388316:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493389568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1389us (1592us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893150.388326:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000040:00080000:2.0:1787893150.394168:0:14748:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787893150.394177:0:14748:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787893150.394216:0:14748:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1787893150.394228:0:14748:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787893150.400519:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c846b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493389568:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787893150.593120:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893150.607338:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481795456 00000100:00100000:2.0:1787893150.607354:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481795456 00000100:00080000:2.0:1787893150.607390:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787893150.607444:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 202 00000100:00100000:2.0:1787893150.607454:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+23:12393:x1874741481795456:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:2.0:1787893150.607478:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893150.607517:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf1957 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62faa04 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.607627:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fc00/0x9232577658cf195e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.607654:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fc00/0x9232577658cf195e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.607668:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fc00/0x9232577658cf195e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893150.607679:0:6506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1787893150.607777:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf1957 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa04 expref: 26 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.607795:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fc00/0x9232577658cf195e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa04 expref: 25 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.608191:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc9c3918700) 00010000:00010000:2.0:1787893150.608196:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787893150.608199:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7fc00, rc 0) 00000100:00100000:2.0:1787893150.608269:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+25:12393:x1874741481795456:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 816us (15159us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1787893150.608389:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 202 00000100:00100000:3.0:1787893150.617917:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893150.618014:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481795584 00000100:00100000:2.0:1787893150.618028:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481795584 00000100:00100000:2.0:1787893150.618091:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 203 00000100:00100000:2.0:1787893150.618101:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+25:12393:x1874741481795584:12345-192.168.202.35@tcp:34:lfs.0 00010000:00010000:2.0:1787893150.618183:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf196c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.618286:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf196c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.618300:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf196c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.618318:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf1973 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.618326:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf1973 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.618332:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf1973 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.618414:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf197a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.618422:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf197a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.618429:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf197a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787893150.618514:0:10086:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf197a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.618526:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf196c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.618534:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf196c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.618540:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf196c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.618545:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7f400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893150.618550:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf196c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.618557:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf196c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.618570:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc9c3918700) 00010000:00010000:2.0:1787893150.618573:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893150.618578:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf196c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.618584:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf196c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.618594:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf1973 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.618600:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf1973 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.618613:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf1973 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.618618:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7e400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893150.618621:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf1973 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.618627:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf1973 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.618634:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc8c6615100) 00010000:00010000:2.0:1787893150.618636:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893150.618639:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf1973 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.618644:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf1973 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.618658:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf197a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.618664:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf197a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.618670:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf197a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.618675:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7fa00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893150.618678:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf197a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.618693:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf197a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.618700:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc8c6615300) 00010000:00010000:2.0:1787893150.618703:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893150.618706:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf197a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.618712:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf197a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893150.618778:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+25:12393:x1874741481795584:12345-192.168.202.35@tcp:34:lfs.0 Request processed in 678us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893150.618786:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 203 00000100:00100000:2.0:1787893150.686766:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893150.686899:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481795840 00000100:00100000:0.0:1787893150.686909:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481795840 00000100:00100000:0.0:1787893150.686969:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 204 00000100:00100000:0.0:1787893150.686990:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c846aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+25:12396:x1874741481795840:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787893150.687010:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893150.687032:0:13436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf1981 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62faa0b expref: -99 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.687104:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1988 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.687120:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1988 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.687132:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1988 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.687146:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf198f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.687171:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf198f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.687178:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf198f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.687449:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1996 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.687456:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1996 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.687460:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1996 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893150.687467:0:13436:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787893150.687656:0:13436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1988 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.687661:0:13436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1988 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.687666:0:13436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1988 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.687670:0:13436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893150.687673:0:13436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1988 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.687678:0:13436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1988 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.687695:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc9c3918700) 00010000:00010000:0.0:1787893150.687697:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893150.687700:0:13436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1988 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.687704:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1988 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.687711:0:13436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf198f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.687714:0:13436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf198f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.687718:0:13436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf198f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.687721:0:13436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893150.687723:0:13436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf198f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.687726:0:13436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf198f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.687729:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc8c751a100) 00010000:00010000:0.0:1787893150.687731:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893150.687732:0:13436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf198f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.687735:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf198f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.687780:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf1981 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa0b expref: 28 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.687793:0:13436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1996 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa0b expref: 27 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.687800:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc8c751af00) 00010000:00010000:0.0:1787893150.687802:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787893150.687804:0:13436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb30800, rc 0) 00000100:00100000:0.0:1787893150.687882:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c846aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+27:12396:x1874741481795840:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 894us (1125us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1787893150.687890:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 204 00000100:00100000:3.0:1787893150.693035:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893150.695417:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481795968 00000100:00100000:2.0:1787893150.695434:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481795968 00000100:00100000:3.0:1787893150.696420:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 205 00000100:00100000:3.0:1787893150.696435:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+27:12396:x1874741481795968:12345-192.168.202.35@tcp:54:lfs.0 00010000:00010000:3.0:1787893150.696515:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6c00/0x9232577658cf19a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893150.696528:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6c00/0x9232577658cf19a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893150.696537:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6c00/0x9232577658cf19a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893150.696568:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6c00/0x9232577658cf19a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893150.696573:0:9515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6c00/0x9232577658cf19a4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893150.696577:0:9515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6c00/0x9232577658cf19a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893150.696580:0:9515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c84f6c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893150.696583:0:9515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6c00/0x9232577658cf19a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893150.696588:0:9515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6c00/0x9232577658cf19a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893150.696595:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc8c751af00) 00010000:00010000:3.0:1787893150.696609:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787893150.696613:0:9515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6c00/0x9232577658cf19a4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893150.696617:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6c00/0x9232577658cf19a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893150.696685:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+27:12396:x1874741481795968:12345-192.168.202.35@tcp:54:lfs.0 Request processed in 256us (3660us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893150.696690:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 205 00000100:00100000:3.0:1787893150.699783:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893150.699922:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481796224 00000100:00100000:1.0:1787893150.699931:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481796224 00000100:00100000:1.0:1787893150.699991:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 51 00000100:00100000:1.0:1787893150.700001:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8404e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+27:12396:x1874741481796224:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:1.0:1787893150.700264:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8404e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+28:12396:x1874741481796224:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 265us (490us total) trans 4294967473 rc 0/0 00000100:00100000:1.0:1787893150.700270:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 51 00000100:00100000:0.0:1787893150.760005:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893150.760946:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481796480 00000100:00100000:2.0:1787893150.760958:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481796480 00000100:00100000:2.0:1787893150.761069:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 206 00000100:00100000:2.0:1787893150.761081:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+28:11920:x1874741481796480:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:2.0:1787893150.761106:0:10086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893150.761127:0:10086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf19ab lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62faa12 expref: -99 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.761243:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf19b2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.761259:0:10086:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1996 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa0b expref: 29 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.761295:0:10086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf19b2 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.761329:0:10086:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1996 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa0b expref: 29 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.761344:0:10086:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1996 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa0b expref: 29 pid: 13436 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893150.761358:0:10086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8469500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10086:1874741493389696:192.168.202.35@tcp:104: 00000100:00100000:2.0:1787893150.761552:0:10086:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9eee58900 going to sleep for 11 seconds 00000100:00100000:2.0:1787893150.767202:0:10086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8469500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10086:1874741493389696:192.168.202.35@tcp:104: 00010000:00010000:2.0:1787893150.767231:0:10086:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf19b2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893150.772388:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893150.772729:0:10383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481796608 00000100:00100000:1.0:1787893150.772740:0:10383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481796608 00010000:00010000:1.0:1787893150.772790:0:10383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1996 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa0b expref: 30 pid: 13436 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893150.772845:0:10383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 93 00000100:00100000:1.0:1787893150.772855:0:10383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8531c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58232959-285a-4954-a3ac-571a2b817017+30:2391:x1874741481796608:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893150.772873:0:10383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893150.772880:0:10383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1996 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa0b expref: 30 pid: 13436 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893150.772892:0:10383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1996 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa0b expref: 30 pid: 13436 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893150.772936:0:10383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1996 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa0b expref: 30 pid: 13436 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893150.772952:0:10383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc8c751af00) 00010000:00010000:1.0:1787893150.772958:0:10383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf19b2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893150.772967:0:10383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf19b2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893150.772974:0:10383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf19b2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893150.773008:0:10383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893150.773067:0:10383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8531c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58232959-285a-4954-a3ac-571a2b817017+29:2391:x1874741481796608:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 213us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893150.773075:0:10383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 93 00010000:00010000:2.0:1787893150.773458:0:10086:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf19b2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.773467:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf19b2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893150.773532:0:10086:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1787893150.773676:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf19ab lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa12 expref: 30 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.773692:0:10086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf19b2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa12 expref: 29 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.773713:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc8c751af00) 00010000:00010000:2.0:1787893150.773717:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787893150.773719:0:10086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7e400, rc 0) 00000100:00100000:2.0:1787893150.773762:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+29:11920:x1874741481796480:12345-192.168.202.35@tcp:101:bash.0 Request processed in 12684us (13767us total) trans 4294967474 rc 0/0 00000100:00100000:2.0:1787893150.773769:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 206 00000100:00100000:0.0:1787893150.787848:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893150.788628:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481796736 00000100:00100000:1.0:1787893150.788639:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481796736 00000100:00100000:1.0:1787893150.788703:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 207 00000100:00100000:1.0:1787893150.788713:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+29:11920:x1874741481796736:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:1.0:1787893150.788736:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893150.788757:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf19c0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62faa19 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893150.788790:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf19c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893150.788833:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf19c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893150.788844:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf19c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893150.788950:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541200/0x9232577658cf19c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa19 expref: 31 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893150.788966:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf19c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa19 expref: 30 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893150.788975:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc8c751af00) 00010000:00010000:1.0:1787893150.788977:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787893150.788981:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe540c00, rc 0) 00000100:00100000:1.0:1787893150.789183:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+30:11920:x1874741481796736:12345-192.168.202.35@tcp:101:bash.0 Request processed in 470us (1361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893150.789190:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 207 00000100:00100000:3.0:1787893150.793413:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893150.793538:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481796992 00000100:00100000:2.0:1787893150.793549:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481796992 00000100:00100000:2.0:1787893150.793626:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 208 00000100:00100000:2.0:1787893150.793635:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+30:11920:x1874741481796992:12345-192.168.202.35@tcp:36:bash.0 00010000:00010000:2.0:1787893150.793855:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf19ce lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.793874:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf19ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.793886:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf19ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787893150.793922:0:9515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:2.0:1787893150.793941:0:9515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d8f9f3c5 reply state 0000000010182131 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf19ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.793953:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf19ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.793961:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc8c751af00) 00010000:00010000:2.0:1787893150.793964:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787893150.793981:0:9515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787893150.794014:0:9515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:2.0:1787893150.794100:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+34:11920:x1874741481796992:12345-192.168.202.35@tcp:36:bash.0 Request processed in 465us (696us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1787893150.794107:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 208 00000020:00080000:2.0:1787893150.794112:0:9515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1787893150.804035:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893150.810915:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481797120 00000100:00100000:0.0:1787893150.810932:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481797120 00000100:00100000:0.0:1787893150.811058:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 209 00000100:00100000:0.0:1787893150.811070:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+34:11920:x1874741481797120:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:0.0:1787893150.811098:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893150.811120:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf19d5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62faa20 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.811184:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf19d5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa20 expref: 35 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.811222:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf19d5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa20 expref: 35 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.811244:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc8c751af00) 00010000:00010000:0.0:1787893150.811247:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787893150.811252:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb31e00, rc 0) 00000100:00100000:0.0:1787893150.811389:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+35:11920:x1874741481797120:12345-192.168.202.35@tcp:101:bash.0 Request processed in 320us (7362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893150.811396:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 209 00000100:00100000:1.0:1787893150.817428:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893150.817568:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481797248 00000100:00100000:3.0:1787893150.817587:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481797248 00000100:00100000:3.0:1787893150.817647:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 66 00000100:00100000:3.0:1787893150.817656:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58232959-285a-4954-a3ac-571a2b817017+7:11920:x1874741481797248:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:3.0:1787893150.817672:0:8421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893150.817688:0:8421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d911091f/0x9232577658cf19dc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62faa27 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787893150.817711:0:8421:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a91159b, atime: 0x6a911599, ctime: 0x6a91159b, blocks: 0x8 00010000:00010000:3.0:1787893150.817729:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=394s v=(0 0) 00010000:00010000:3.0:1787893150.817732:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893150.817738:0:8421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d911091f/0x9232577658cf19dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa27 expref: 8 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893150.817750:0:8421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d911091f/0x9232577658cf19dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa27 expref: 8 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893150.817773:0:8421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c84f6c00, rc 0) 00000100:00100000:3.0:1787893150.817832:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58232959-285a-4954-a3ac-571a2b817017+8:11920:x1874741481797248:12345-192.168.202.35@tcp:101:bash.0 Request processed in 176us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893150.817839:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 66 00000100:00080000:0.0:1787893150.818090:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787893150.820558:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893150.821919:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481797376 00000100:00100000:0.0:1787893150.821933:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481797376 00002000:00010000:0.0:1787893150.821979:0:8425:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:0.0:1787893150.821984:0:8425:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc8c8407800 with x1874741481797376 ext(0->18446744073709551615) 00002000:00010000:0.0:1787893150.821997:0:8425:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fc8c8407800. 00000100:00100000:0.0:1787893150.822098:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 5 00000100:00100000:0.0:1787893150.822109:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8407800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:58232959-285a-4954-a3ac-571a2b817017+8:2392:x1874741481797376:12345-192.168.202.35@tcp:10:bash.0 00002000:00010000:0.0:1787893150.822362:0:8425:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787893150.822366:0:8425:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1787893147 -> 1787893150 00002000:00010000:0.0:1787893150.822369:0:8425:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1787893145 -> 1787893145 00002000:00010000:0.0:1787893150.822371:0:8425:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1787893147 -> 1787893150 00002000:00010000:0.0:1787893150.822373:0:8425:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1787893150.822444:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8407800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:58232959-285a-4954-a3ac-571a2b817017+9:2392:x1874741481797376:12345-192.168.202.35@tcp:10:bash.0 Request processed in 336us (1895us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1787893150.822453:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 5 00002000:00010000:0.0:1787893150.822466:0:8425:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:0.0:1787893150.822468:0:8425:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc8c8407800 with x1874741481797376 ext(0->18446744073709551615) 00002000:00010000:0.0:1787893150.822472:0:8425:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fc8c8407800. 00000100:00100000:3.0:1787893150.899138:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493389824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787893150.899239:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893150.900001:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7cd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493389952:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787893150.900035:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893150.900096:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493389824 00000100:00100000:0.0:1787893150.900103:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493389824 00000100:00100000:0.0:1787893150.900149:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493389952 00000100:00100000:0.0:1787893150.900152:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493389952 00000100:00100000:0.0:1787893150.900167:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787893150.900175:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8405880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3630:x1874741493389824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787893150.900202:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787893150.906035:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c846b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874741493390336:0@lo:400:kworker.0 00000100:00100000:3.0:1787893150.906297:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893150.910768:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c846bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874741493390208:0@lo:400:kworker.0 00000100:00100000:1.0:1787893150.910860:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893150.910915:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787893150.910923:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8469500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493390080:0@lo:400:kworker.0 00000100:00100000:1.0:1787893150.910951:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893150.911721:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8405880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3630:x1874741493389824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 11542us (12478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893150.911734:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787893150.911770:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493390336 00000100:00100000:0.0:1787893150.911779:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493390336 00000100:00100000:0.0:1787893150.911832:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493390208 00000100:00100000:0.0:1787893150.911836:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493390208 00000100:00100000:0.0:1787893150.911857:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1787893150.911865:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874741493390336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893150.911917:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874741493390336:12345-0@lo:400:kworker.0 Request processed in 53us (5620us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893150.911924:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1787893150.911935:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1787893150.911940:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1874741493390208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893150.914583:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1874741493390208:12345-0@lo:400:kworker.0 Request processed in 2633us (3714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893150.914614:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1787893150.914661:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787893150.914673:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493389952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787893150.914696:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787893150.914760:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493389952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (14724us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893150.914767:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787893150.914812:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7cd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493389952:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787893150.914873:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787893150.914899:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493390080 00000100:00100000:0.0:1787893150.914905:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493390080 00000100:00100000:0.0:1787893150.914938:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:0.0:1787893150.914945:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+24:3633:x1874741493390080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893150.914963:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493389824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787893150.914975:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+24:3633:x1874741493390080:12345-0@lo:400:kworker.0 Request processed in 31us (4023us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893150.914981:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1787893150.914998:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c846b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874741493390336:0@lo:400:kworker.0 00000100:00100000:2.0:1787893150.915628:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c846b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493390592:0@lo:400:kworker.0 00000100:00100000:2.0:1787893150.915668:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893150.915703:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493390592 00000100:00100000:2.0:1787893150.915707:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493390592 00000100:00100000:2.0:1787893150.915739:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1787893150.915745:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c846b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493390592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893150.915779:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c846b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493390592:12345-0@lo:400:kworker.0 Request processed in 34us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893150.915785:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1787893150.915815:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c846b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493390592:0@lo:400:kworker.0 00000100:00100000:0.0:1787893150.915986:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8469c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493390464:0@lo:400:kworker.0 00000100:00100000:0.0:1787893150.916015:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787893150.916051:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787893150.916339:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493390464 00000100:00100000:3.0:1787893150.916344:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493390464 00000100:00100000:3.0:1787893150.916379:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787893150.916386:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493390464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893150.916428:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493390464:12345-0@lo:400:kworker.0 Request processed in 42us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893150.916434:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787893150.916461:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8469c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493390464:0@lo:400:kworker.0 00000100:00100000:2.0:1787893150.916588:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787893150.916595:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493390720:0@lo:400:kworker.0 00000100:00100000:2.0:1787893150.916621:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893150.916647:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493390720 00000100:00100000:2.0:1787893150.916651:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493390720 00000100:00100000:2.0:1787893150.916680:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1787893150.916687:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c846b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493390720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893150.916719:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c846b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493390720:12345-0@lo:400:kworker.0 Request processed in 33us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893150.916725:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00010000:00080000:2.0:1787893150.916752:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7fdce00 x1874741493390720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893150.916774:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493390720:0@lo:400:kworker.0 00000100:00080000:2.0:1787893150.916792:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787893150.919380:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787893150.919399:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493390848:0@lo:400:kworker.0 00000100:00100000:3.0:1787893150.919459:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893150.919537:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493390848 00000100:00100000:3.0:1787893150.919544:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493390848 00000100:00100000:3.0:1787893150.919594:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787893150.919604:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7fdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493390848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893150.919653:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7fdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493390848:12345-0@lo:400:kworker.0 Request processed in 51us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893150.919661:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787893150.919700:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493390848:0@lo:400:kworker.0 00000100:00100000:3.0:1787893150.919733:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493390976:0@lo:400:kworker.0 00000100:00100000:3.0:1787893150.919754:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893150.919777:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493390976 00000100:00100000:3.0:1787893150.919780:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493390976 00000100:00100000:3.0:1787893150.919810:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00080000:2.0:1787893150.919986:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787893150.920032:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8468e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1874741493391104:0@lo:400:kworker.0 00000100:00100000:2.0:1787893150.920063:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893150.920552:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787893150.920558:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c846a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493391232:0@lo:400:kworker.0 00000100:00100000:2.0:1787893150.920584:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893150.920708:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493391104 00000100:00100000:0.0:1787893150.920714:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493391104 00000100:00100000:0.0:1787893150.920760:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493391232 00000100:00100000:0.0:1787893150.920763:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493391232 00000100:00100000:0.0:1787893150.920781:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1787893150.920788:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c846ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1874741493391104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893150.920849:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c846ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1874741493391104:12345-0@lo:400:kworker.0 Request processed in 61us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893150.920993:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1787893150.921009:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1787893150.921014:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8469c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493391232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893150.921045:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8469c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493391232:12345-0@lo:400:kworker.0 Request processed in 31us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893150.921051:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00010000:00080000:0.0:1787893150.921160:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c846a300 x1874741493391232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893150.921182:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c846a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493391232:0@lo:400:kworker.0 00000100:00100000:0.0:1787893150.921263:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8468e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1874741493391104:0@lo:400:kworker.0 00000100:00080000:2.0:1787893150.921347:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787893150.921351:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787893150.921505:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3631:x1874741493390976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893150.921559:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3631:x1874741493390976:12345-0@lo:400:kworker.0 Request processed in 1742us (1803us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893150.921566:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787893150.921640:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493390976:0@lo:400:kworker.0 00000100:00100000:1.0:1787893150.923936:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c846bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874741493390208:0@lo:400:kworker.0 00000100:00100000:1.0:1787893150.923978:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8469500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493390080:0@lo:400:kworker.0 00000001:00080000:3.0:1787893150.926612:0:8413:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:3.0:1787893150.926629:0:8413:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:3.0:1787893150.929450:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893150.929574:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481797504 00000100:00100000:2.0:1787893150.929654:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481797504 00000100:00100000:2.0:1787893150.929792:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 210 00000100:00100000:2.0:1787893150.929805:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+35:12410:x1874741481797504:12345-192.168.202.35@tcp:34:lfs.0 00010000:00010000:2.0:1787893150.929904:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf19e3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.929923:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf19e3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.929935:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf19e3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.929951:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf19ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.929978:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf19ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.929986:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf19ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.930059:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf19f1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.930080:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf19f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.930086:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf19f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787893150.930133:0:13436:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf19f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.930145:0:13436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf19e3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.930153:0:13436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf19e3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.930160:0:13436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf19e3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.930166:0:13436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7f400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893150.930180:0:13436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf19e3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.930351:0:13436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf19e3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.930373:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc9c3918700) 00010000:00010000:2.0:1787893150.930376:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893150.930380:0:13436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf19e3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.930387:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf19e3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.930400:0:13436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf19ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.930407:0:13436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf19ea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.930413:0:13436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf19ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.930418:0:13436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7e000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893150.930421:0:13436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf19ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.930426:0:13436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf19ea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.930433:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc8c6615400) 00010000:00010000:2.0:1787893150.930434:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893150.930437:0:13436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf19ea lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.930442:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf19ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.930467:0:13436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf19f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.930473:0:13436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf19f1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.930477:0:13436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf19f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.930482:0:13436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7e600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893150.930485:0:13436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf19f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.930552:0:13436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf19f1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.930561:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc8c751af00) 00010000:00010000:2.0:1787893150.930564:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893150.930567:0:13436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf19f1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893150.930573:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf19f1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893150.930669:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+35:12410:x1874741481797504:12345-192.168.202.35@tcp:34:lfs.0 Request processed in 866us (1234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893150.930678:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 210 00000100:00100000:1.0:1787893150.994325:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893150.994614:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481797760 00000100:00100000:0.0:1787893150.994628:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481797760 00000100:00100000:0.0:1787893150.994718:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 211 00000100:00100000:0.0:1787893150.994730:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+35:12413:x1874741481797760:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787893150.994758:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893150.994787:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf19f8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62faa2e expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.994914:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf19ff lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.995428:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf19ff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.995446:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf19ff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.995539:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1a06 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.995549:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1a06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.995556:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1a06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.995760:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf1a0d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.995772:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf1a0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.995780:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf1a0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893150.995792:0:6505:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787893150.995907:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf19ff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.995916:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf19ff lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.995924:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf19ff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.996164:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893150.996171:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf19ff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.996192:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf19ff lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.996209:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc9c3918700) 00010000:00010000:0.0:1787893150.996212:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893150.996216:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf19ff lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.996223:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf19ff lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.996238:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1a06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.996244:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1a06 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.996250:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1a06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.996255:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893150.996257:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1a06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.996263:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1a06 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.996270:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc8c751a100) 00010000:00010000:0.0:1787893150.996283:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893150.996286:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1a06 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.996302:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1a06 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.996360:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf19f8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa2e expref: 38 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.996374:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf1a0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa2e expref: 37 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893150.996382:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc8c751af00) 00010000:00010000:0.0:1787893150.996385:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787893150.996387:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb30600, rc 0) 00000100:00100000:0.0:1787893150.996485:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+37:12413:x1874741481797760:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 1756us (2173us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1787893150.996543:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 211 00000100:00100000:3.0:1787893151.002476:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893151.002881:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481797888 00000100:00100000:0.0:1787893151.002895:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481797888 00000100:00100000:0.0:1787893151.003146:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 212 00000100:00100000:0.0:1787893151.003159:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+37:12413:x1874741481797888:12345-192.168.202.35@tcp:54:lfs.0 00010000:00010000:0.0:1787893151.003250:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1a1b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.003271:0:10086:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf19b2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa12 expref: 37 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.003294:0:10086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1a1b lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.003356:0:10086:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf19b2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa12 expref: 37 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.003374:0:10086:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf19b2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa12 expref: 37 pid: 10086 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893151.003393:0:10086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10086:1874741493391360:192.168.202.35@tcp:104: 00000100:00100000:0.0:1787893151.003552:0:10086:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c4d87000 going to sleep for 11 seconds 00000100:00100000:3.0:1787893151.007448:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893151.007618:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481798144 00000100:00100000:1.0:1787893151.007633:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481798144 00000100:00100000:1.0:1787893151.007709:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 52 00000100:00100000:1.0:1787893151.007722:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+38:6162:x1874741481798144:12345-192.168.202.35@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787893151.007856:0:10086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10086:1874741493391360:192.168.202.35@tcp:104: 00010000:00010000:0.0:1787893151.007892:0:10086:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1a1b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787893151.008256:0:6507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967479 00000100:00100000:1.0:1787893151.008390:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+40:6162:x1874741481798144:12345-192.168.202.35@tcp:35:ldlm_bl.0 Request processed in 669us (954us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1787893151.008400:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 52 00000020:00080000:1.0:1787893151.008408:0:6507:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787893151.013762:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893151.013881:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481798272 00000100:00100000:3.0:1787893151.013895:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481798272 00010000:00010000:3.0:1787893151.013960:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf19b2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa12 expref: 40 pid: 10086 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893151.014008:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 94 00000100:00100000:3.0:1787893151.014044:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58232959-285a-4954-a3ac-571a2b817017+40:2391:x1874741481798272:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893151.014064:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893151.014074:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf19b2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa12 expref: 40 pid: 10086 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.014091:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf19b2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa12 expref: 40 pid: 10086 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.014120:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf19b2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa12 expref: 40 pid: 10086 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.014143:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc8c751af00) 00010000:00010000:3.0:1787893151.014150:0:6491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1a1b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.014162:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1a1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.014171:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1a1b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.014206:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787893151.014249:0:10086:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1a1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.014267:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1a1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893151.014287:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58232959-285a-4954-a3ac-571a2b817017+39:2391:x1874741481798272:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 246us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893151.014298:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 94 00010000:00010000:0.0:1787893151.014322:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1a1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.014331:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1a1b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.014338:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1a1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.014344:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893151.014349:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1a1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.014375:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1a1b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.014393:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc8c751af00) 00010000:00010000:0.0:1787893151.014396:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787893151.014401:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1a1b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.014407:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1a1b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893151.014547:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+38:12413:x1874741481797888:12345-192.168.202.35@tcp:54:lfs.0 Request processed in 11336us (12033us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893151.014556:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 212 00000100:00100000:3.0:1787893151.019770:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893151.019872:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481798528 00000100:00100000:2.0:1787893151.019889:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481798528 00000100:00100000:2.0:1787893151.019970:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 53 00000100:00100000:2.0:1787893151.019997:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+38:12413:x1874741481798528:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:2.0:1787893151.020244:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+39:12413:x1874741481798528:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 248us (486us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1787893151.020253:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 53 00000100:00100000:1.0:1787893151.114453:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893151.114798:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481798784 00000100:00100000:0.0:1787893151.114814:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481798784 00000100:00100000:0.0:1787893151.114941:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 213 00000100:00100000:0.0:1787893151.114955:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+39:12424:x1874741481798784:12345-192.168.202.35@tcp:101:cat.0 00010000:00010000:0.0:1787893151.114989:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893151.115019:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1a22 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62faa35 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.115119:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1a29 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.115138:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1a29 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.115151:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1a29 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.115190:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf1a30 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.115198:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf1a30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.115205:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf1a30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.115579:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf1a37 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.115591:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf1a37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.115599:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf1a37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893151.115612:0:6506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:0.0:1787893151.115719:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1a29 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.115726:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1a29 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.115733:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1a29 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.115740:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893151.115745:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1a29 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.115766:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1a29 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.115781:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc9c3918700) 00010000:00010000:0.0:1787893151.115785:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893151.115790:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1a29 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.115797:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf1a29 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.115813:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf1a30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.115828:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf1a30 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.115834:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf1a30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.115839:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893151.115843:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf1a30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.115848:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf1a30 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.115855:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc8c751a100) 00010000:00010000:0.0:1787893151.115858:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893151.115860:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf1a30 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.115876:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf1a30 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.116047:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30000/0x9232577658cf1a22 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa35 expref: 42 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.116064:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf1a37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa35 expref: 41 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.116072:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc8c751af00) 00010000:00010000:0.0:1787893151.116074:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787893151.116077:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9dd69da00, rc 0) 00000100:00100000:0.0:1787893151.116171:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+41:12424:x1874741481798784:12345-192.168.202.35@tcp:101:cat.0 Request processed in 1218us (1734us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1787893151.116179:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 213 00000100:00100000:1.0:1787893151.121159:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893151.121266:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481799040 00000100:00100000:3.0:1787893151.121291:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481799040 00000100:00100000:3.0:1787893151.121368:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 54 00000100:00100000:3.0:1787893151.121402:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+41:12424:x1874741481799040:12345-192.168.202.35@tcp:35:cat.0 00000100:00100000:3.0:1787893151.121855:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+42:12424:x1874741481799040:12345-192.168.202.35@tcp:35:cat.0 Request processed in 454us (710us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1787893151.121865:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 54 00000100:00100000:3.0:1787893151.144354:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893151.144551:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481799296 00000100:00100000:2.0:1787893151.144565:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481799296 00000100:00100000:2.0:1787893151.144633:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 214 00000100:00100000:2.0:1787893151.144661:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c69c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+42:12425:x1874741481799296:12345-192.168.202.35@tcp:36:rm.0 00010000:00010000:2.0:1787893151.144741:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1787893151.144781:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf19d5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa20 expref: 42 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.144809:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf1a37 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa35 expref: 41 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.144838:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf1a0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa2e expref: 40 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.144852:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf19c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa19 expref: 39 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.144864:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc8c751af00) 00010000:00010000:2.0:1787893151.144870:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787893151.144900:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf1a45 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.144916:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf1a45 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.144954:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf1a45 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.144974:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf1a4c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.144982:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf1a4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.144990:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf1a4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.145095:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf1a53 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.145105:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf1a53 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.145112:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf1a53 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787893151.145540:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1787893151.145552:0:6504:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 394967059991ns, next at 395967056743ns, rc = 0 00010000:00010000:2.0:1787893151.145608:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf1a5a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.145620:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf1a5a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.145628:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf1a5a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.145779:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf1a5a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.145788:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf1a5a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.145795:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf1a5a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.145875:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787893151.145902:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf1a53 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.145909:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf1a53 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.145917:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf1a53 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.145923:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7f400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893151.145929:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf1a53 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.145938:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf1a53 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.145949:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc8c751af00) 00010000:00010000:2.0:1787893151.145952:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787893151.145957:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf1a53 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.145974:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf1a53 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.145997:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf1a45 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.146003:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf1a45 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.146009:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf1a45 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.146015:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7e600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893151.146018:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf1a45 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.146024:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf1a45 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.146033:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc9c3918700) 00010000:00010000:2.0:1787893151.146036:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893151.146039:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf1a45 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.146045:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf1a45 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787893151.146056:0:6504:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000103cec61 reply state 00000000421683d9 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf1a4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.146069:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf1a4c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.146082:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc8c6615400) 00010000:00010000:2.0:1787893151.146085:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787893151.146088:0:6504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787893151.146230:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c69c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+40:12425:x1874741481799296:12345-192.168.202.35@tcp:36:rm.0 Request processed in 1570us (1887us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1787893151.146240:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 214 00010000:00010000:1.0:1787893151.150591:0:8435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893151.150610:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf1a5a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893151.150624:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7e800 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:1.0:1787893151.150629:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf1a5a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893151.151742:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf1a5a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893151.151777:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc8c751af00) 00010000:00010000:1.0:1787893151.151781:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787893151.151787:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf1a5a lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893151.151828:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf1a5a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893151.151849:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893151.151851:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893151.151853:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893151.195906:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893151.196416:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481799552 00000100:00100000:2.0:1787893151.196432:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481799552 00000100:00100000:2.0:1787893151.196567:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 215 00000100:00100000:2.0:1787893151.196581:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+40:12430:x1874741481799552:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:2.0:1787893151.196616:0:9515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893151.196828:0:9515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf1a61 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62faa3c expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.196981:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf1a68 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.197000:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf1a68 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.197017:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf1a68 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.197029:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fe00/0x9232577658cf1a6f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.197037:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fe00/0x9232577658cf1a6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.197067:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fe00/0x9232577658cf1a6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787893151.198178:0:9515:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:2.0:1787893151.198456:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1a76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.199008:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1a76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.199025:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1a76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.199081:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf1a68 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.199090:0:9515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf1a68 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.199098:0:9515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf1a68 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.199105:0:9515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7f400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893151.199110:0:9515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf1a68 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.199118:0:9515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf1a68 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.199133:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc9c3918700) 00010000:00010000:2.0:1787893151.199136:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893151.199160:0:9515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf1a68 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.199168:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf1a68 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787893151.199186:0:9515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000045f48ddb reply state 0000000069811379 transno 4294967485 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fe00/0x9232577658cf1a6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.199201:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fe00/0x9232577658cf1a6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.199207:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc8c6615400) 00010000:00010000:2.0:1787893151.199210:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787893151.199214:0:9515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787893151.199262:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf1a61 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa3c expref: 43 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.201784:0:9515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1a76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa3c expref: 42 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.201806:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc8c6615a00) 00010000:00010000:2.0:1787893151.201809:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787893151.201813:0:9515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7ee00, rc 0) 00000100:00100000:2.0:1787893151.202124:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+43:12430:x1874741481799552:12345-192.168.202.35@tcp:101:bash.0 Request processed in 5544us (6231us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1787893151.202136:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 215 00000100:00100000:0.0:1787893151.206863:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893151.207031:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481799680 00000100:00100000:3.0:1787893151.207046:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481799680 00000100:00100000:3.0:1787893151.207179:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 67 00000100:00100000:3.0:1787893151.207191:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58232959-285a-4954-a3ac-571a2b817017+5:2392:x1874741481799680:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:3.0:1787893151.207216:0:8535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893151.207244:0:8535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007029ea2a/0x9232577658cf1a84 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62faa43 expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787893151.207291:0:8535:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787893151.207320:0:8535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1787893151.207326:0:8535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893151.207339:0:8535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007029ea2a/0x9232577658cf1a84 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa43 expref: 6 pid: 8535 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.207363:0:8535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007029ea2a/0x9232577658cf1a84 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa43 expref: 6 pid: 8535 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.207379:0:8535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c84f7600, rc 0) 00000100:00100000:3.0:1787893151.207461:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58232959-285a-4954-a3ac-571a2b817017+6:2392:x1874741481799680:12345-192.168.202.35@tcp:101:bash.0 Request processed in 272us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893151.207468:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 67 00000100:00080000:2.0:1787893151.210914:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787893151.211179:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893151.211260:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481799808 00000100:00100000:2.0:1787893151.211337:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481799808 00000100:00100000:2.0:1787893151.211447:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 68 00000100:00100000:2.0:1787893151.211486:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+6:12430:x1874741481799808:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:2.0:1787893151.211557:0:8420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893151.211581:0:8420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000639c4e2/0x9232577658cf1a8b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62faa4a expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.211621:0:8420:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007029ea2a/0x9232577658cf1a84 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa43 expref: 7 pid: 8535 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.211632:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893151.211637:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893151.211643:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000639c4e2/0x9232577658cf1a8b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa4a expref: 7 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.211686:0:8420:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007029ea2a/0x9232577658cf1a84 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa43 expref: 7 pid: 8535 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.211702:0:8420:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007029ea2a/0x9232577658cf1a84 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa43 expref: 7 pid: 8535 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893151.211720:0:8420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8469f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8420:1874741493391488:192.168.202.35@tcp:104: 00000100:00100000:2.0:1787893151.211862:0:8420:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9eee58240 going to sleep for 11 seconds 00000100:00100000:1.0:1787893151.215313:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893151.215421:0:10383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481799936 00000100:00100000:3.0:1787893151.215434:0:10383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481799936 00010000:00010000:3.0:1787893151.215536:0:10383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007029ea2a/0x9232577658cf1a84 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa43 expref: 8 pid: 8535 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893151.215582:0:10383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 95 00000100:00100000:3.0:1787893151.215594:0:10383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3efe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58232959-285a-4954-a3ac-571a2b817017+8:2391:x1874741481799936:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893151.215613:0:10383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893151.215652:0:10383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007029ea2a/0x9232577658cf1a84 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa43 expref: 8 pid: 8535 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.215669:0:10383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007029ea2a/0x9232577658cf1a84 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa43 expref: 8 pid: 8535 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.215705:0:10383:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893151.215712:0:10383:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893151.215722:0:10383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000639c4e2/0x9232577658cf1a8b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa4a expref: 8 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.215734:0:10383:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000639c4e2/0x9232577658cf1a8b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa4a expref: 8 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.215787:0:10383:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000639c4e2/0x9232577658cf1a8b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa4a expref: 8 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893151.215805:0:10383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8506680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10383:1874741493391616:192.168.202.35@tcp:105: 00000100:00100000:3.0:1787893151.215963:0:10383:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c3ed2900 going to sleep for 11 seconds 00010000:00010000:2.0:1787893151.216961:0:8420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007029ea2a/0x9232577658cf1a84 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa43 expref: 8 pid: 8535 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893151.216986:0:8420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8469f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8420:1874741493391488:192.168.202.35@tcp:104: 00010000:00010000:2.0:1787893151.217034:0:8420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000639c4e2/0x9232577658cf1a8b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa4a expref: 7 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.217049:0:8420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7e600, rc 0) 00000100:00100000:2.0:1787893151.217154:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+7:12430:x1874741481799808:12345-192.168.202.35@tcp:101:bash.0 Request processed in 5679us (5982us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893151.217164:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 68 00000100:00100000:3.0:1787893151.221094:0:10383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8506680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10383:1874741493391616:192.168.202.35@tcp:105: 00010000:00010000:3.0:1787893151.221135:0:10383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893151.221209:0:10383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3efe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58232959-285a-4954-a3ac-571a2b817017+6:2391:x1874741481799936:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 5615us (5912us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893151.221224:0:10383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 95 00000100:00100000:0.0:1787893151.225071:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893151.225223:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481800192 00000100:00100000:3.0:1787893151.225237:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481800192 00000100:00100000:3.0:1787893151.225321:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 55 00000100:00100000:3.0:1787893151.225335:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+43:12430:x1874741481800192:12345-192.168.202.35@tcp:35:bash.0 00000100:00100000:3.0:1787893151.225793:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+44:12430:x1874741481800192:12345-192.168.202.35@tcp:35:bash.0 Request processed in 460us (734us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1787893151.225802:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 55 00000100:00100000:1.0:1787893151.399615:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893151.399736:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481800320 00000100:00100000:2.0:1787893151.399751:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481800320 00000100:00100000:2.0:1787893151.399855:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 216 00000100:00100000:2.0:1787893151.399868:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+44:12447:x1874741481800320:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:2.0:1787893151.399898:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893151.399934:0:13436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf1a92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62faa51 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.400023:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf1a99 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.400040:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf1a99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.400055:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf1a99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893151.400110:0:13436:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1787893151.400115:0:13436:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787893151.400140:0:13436:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf1a99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.400197:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf1a92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa51 expref: 46 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.400220:0:13436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf1a99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa51 expref: 45 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.400230:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc9c3918700) 00010000:00010000:2.0:1787893151.400233:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787893151.400238:0:13436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7e200, rc 0) 00000100:00100000:2.0:1787893151.400328:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+45:12447:x1874741481800320:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 462us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893151.400336:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 216 00000100:00100000:1.0:1787893151.405224:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893151.405540:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481800576 00000100:00100000:0.0:1787893151.405556:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481800576 00000100:00100000:0.0:1787893151.405657:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 217 00000100:00100000:0.0:1787893151.405674:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+45:12447:x1874741481800576:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787893151.405709:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893151.405740:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69de00/0x9232577658cf1aa0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62faa58 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.405909:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69d800/0x9232577658cf1aa7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.405953:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69d800/0x9232577658cf1aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.405968:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69d800/0x9232577658cf1aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893151.405982:0:6505:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787893151.406129:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69de00/0x9232577658cf1aa0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa58 expref: 48 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.406156:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69d800/0x9232577658cf1aa7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa58 expref: 47 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.406166:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc8c6615a00) 00010000:00010000:0.0:1787893151.406169:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787893151.406173:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9dd69d800, rc 0) 00000100:00100000:0.0:1787893151.406262:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+47:12447:x1874741481800576:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 592us (1056us total) trans 4294967487 rc 0/0 00000100:00100000:0.0:1787893151.406279:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 217 00010000:00010000:1.0:1787893151.410763:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893151.412480:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893151.412630:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481800832 00000100:00100000:0.0:1787893151.412653:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481800832 00000100:00100000:0.0:1787893151.412723:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 218 00000100:00100000:0.0:1787893151.412735:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+47:12447:x1874741481800832:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787893151.412770:0:10086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893151.412798:0:10086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69de00/0x9232577658cf1ab5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62faa5f expref: -99 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.412979:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c800/0x9232577658cf1abc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.412997:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c800/0x9232577658cf1abc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.413011:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c800/0x9232577658cf1abc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893151.413026:0:10086:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787893151.413160:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69de00/0x9232577658cf1ab5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa5f expref: 50 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.413182:0:10086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c800/0x9232577658cf1abc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa5f expref: 49 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.413192:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc8c6615a00) 00010000:00010000:0.0:1787893151.413195:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787893151.413199:0:10086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9dd69c800, rc 0) 00000100:00100000:0.0:1787893151.413286:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+49:12447:x1874741481800832:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 553us (828us total) trans 4294967488 rc 0/0 00000100:00100000:0.0:1787893151.413295:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 218 00000100:00100000:1.0:1787893151.416733:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893151.416842:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481800960 00000100:00100000:0.0:1787893151.416856:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481800960 00000100:00100000:0.0:1787893151.416948:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 16 00000100:00100000:0.0:1787893151.416960:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+49:2391:x1874741481800960:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893151.416978:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893151.417030:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69d800/0x9232577658cf1aa7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa58 expref: 49 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.417057:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc8c6615a00) 00010000:00010000:0.0:1787893151.417063:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893151.417135:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+48:2391:x1874741481800960:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 177us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893151.417144:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 16 00000100:00100000:1.0:1787893151.425913:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893151.426212:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481801088 00000100:00100000:0.0:1787893151.426226:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481801088 00000100:00100000:0.0:1787893151.426307:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 69 00000100:00100000:0.0:1787893151.426320:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58232959-285a-4954-a3ac-571a2b817017+6:2390:x1874741481801088:12345-192.168.202.35@tcp:1:lfs.0 00010000:00010000:0.0:1787893151.426381:0:8419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002170d5bd/0x9232577658cf1aca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.426411:0:8419:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000639c4e2/0x9232577658cf1a8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa4a expref: 6 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.426423:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787893151.426429:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787893151.426434:0:8419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002170d5bd/0x9232577658cf1aca lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.426483:0:8419:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000639c4e2/0x9232577658cf1a8b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa4a expref: 6 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.426520:0:8419:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000639c4e2/0x9232577658cf1a8b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa4a expref: 6 pid: 8420 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893151.426558:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8419:1874741493391744:192.168.202.35@tcp:104: 00000100:00100000:0.0:1787893151.426692:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c4d87300 going to sleep for 11 seconds 00000100:00100000:0.0:1787893151.429546:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8419:1874741493391744:192.168.202.35@tcp:104: 00010000:00010000:0.0:1787893151.429589:0:8419:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002170d5bd/0x9232577658cf1aca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893151.430846:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893151.430955:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481801216 00000100:00100000:2.0:1787893151.430965:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481801216 00002000:00100000:2.0:1787893151.431035:0:8424:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9fc8c7cd6680 x1874741481801216/t0(0) o4->58232959-285a-4954-a3ac-571a2b817017@192.168.202.35@tcp:312/0 lens 504/0 e 0 to 0 dl 1787893162 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787893151.431048:0:8424:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc8c7cd6680 with x1874741481801216 ext(0->8) 00010000:00010000:2.0:1787893151.431058:0:8424:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000639c4e2/0x9232577658cf1a8b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa4a expref: 7 pid: 8420 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.431077:0:8424:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000639c4e2/0x9232577658cf1a8b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa4a expref: 7 pid: 8420 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787893151.431085:0:8424:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9fc8c7cd6680 00000100:00100000:2.0:1787893151.431126:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 3 00000100:00100000:2.0:1787893151.431138:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:58232959-285a-4954-a3ac-571a2b817017+7:2390:x1874741481801216:12345-192.168.202.35@tcp:4:lfs.0 00000100:00100000:2.0:1787893151.432981:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:58232959-285a-4954-a3ac-571a2b817017+9:2390:x1874741481801216:12345-192.168.202.35@tcp:4:lfs.0 Request processed in 1831us (2131us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787893151.432997:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 3 00002000:00100000:2.0:1787893151.433011:0:8424:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9fc8c7cd6680 x1874741481801216/t4294967309(0) o4->58232959-285a-4954-a3ac-571a2b817017@192.168.202.35@tcp:312/0 lens 504/448 e 0 to 0 dl 1787893162 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787893151.433022:0:8424:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc8c7cd6680 with x1874741481801216 ext(0->8) 00010000:00010000:2.0:1787893151.433033:0:8424:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000639c4e2/0x9232577658cf1a8b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa4a expref: 9 pid: 8420 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.433056:0:8424:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000639c4e2/0x9232577658cf1a8b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa4a expref: 9 pid: 8420 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787893151.433064:0:8424:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9fc8c7cd6680 00000100:00100000:1.0:1787893151.437350:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893151.437459:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481801344 00000100:00100000:0.0:1787893151.437579:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481801344 00010000:00010000:0.0:1787893151.437637:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000639c4e2/0x9232577658cf1a8b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa4a expref: 9 pid: 8420 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893151.437843:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 96 00000100:00100000:0.0:1787893151.437857:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58232959-285a-4954-a3ac-571a2b817017+9:2391:x1874741481801344:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893151.437877:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787893151.437902:0:6492:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787893151.437905:0:6492:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787893151 00002000:00010000:0.0:1787893151.437908:0:6492:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787893151 00002000:00010000:0.0:1787893151.437911:0:6492:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1787893151 00002000:00010000:0.0:1787893151.437914:0:6492:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1787893151.437921:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000639c4e2/0x9232577658cf1a8b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa4a expref: 9 pid: 8420 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.438011:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000639c4e2/0x9232577658cf1a8b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa4a expref: 9 pid: 8420 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.438064:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000639c4e2/0x9232577658cf1a8b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa4a expref: 9 pid: 8420 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.438084:0:6492:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787893151.438089:0:6492:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787893151.438097:0:6492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002170d5bd/0x9232577658cf1aca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.438108:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002170d5bd/0x9232577658cf1aca lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.438153:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893151.438228:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58232959-285a-4954-a3ac-571a2b817017+8:2391:x1874741481801344:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 373us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893151.438236:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 96 00010000:00010000:1.0:1787893151.438308:0:8419:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002170d5bd/0x9232577658cf1aca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893151.438320:0:8419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002170d5bd/0x9232577658cf1aca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893151.438343:0:8419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002170d5bd/0x9232577658cf1aca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893151.438352:0:8419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002170d5bd/0x9232577658cf1aca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893151.438374:0:8419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002170d5bd/0x9232577658cf1aca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893151.438383:0:8419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd69d800 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:1.0:1787893151.438389:0:8419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002170d5bd/0x9232577658cf1aca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893151.438400:0:8419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002170d5bd/0x9232577658cf1aca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893151.438415:0:8419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002170d5bd/0x9232577658cf1aca lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893151.438423:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002170d5bd/0x9232577658cf1aca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893151.438525:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58232959-285a-4954-a3ac-571a2b817017+7:2390:x1874741481801088:12345-192.168.202.35@tcp:1:lfs.0 Request processed in 12174us (12595us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893151.438535:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 69 00000100:00100000:1.0:1787893151.441552:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893151.441683:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481801600 00000100:00100000:3.0:1787893151.441697:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481801600 00000100:00100000:3.0:1787893151.441803:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 56 00000100:00100000:3.0:1787893151.441824:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fec450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+48:12447:x1874741481801600:12345-192.168.202.35@tcp:35:lfs.0 00000004:00010000:3.0:1787893151.441904:0:6507:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c800/0x9232577658cf1abc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa5f expref: 48 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787893151.442168:0:6507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1787893151.442208:0:6507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:3.0:1787893151.442652:0:6507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00010000:00010000:3.0:1787893151.442697:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6000/0x9232577658cf1ad1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.442716:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1a76 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa3c expref: 52 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.442744:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6000/0x9232577658cf1ad1 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.442790:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1a76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa3c expref: 52 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.442806:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1a76 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa3c expref: 52 pid: 9515 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893151.442838:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8506680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6507:1874741493391872:192.168.202.35@tcp:104: 00000100:00100000:3.0:1787893151.442949:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d7e300 going to sleep for 11 seconds 00000100:00100000:1.0:1787893151.446775:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893151.446862:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481801728 00000100:00100000:0.0:1787893151.446875:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481801728 00010000:00010000:0.0:1787893151.446940:0:6490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1a76 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa3c expref: 53 pid: 9515 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893151.446991:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 97 00000100:00100000:0.0:1787893151.447003:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+53:2391:x1874741481801728:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893151.447021:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893151.447029:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1a76 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa3c expref: 53 pid: 9515 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.447066:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1a76 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa3c expref: 53 pid: 9515 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.447095:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc8c6615a00) 00010000:00010000:0.0:1787893151.447101:0:6490:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6000/0x9232577658cf1ad1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.447114:0:6490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6000/0x9232577658cf1ad1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.447122:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6000/0x9232577658cf1ad1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.447147:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893151.447212:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+53:2391:x1874741481801728:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 212us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893151.447221:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 97 00010000:00010000:3.0:1787893151.448618:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1a76 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa3c expref: 52 pid: 9515 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893151.448751:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8506680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6507:1874741493391872:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787893151.448787:0:6507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6000/0x9232577658cf1ad1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.448899:0:6507:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6000/0x9232577658cf1ad1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.448908:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6000/0x9232577658cf1ad1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787893151.449133:0:6507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000001:00080000:2.0:1787893151.449277:0:6507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:2.0:1787893151.449392:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8469f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6507:1874741493392000:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787893151.450133:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893151.450225:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9eee58540 going to sleep for 11 seconds 00000100:00100000:0.0:1787893151.450280:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493392000 00000100:00100000:0.0:1787893151.450289:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493392000 00000100:00100000:0.0:1787893151.450748:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787893151.450760:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6507:x1874741493392000:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787893151.450962:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6507:x1874741493392000:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 204us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893151.450971:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787893151.451134:0:6507:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:2.0:1787893151.451141:0:6507:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:2.0:1787893151.451191:0:6507:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fc8c7d49880, transno 4294967308 00000100:00100000:2.0:1787893151.451225:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8469f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6507:1874741493392000:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787893151.451400:0:6507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00000100:00100000:2.0:1787893151.451575:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8469f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6507:1874741493392128:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787893151.451622:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893151.451910:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9eee58780 going to sleep for 11 seconds 00000100:00100000:0.0:1787893151.452030:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493392128 00000100:00100000:0.0:1787893151.452037:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493392128 00000100:00100000:0.0:1787893151.452116:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787893151.452127:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c846a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6507:x1874741493392128:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787893151.452287:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c846a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6507:x1874741493392128:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 162us (665us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787893151.452295:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787893151.452359:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8469f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6507:1874741493392128:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787893151.452416:0:6507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:2.0:1787893151.452457:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6000/0x9232577658cf1ad1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.452468:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6000/0x9232577658cf1ad1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.452488:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6000/0x9232577658cf1ad1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.452513:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c84f6000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893151.452519:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6000/0x9232577658cf1ad1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.452527:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6000/0x9232577658cf1ad1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.452548:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc8c6615a00) 00010000:00010000:2.0:1787893151.452551:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787893151.452557:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6000/0x9232577658cf1ad1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.452563:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6000/0x9232577658cf1ad1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787893151.452704:0:6507:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787893151.452770:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1787893151.452784:0:6507:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 395274292229ns, next at 396274289706ns, rc = 0 00000001:00080000:2.0:1787893151.452791:0:6507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967496 00010000:00010000:2.0:1787893151.452826:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc8c6615a00) 00010000:00010000:2.0:1787893151.452829:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787893151.452837:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c800/0x9232577658cf1abc lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa5f expref: 56 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893151.452976:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fec450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+55:12447:x1874741481801600:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 11162us (11437us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1787893151.452984:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 56 00000020:00080000:2.0:1787893151.452988:0:6507:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787893151.457201:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893151.457434:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481801856 00000100:00100000:2.0:1787893151.457448:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481801856 00000100:00100000:2.0:1787893151.457662:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 219 00000100:00100000:2.0:1787893151.457676:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+55:12447:x1874741481801856:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:2.0:1787893151.457708:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893151.457738:0:13436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf1ad8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62faa66 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.457826:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf1ad8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa66 expref: 56 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.457844:0:13436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf1ad8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa66 expref: 56 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.457895:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc8c6615800) 00010000:00010000:2.0:1787893151.457898:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787893151.457903:0:13436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7ea00, rc 0) 00000100:00100000:2.0:1787893151.458151:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+56:12447:x1874741481801856:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 477us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893151.458159:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 219 00000100:00100000:0.0:1787893151.463748:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893151.464879:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481802112 00000100:00100000:2.0:1787893151.464896:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481802112 00000100:00100000:1.0:1787893151.466331:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 57 00000100:00100000:1.0:1787893151.466361:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+56:12447:x1874741481802112:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:1.0:1787893151.468750:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+57:12447:x1874741481802112:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 2387us (4999us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1787893151.468768:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 57 00000100:00100000:1.0:1787893151.531307:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893151.531463:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481802240 00000100:00100000:0.0:1787893151.531477:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481802240 00000100:00100000:0.0:1787893151.531604:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 220 00000100:00100000:0.0:1787893151.531616:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+57:12457:x1874741481802240:12345-192.168.202.35@tcp:34:lfs.0 00010000:00010000:0.0:1787893151.531733:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf1adf lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.531754:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf1adf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.531768:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf1adf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.531781:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c600/0x9232577658cf1ae6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.531789:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c600/0x9232577658cf1ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.531796:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c600/0x9232577658cf1ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.531900:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf1aed lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.531908:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf1aed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.531934:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf1aed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787893151.531996:0:6505:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf1aed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.532011:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf1adf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.532019:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf1adf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.532027:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf1adf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.532034:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd69ce00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893151.532039:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf1adf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.532047:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf1adf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.532061:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc9c3918700) 00010000:00010000:0.0:1787893151.532065:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893151.532069:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf1adf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.532077:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf1adf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.532094:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c600/0x9232577658cf1ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.532106:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c600/0x9232577658cf1ae6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.532112:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c600/0x9232577658cf1ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.532117:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd69c600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893151.532120:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c600/0x9232577658cf1ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.532126:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c600/0x9232577658cf1ae6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.532133:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc8c6615400) 00010000:00010000:0.0:1787893151.532135:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893151.532138:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c600/0x9232577658cf1ae6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.532145:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c600/0x9232577658cf1ae6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.532154:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf1aed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.532160:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf1aed lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.532166:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf1aed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.532171:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd69da00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893151.532179:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf1aed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.532186:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf1aed lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.532193:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc8c6615800) 00010000:00010000:0.0:1787893151.532195:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893151.532198:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf1aed lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.532204:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf1aed lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893151.532770:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+57:12457:x1874741481802240:12345-192.168.202.35@tcp:34:lfs.0 Request processed in 1149us (1471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893151.532780:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 220 00000100:00100000:2.0:1787893151.595398:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893151.596217:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481802496 00000100:00100000:0.0:1787893151.596234:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481802496 00000100:00100000:0.0:1787893151.596434:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 221 00000100:00100000:0.0:1787893151.596448:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c846b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+57:12460:x1874741481802496:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787893151.596479:0:10086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893151.596527:0:10086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf1af4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62faa6d expref: -99 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.596633:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c600/0x9232577658cf1afb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.596667:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c600/0x9232577658cf1afb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.596702:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c600/0x9232577658cf1afb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.596716:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf1b02 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.596724:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf1b02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.596731:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf1b02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.596892:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c800/0x9232577658cf1b09 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.596901:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c800/0x9232577658cf1b09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.596908:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c800/0x9232577658cf1b09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893151.596920:0:10086:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787893151.597031:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c600/0x9232577658cf1afb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.597039:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c600/0x9232577658cf1afb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.597046:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c600/0x9232577658cf1afb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.597052:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd69c600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893151.597064:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c600/0x9232577658cf1afb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.597072:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c600/0x9232577658cf1afb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.597088:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc9c3918700) 00010000:00010000:0.0:1787893151.597091:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893151.597095:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c600/0x9232577658cf1afb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.597102:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c600/0x9232577658cf1afb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.597124:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf1b02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.597131:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf1b02 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.597136:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf1b02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.597142:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd69ce00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893151.597144:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf1b02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.597150:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf1b02 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.597157:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc8c6615400) 00010000:00010000:0.0:1787893151.597160:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893151.597169:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf1b02 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.597175:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf1b02 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.597222:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf1af4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa6d expref: 60 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.597240:0:10086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c800/0x9232577658cf1b09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa6d expref: 59 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.597250:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc8c6615800) 00010000:00010000:0.0:1787893151.597253:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787893151.597255:0:10086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9dd69c800, rc 0) 00000100:00100000:0.0:1787893151.597356:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c846b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+59:12460:x1874741481802496:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 912us (1973us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1787893151.597365:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 221 00000100:00100000:1.0:1787893151.601306:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893151.602033:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481802624 00000100:00100000:2.0:1787893151.602046:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481802624 00000100:00100000:2.0:1787893151.602150:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 222 00000100:00100000:2.0:1787893151.602162:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+59:12460:x1874741481802624:12345-192.168.202.35@tcp:54:lfs.0 00010000:00010000:2.0:1787893151.602246:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f200/0x9232577658cf1b17 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.602265:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f200/0x9232577658cf1b17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.602288:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f200/0x9232577658cf1b17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.602334:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f200/0x9232577658cf1b17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.602341:0:9515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f200/0x9232577658cf1b17 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.602348:0:9515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f200/0x9232577658cf1b17 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.602372:0:9515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7f200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893151.602377:0:9515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f200/0x9232577658cf1b17 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.602386:0:9515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f200/0x9232577658cf1b17 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.602400:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc8c6615800) 00010000:00010000:2.0:1787893151.602404:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787893151.602629:0:9515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f200/0x9232577658cf1b17 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.602715:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f200/0x9232577658cf1b17 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893151.602820:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+59:12460:x1874741481802624:12345-192.168.202.35@tcp:54:lfs.0 Request processed in 648us (1519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893151.602829:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 222 00000100:00100000:3.0:1787893151.609031:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893151.609124:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481802880 00000100:00100000:3.0:1787893151.609137:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481802880 00000100:00100000:3.0:1787893151.609214:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 58 00000100:00100000:3.0:1787893151.609225:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+59:12460:x1874741481802880:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:3.0:1787893151.609600:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+60:12460:x1874741481802880:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 375us (582us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1787893151.609630:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 58 00000100:00100000:2.0:1787893151.716396:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893151.716769:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481803136 00000100:00100000:0.0:1787893151.716857:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481803136 00000100:00100000:1.0:1787893151.717126:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 223 00000100:00100000:1.0:1787893151.717140:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+60:12470:x1874741481803136:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:1.0:1787893151.717174:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893151.717179:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787893151.717218:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf1a99 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa51 expref: 60 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893151.717245:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc9c3918700) 00010000:00010000:1.0:1787893151.717251:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787893151.717278:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf1b1e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62faa74 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893151.717426:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf1b25 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893151.717442:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf1b25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893151.717454:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf1b25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893151.717467:0:6504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787893151.717710:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541a00/0x9232577658cf1b1e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa74 expref: 62 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893151.717747:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf1b25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa74 expref: 61 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893151.717755:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc8c6615800) 00010000:00010000:1.0:1787893151.717758:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787893151.717761:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe540c00, rc 0) 00000100:00100000:1.0:1787893151.717915:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+61:12470:x1874741481803136:12345-192.168.202.35@tcp:101:bash.0 Request processed in 776us (1534us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1787893151.717988:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 223 00000100:00100000:1.0:1787893151.723441:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893151.723591:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893151.723757:0:10383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481803392 00000100:00100000:0.0:1787893151.723771:0:10383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481803392 00000100:00100000:0.0:1787893151.723875:0:10383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 17 00000100:00100000:0.0:1787893151.723888:0:10383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58232959-285a-4954-a3ac-571a2b817017+61:2391:x1874741481803392:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893151.723907:0:10383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893151.724100:0:10383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf1b25 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa74 expref: 61 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.724126:0:10383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc8c6615800) 00010000:00010000:0.0:1787893151.724149:0:10383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893151.724226:0:10383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58232959-285a-4954-a3ac-571a2b817017+60:2391:x1874741481803392:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 341us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893151.724235:0:10383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 17 00000100:00100000:2.0:1787893151.725915:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481803264 00000100:00100000:2.0:1787893151.725987:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481803264 00000100:00100000:2.0:1787893151.726105:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 224 00000100:00100000:2.0:1787893151.726117:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+60:12470:x1874741481803264:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:2.0:1787893151.726148:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893151.726173:0:13436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf1b33 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62faa7b expref: -99 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.726218:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf1b3a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.726251:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf1b3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.726274:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf1b3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.726418:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf1b33 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa7b expref: 62 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.726439:0:13436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf1b3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa7b expref: 61 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.726448:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc8c6615800) 00010000:00010000:2.0:1787893151.726451:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787893151.726455:0:13436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7e800, rc 0) 00000100:00100000:2.0:1787893151.726559:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+61:12470:x1874741481803264:12345-192.168.202.35@tcp:101:bash.0 Request processed in 444us (3133us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893151.726567:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 224 00000100:00100000:1.0:1787893151.729168:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893151.729264:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481803648 00000100:00100000:2.0:1787893151.729332:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481803648 00000100:00100000:2.0:1787893151.729447:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 225 00000100:00100000:2.0:1787893151.729460:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+61:12470:x1874741481803648:12345-192.168.202.35@tcp:36:bash.0 00010000:00010000:2.0:1787893151.729573:0:9515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893151.729610:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c800/0x9232577658cf1b09 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa6d expref: 61 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.729634:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc8c6615800) 00010000:00010000:2.0:1787893151.729670:0:9515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787893151.729907:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf1b41 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.729924:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf1b41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.729936:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf1b41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787893151.729986:0:9515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967502 00000004:00010000:2.0:1787893151.730012:0:9515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b42941a7 reply state 00000000a82644f6 transno 4294967503 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf1b41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.730027:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf1b41 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.730033:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc8c6615800) 00010000:00010000:2.0:1787893151.730037:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787893151.730040:0:9515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787893151.730152:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+63:12470:x1874741481803648:12345-192.168.202.35@tcp:36:bash.0 Request processed in 694us (998us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1787893151.730160:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 225 00000020:00080000:2.0:1787893151.730166:0:9515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787893151.732844:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893151.735236:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481803776 00000100:00100000:0.0:1787893151.735256:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481803776 00000100:00100000:0.0:1787893151.735423:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 226 00000100:00100000:0.0:1787893151.735435:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+63:12470:x1874741481803776:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:0.0:1787893151.735467:0:10086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893151.735510:0:10086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf1b48 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62faa82 expref: -99 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.735636:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf1b4f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.735653:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf1b4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.735667:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf1b4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893151.735705:0:10086:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787893151.735711:0:10086:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787893151.735735:0:10086:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf1b4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.735767:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf1b48 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa82 expref: 65 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.735806:0:10086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf1b4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa82 expref: 64 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.735843:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc8c6615800) 00010000:00010000:0.0:1787893151.735846:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787893151.735851:0:10086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9dd69ce00, rc 0) 00000100:00100000:0.0:1787893151.735935:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+64:12470:x1874741481803776:12345-192.168.202.35@tcp:101:bash.0 Request processed in 493us (3096us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893151.735943:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 226 00000100:00100000:2.0:1787893151.739214:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893151.739298:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481804032 00000100:00100000:3.0:1787893151.739311:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481804032 00000100:00100000:3.0:1787893151.739374:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 59 00000100:00100000:3.0:1787893151.739387:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+64:12470:x1874741481804032:12345-192.168.202.35@tcp:35:bash.0 00000100:00100000:3.0:1787893151.739705:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+65:12470:x1874741481804032:12345-192.168.202.35@tcp:35:bash.0 Request processed in 320us (503us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1787893151.739713:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 59 00000100:00100000:0.0:1787893151.775076:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893151.775138:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893151.775172:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893151.775210:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893151.775243:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893151.775281:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481804672 00000100:00100000:0.0:1787893151.775294:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481804672 00000100:00100000:0.0:1787893151.775363:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481804288 00000100:00100000:0.0:1787893151.775367:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481804288 00000100:00100000:0.0:1787893151.775390:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481804544 00000100:00100000:0.0:1787893151.775393:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481804544 00000100:00100000:0.0:1787893151.775417:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 366 00000100:00100000:0.0:1787893151.775429:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2391:x1874741481804672:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893151.776385:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 367 00000100:00100000:2.0:1787893151.776444:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+5:2391:x1874741481804288:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893151.776540:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481804160 00000100:00100000:1.0:1787893151.776547:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481804160 00000100:00100000:1.0:1787893151.776608:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 397 00000100:00100000:1.0:1787893151.776616:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2391:x1874741481804160:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893151.776691:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481804416 00000100:00100000:3.0:1787893151.776696:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481804416 00000100:00100000:3.0:1787893151.776736:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 140 00000100:00100000:3.0:1787893151.776743:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58232959-285a-4954-a3ac-571a2b817017+9:2391:x1874741481804416:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893151.777120:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2391:x1874741481804672:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 1691us (1944us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893151.777130:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 366 00000100:00100000:0.0:1787893151.777156:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 368 00000100:00100000:0.0:1787893151.777165:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2391:x1874741481804544:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893151.786216:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+5:2391:x1874741481804288:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 9765us (10985us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893151.786239:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 367 00000100:00080000:2.0:1787893151.786328:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787893151.786335:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787893151.786999:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2391:x1874741481804160:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 10378us (11933us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893151.787011:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 397 00000100:00100000:3.0:1787893151.788741:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58232959-285a-4954-a3ac-571a2b817017+9:2391:x1874741481804416:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 11983us (13587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893151.788758:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 140 00000100:00100000:0.0:1787893151.793320:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2391:x1874741481804544:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 16136us (18055us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893151.793362:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 368 00000100:00100000:2.0:1787893151.822534:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893151.822633:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481804800 00000100:00100000:0.0:1787893151.822658:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481804800 00000100:00100000:0.0:1787893151.822876:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 227 00000100:00100000:0.0:1787893151.822890:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+65:12476:x1874741481804800:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787893151.822924:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893151.823166:0:13436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf1b56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62faa89 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.823254:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69d800/0x9232577658cf1b5d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.823271:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69d800/0x9232577658cf1b5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.823285:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69d800/0x9232577658cf1b5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893151.823340:0:13436:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1787893151.823344:0:13436:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787893151.823368:0:13436:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69d800/0x9232577658cf1b5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.823400:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf1b56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa89 expref: 67 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.823425:0:13436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69d800/0x9232577658cf1b5d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa89 expref: 66 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.823460:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc9c3918700) 00010000:00010000:0.0:1787893151.823463:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787893151.823467:0:13436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9dd69d800, rc 0) 00000100:00100000:0.0:1787893151.823655:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+66:12476:x1874741481804800:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 767us (1180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893151.823664:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 227 00000100:00100000:2.0:1787893151.836334:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893151.836443:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481804928 00000100:00100000:3.0:1787893151.836457:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481804928 00000100:00100000:3.0:1787893151.836561:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 228 00000100:00100000:3.0:1787893151.836574:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c846aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+66:12476:x1874741481804928:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:3.0:1787893151.836602:0:9515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893151.836628:0:9515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6600/0x9232577658cf1b64 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62faa90 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.836724:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1b6b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.836772:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1b6b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.836787:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1b6b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.836801:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6400/0x9232577658cf1b72 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.836818:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6400/0x9232577658cf1b72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.836826:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6400/0x9232577658cf1b72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.837195:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7e00/0x9232577658cf1b79 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.837206:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7e00/0x9232577658cf1b79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.837215:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7e00/0x9232577658cf1b79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893151.837271:0:9515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787893151.837277:0:9515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787893151.837299:0:9515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7e00/0x9232577658cf1b79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.837315:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7e00/0x9232577658cf1b79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.837336:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1b6b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.837343:0:9515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1b6b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.837351:0:9515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1b6b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.837357:0:9515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c84f7a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893151.837363:0:9515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1b6b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.837372:0:9515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1b6b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.837386:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc9c3918700) 00010000:00010000:3.0:1787893151.837389:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893151.837395:0:9515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1b6b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.837401:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1b6b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.837418:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6400/0x9232577658cf1b72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.837425:0:9515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6400/0x9232577658cf1b72 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.837432:0:9515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6400/0x9232577658cf1b72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.837443:0:9515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c84f6400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893151.837446:0:9515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6400/0x9232577658cf1b72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.837453:0:9515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6400/0x9232577658cf1b72 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.837462:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc8c6615400) 00010000:00010000:3.0:1787893151.837465:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893151.837468:0:9515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6400/0x9232577658cf1b72 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.837474:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6400/0x9232577658cf1b72 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.837861:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6600/0x9232577658cf1b64 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa90 expref: 68 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.837881:0:9515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7e00/0x9232577658cf1b79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa90 expref: 67 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.837889:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc8c6615800) 00010000:00010000:3.0:1787893151.837892:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787893151.837894:0:9515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c84f7e00, rc 0) 00000100:00100000:2.0:1787893151.842372:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c846aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+67:12476:x1874741481804928:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 5783us (6036us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893151.842388:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 228 00000100:00100000:3.0:1787893151.846755:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893151.852419:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481805056 00000100:00100000:0.0:1787893151.852444:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481805056 00000100:00100000:0.0:1787893151.852558:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 18 00000100:00100000:0.0:1787893151.852571:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8507480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+67:2391:x1874741481805056:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893151.852591:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893151.852624:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7e00/0x9232577658cf1b79 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa90 expref: 67 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.852648:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc8c6615800) 00010000:00010000:0.0:1787893151.852655:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893151.852744:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8507480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+66:2391:x1874741481805056:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 176us (6018us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893151.852753:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 18 00000100:00100000:3.0:1787893151.853261:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893151.853763:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481805312 00000100:00100000:0.0:1787893151.853783:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481805312 00000100:00100000:0.0:1787893151.853844:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 229 00000100:00100000:0.0:1787893151.853854:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+66:12476:x1874741481805312:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787893151.853879:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893151.853906:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf1b80 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62faa97 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.854680:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1b87 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.854698:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf1b4f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa82 expref: 67 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.854709:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1b87 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.854752:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf1b4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa82 expref: 67 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.854768:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf1b4f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa82 expref: 67 pid: 10086 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893151.854783:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c846b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6505:1874741493392256:192.168.202.35@tcp:104: 00000100:00100000:2.0:1787893151.854970:0:6505:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c63db6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787893151.857282:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c846b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6505:1874741493392256:192.168.202.35@tcp:104: 00010000:00010000:2.0:1787893151.857321:0:6505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1b87 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893151.857922:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893151.858082:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481805440 00000100:00100000:3.0:1787893151.858092:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481805440 00010000:00010000:3.0:1787893151.858150:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf1b4f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa82 expref: 68 pid: 10086 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893151.858198:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 98 00000100:00100000:3.0:1787893151.858209:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c846b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58232959-285a-4954-a3ac-571a2b817017+68:2390:x1874741481805440:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893151.858227:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893151.858235:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf1b4f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa82 expref: 68 pid: 10086 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.858248:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf1b4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa82 expref: 68 pid: 10086 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.858280:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf1b4f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa82 expref: 68 pid: 10086 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.858302:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc8c6615800) 00010000:00010000:3.0:1787893151.858308:0:6492:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1b87 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.858320:0:6492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1b87 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.858329:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1b87 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.858361:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893151.858434:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c846b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58232959-285a-4954-a3ac-571a2b817017+67:2390:x1874741481805440:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 227us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893151.858442:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 98 00010000:00010000:2.0:1787893151.859564:0:6505:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1b87 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.859591:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1b87 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893151.859619:0:6505:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787893151.859807:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf1b80 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa97 expref: 68 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.859842:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1b87 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa97 expref: 67 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.859851:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc8c6615800) 00010000:00010000:2.0:1787893151.859854:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787893151.859857:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7ee00, rc 0) 00000100:00100000:2.0:1787893151.859921:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+67:12476:x1874741481805312:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 6068us (6663us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1787893151.859936:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 229 00000100:00100000:2.0:1787893151.870164:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893151.870398:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481805696 00000100:00100000:0.0:1787893151.870413:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481805696 00000100:00100000:0.0:1787893151.870542:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 19 00000100:00100000:0.0:1787893151.870556:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3efd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+67:12476:x1874741481805696:12345-192.168.202.35@tcp:103:lfs.0 00010000:00010000:0.0:1787893151.870587:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893151.870623:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf1ad8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa66 expref: 67 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.870648:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc8c6615800) 00010000:00010000:0.0:1787893151.870653:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893151.870720:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3efd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+66:12476:x1874741481805696:12345-192.168.202.35@tcp:103:lfs.0 Request processed in 167us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893151.870728:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 19 00000100:00100000:0.0:1787893151.872912:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893151.872996:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481805824 00000100:00100000:2.0:1787893151.873009:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481805824 00000100:00100000:2.0:1787893151.873073:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 230 00000100:00100000:2.0:1787893151.873084:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+66:12476:x1874741481805824:12345-192.168.202.35@tcp:58:lfs.0 00010000:00010000:2.0:1787893151.873259:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f200/0x9232577658cf1b95 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.873292:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f200/0x9232577658cf1b95 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.873320:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f200/0x9232577658cf1b95 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787893151.873455:0:13436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1787893151.873607:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+66:12476:x1874741481805824:12345-192.168.202.35@tcp:58:lfs.0 Request processed in 524us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893151.873616:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 230 00000100:00100000:2.0:1787893151.878200:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893151.878295:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481805952 00000100:00100000:3.0:1787893151.878308:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481805952 00000100:00100000:3.0:1787893151.878383:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 231 00000100:00100000:3.0:1787893151.878395:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c846b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+66:12476:x1874741481805952:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:3.0:1787893151.878422:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893151.878445:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6400/0x9232577658cf1b9c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62faa9e expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.878577:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f200/0x9232577658cf1b95 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.878591:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6400/0x9232577658cf1b9c lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa9e expref: 67 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.878615:0:6504:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f200/0x9232577658cf1b95 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.878629:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6400/0x9232577658cf1b9c lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa9e expref: 67 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.878648:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc8c6615800) 00010000:00010000:3.0:1787893151.878651:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787893151.878655:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6400/0x9232577658cf1b9c lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa9e expref: 67 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.878664:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c84f6400, rc 0) 00000100:00100000:3.0:1787893151.878734:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c846b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+67:12476:x1874741481805952:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 340us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893151.878741:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 231 00000040:00080000:3.0:1787893151.985904:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787893151.985919:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787893151.985974:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1787893151.985986:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787893151.986190:0:13786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8504380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13786:1874741493392384:192.168.202.35@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787893151.986412:0:13786:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d7e780 going to sleep for 11 seconds 00000100:00100000:3.0:1787893151.992587:0:13786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8504380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13786:1874741493392384:192.168.202.35@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787893151.993540:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893151.993643:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481806080 00000100:00100000:2.0:1787893151.993654:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481806080 00000100:00100000:2.0:1787893151.993766:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 232 00000100:00100000:2.0:1787893151.993788:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+67:12477:x1874741481806080:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787893151.993841:0:10086:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787893151.994018:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+67:12477:x1874741481806080:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 Request processed in 232us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893151.994028:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 232 00000100:00100000:2.0:1787893151.997883:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893151.998098:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481806208 00000100:00100000:0.0:1787893151.998113:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481806208 00000100:00100000:0.0:1787893151.998195:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 233 00000100:00100000:0.0:1787893151.998207:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c846ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+67:12477:x1874741481806208:12345-192.168.202.35@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787893151.998319:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c600/0x9232577658cf1ba3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.998340:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c600/0x9232577658cf1ba3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.998354:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c600/0x9232577658cf1ba3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.000816:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf1baa lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.000843:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf1baa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.000858:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf1baa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.000896:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf1bb1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.006367:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf1bb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.006386:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf1bb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893152.006925:0:13436:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787893152.006932:0:13436:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787893152.006950:0:13436:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf1bb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.006966:0:13436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c600/0x9232577658cf1ba3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.007002:0:13436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c600/0x9232577658cf1ba3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.007010:0:13436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c600/0x9232577658cf1ba3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.007016:0:13436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd69c600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893152.007021:0:13436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c600/0x9232577658cf1ba3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.007028:0:13436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c600/0x9232577658cf1ba3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.007043:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fc9d5c29800) 00010000:00010000:1.0:1787893152.007046:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893152.007050:0:13436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c600/0x9232577658cf1ba3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.007057:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c600/0x9232577658cf1ba3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.007077:0:13436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf1baa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.007084:0:13436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf1baa lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.007089:0:13436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf1baa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.007094:0:13436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd69da00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893152.007103:0:13436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf1baa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.007110:0:13436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf1baa lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.007117:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9fc8c751a100) 00010000:00010000:1.0:1787893152.007120:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893152.007123:0:13436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf1baa lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.007128:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf1baa lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.007147:0:13436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf1bb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.007153:0:13436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf1bb1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.007158:0:13436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf1bb1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.007163:0:13436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd69ce00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893152.007166:0:13436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf1bb1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.007171:0:13436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf1bb1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.007178:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc8c6615800) 00010000:00010000:1.0:1787893152.007180:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893152.007191:0:13436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf1bb1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.007197:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf1bb1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893152.007312:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c846ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+67:12477:x1874741481806208:12345-192.168.202.35@tcp:34:lhsmtool_posix.0 Request processed in 9102us (9438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893152.007322:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 233 00000100:00100000:3.0:1787893152.020769:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893152.020986:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481806464 00000100:00100000:2.0:1787893152.020997:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481806464 00000100:00100000:2.0:1787893152.021085:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 234 00000100:00100000:2.0:1787893152.021096:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8504380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+67:12477:x1874741481806464:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787893152.021116:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893152.021139:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf1bb8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62faaa5 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.021262:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf1bbf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.021309:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf1bbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.021320:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf1bbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893152.021333:0:6504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787893152.021410:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf1bbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.021418:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf1bbf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.021425:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf1bbf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.021431:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7e200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893152.021748:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf1bbf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.021757:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf1bbf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.021768:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc8c6615800) 00010000:00010000:2.0:1787893152.021771:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787893152.021775:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf1bbf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.021782:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf1bbf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.021832:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf1bb8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faaa5 expref: 69 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.021849:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fc9d5c29800) 00010000:00010000:2.0:1787893152.021851:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787893152.021855:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf1bb8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faaa5 expref: 69 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.021864:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7f400, rc 0) 00000100:00100000:2.0:1787893152.021918:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8504380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+68:12477:x1874741481806464:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 825us (1158us total) trans 4294967506 rc 301/301 00000100:00100000:2.0:1787893152.021926:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 234 00000100:00080000:0.0:1787893152.022667:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787893152.024298:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893152.024461:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481806592 00000100:00100000:2.0:1787893152.024472:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481806592 00000100:00100000:2.0:1787893152.024556:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 235 00000100:00100000:2.0:1787893152.024566:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+68:12477:x1874741481806592:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787893152.024601:0:6505:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787893152.024727:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+68:12477:x1874741481806592:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 Request processed in 161us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893152.024735:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 235 00000100:00100000:1.0:1787893152.027624:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893152.027734:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481806848 00000100:00100000:2.0:1787893152.027746:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481806848 00000100:00100000:2.0:1787893152.027801:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 236 00000100:00100000:2.0:1787893152.027822:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+68:12477:x1874741481806848:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787893152.027843:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893152.027846:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787893152.027873:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69d800/0x9232577658cf1b5d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa89 expref: 68 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.027915:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc9c3918700) 00010000:00010000:2.0:1787893152.027920:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787893152.027934:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf1bcd lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62faaac expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787893152.028315:0:6506:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:2.0:1787893152.028456:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf1bd4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.028470:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf1bd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.028480:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf1bd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.028574:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf1bcd lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faaac expref: 70 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.028589:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf1bd4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faaac expref: 69 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.028596:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fc8c6615a00) 00010000:00010000:2.0:1787893152.028599:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787893152.028601:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7e200, rc 0) 00000100:00100000:2.0:1787893152.028655:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+69:12477:x1874741481806848:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 845us (1041us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1787893152.028664:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 236 00000100:00100000:2.0:1787893152.033152:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893152.033230:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481807104 00000100:00100000:3.0:1787893152.033241:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481807104 00000100:00100000:3.0:1787893152.033312:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 237 00000100:00100000:3.0:1787893152.033324:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8469c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+69:12477:x1874741481807104:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787893152.033380:0:9515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893152.033407:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf1bd4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faaac expref: 69 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.033425:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fc8c6615a00) 00010000:00010000:3.0:1787893152.033449:0:9515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787893152.033470:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6600/0x9232577658cf1be2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.033483:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6600/0x9232577658cf1be2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.033729:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6600/0x9232577658cf1be2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.033748:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1be9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xe501cc7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.033767:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1be9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xe501cc7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.033773:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1be9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xe501cc7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.033829:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6600/0x9232577658cf1be2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.033836:0:9515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6600/0x9232577658cf1be2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.033842:0:9515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6600/0x9232577658cf1be2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.033847:0:9515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c84f6600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893152.033852:0:9515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6600/0x9232577658cf1be2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.033858:0:9515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6600/0x9232577658cf1be2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.033866:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc9c3918700) 00010000:00010000:3.0:1787893152.033869:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893152.033872:0:9515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6600/0x9232577658cf1be2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.033877:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6600/0x9232577658cf1be2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.033887:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1be9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xe501cc7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.033898:0:9515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1be9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe501cc7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.033905:0:9515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1be9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe501cc7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.033910:0:9515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c84f7a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893152.033913:0:9515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1be9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe501cc7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.033918:0:9515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1be9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe501cc7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.033927:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xe501cc7d (ffff9fc8c7511e00) 00010000:00010000:3.0:1787893152.033930:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893152.033932:0:9515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1be9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xe501cc7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.033937:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1be9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xe501cc7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893152.034019:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8469c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+68:12477:x1874741481807104:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 Request processed in 697us (876us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787893152.034026:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 237 00000100:00100000:0.0:1787893152.038968:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893152.039070:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481807232 00000100:00100000:2.0:1787893152.039080:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481807232 00000100:00100000:2.0:1787893152.039139:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 238 00000100:00100000:2.0:1787893152.039149:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+68:12477:x1874741481807232:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787893152.039170:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893152.039195:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf1bf0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62faab3 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.039229:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf1bf7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.039243:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf1bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.039254:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf1bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.039385:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf1bf0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faab3 expref: 70 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.039404:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf1bf7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faab3 expref: 69 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.039414:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fc8c6615b00) 00010000:00010000:2.0:1787893152.039417:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787893152.039420:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7ea00, rc 0) 00000100:00100000:2.0:1787893152.039520:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+69:12477:x1874741481807232:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 371us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893152.039538:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 238 00000100:00100000:1.0:1787893152.053736:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893152.054044:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481807488 00000100:00100000:2.0:1787893152.054054:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481807488 00000100:00100000:2.0:1787893152.054119:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 239 00000100:00100000:2.0:1787893152.054131:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+69:12477:x1874741481807488:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787893152.054219:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf1bfe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.054236:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf1bfe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.054248:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf1bfe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787893152.054425:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00010000:2.0:1787893152.054541:0:6506:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b73742ac reply state 00000000555ab67e transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf1bfe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.054555:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf1bfe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.054563:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fc8c6615b00) 00010000:00010000:2.0:1787893152.054565:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787893152.054569:0:6506:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787893152.054664:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+71:12477:x1874741481807488:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 Request processed in 534us (936us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1787893152.054672:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 239 00000100:00100000:3.0:1787893152.058556:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893152.059046:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481807616 00000100:00100000:2.0:1787893152.059057:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481807616 00000100:00100000:2.0:1787893152.059135:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 240 00000100:00100000:2.0:1787893152.059146:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+71:12477:x1874741481807616:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787893152.059170:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893152.059192:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf1c05 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62faaba expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.059252:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf1c05 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faaba expref: 72 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.059278:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf1c05 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faaba expref: 72 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.059300:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fc8c6615b00) 00010000:00010000:2.0:1787893152.059303:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787893152.059307:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7e600, rc 0) 00000100:00100000:2.0:1787893152.059368:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+72:12477:x1874741481807616:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 223us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893152.059375:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 240 00000100:00100000:0.0:1787893152.064989:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893152.065139:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481807744 00000100:00100000:3.0:1787893152.065149:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481807744 00000100:00100000:3.0:1787893152.065222:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 70 00000100:00100000:3.0:1787893152.065233:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58232959-285a-4954-a3ac-571a2b817017+9:2391:x1874741481807744:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1787893152.065589:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787893152.065771:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58232959-285a-4954-a3ac-571a2b817017+10:2391:x1874741481807744:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 Request processed in 538us (790us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1787893152.065779:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 70 00000100:00100000:1.0:1787893152.081652:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893152.085867:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481808000 00000100:00100000:3.0:1787893152.085882:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481808000 00000100:00100000:2.0:1787893152.090019:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 60 00000100:00100000:2.0:1787893152.090035:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+72:12477:x1874741481808000:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787893152.090257:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+73:12477:x1874741481808000:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 Request processed in 226us (8616us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1787893152.090266:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 60 00000100:00100000:3.0:1787893152.094717:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893152.095558:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481808256 00000100:00100000:0.0:1787893152.095571:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481808256 00000100:00100000:0.0:1787893152.095699:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 241 00000100:00100000:0.0:1787893152.095711:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+73:12477:x1874741481808256:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787893152.095878:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+73:12477:x1874741481808256:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 Request processed in 169us (1170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893152.095901:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 241 00000100:00100000:2.0:1787893152.100347:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893152.100526:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481808384 00000100:00100000:1.0:1787893152.100536:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481808384 00000100:00100000:1.0:1787893152.100602:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 242 00000100:00100000:1.0:1787893152.100613:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c846b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+73:12477:x1874741481808384:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787893152.100632:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893152.100654:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf1c0c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62faac1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.100727:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1c13 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.100742:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1c13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.100841:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1c13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893152.100906:0:6506:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787893152.101057:0:6506:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1c13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.101085:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf1c0c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faac1 expref: 75 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.101104:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1c13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faac1 expref: 74 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.101113:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fc8c6615b00) 00010000:00010000:1.0:1787893152.101116:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787893152.101120:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe540e00, rc 0) 00000100:00100000:1.0:1787893152.101231:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c846b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+74:12477:x1874741481808384:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 619us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893152.101238:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 242 00000100:00100000:3.0:1787893152.108841:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893152.109079:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481808512 00000100:00100000:2.0:1787893152.109090:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481808512 00000100:00100000:2.0:1787893152.109196:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 71 00000100:00100000:2.0:1787893152.109207:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8504700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+10:2391:x1874741481808512:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787893152.109229:0:8420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893152.109250:0:8420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000991ac37/0x9232577658cf1c1a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62faac8 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787893152.109291:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9115a0, blocks: 0x0 00010000:00010000:2.0:1787893152.109317:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1787893152.109322:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893152.109332:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000991ac37/0x9232577658cf1c1a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faac8 expref: 11 pid: 8420 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.109350:0:8420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000991ac37/0x9232577658cf1c1a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faac8 expref: 11 pid: 8420 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.109364:0:8420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7e200, rc 0) 00000100:00100000:2.0:1787893152.109425:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8504700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+11:2391:x1874741481808512:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 220us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893152.109433:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 71 00000100:00100000:2.0:1787893152.112902:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893152.112980:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481808768 00000100:00100000:3.0:1787893152.112991:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481808768 00000100:00100000:3.0:1787893152.113052:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 243 00000100:00100000:3.0:1787893152.113062:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+74:12477:x1874741481808768:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787893152.113159:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+74:12477:x1874741481808768:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 Request processed in 99us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893152.113167:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 243 00000100:00100000:0.0:1787893152.123015:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893152.123113:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481808896 00000100:00100000:1.0:1787893152.123123:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481808896 00000100:00100000:3.0:1787893152.123860:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 72 00000100:00100000:3.0:1787893152.123890:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58232959-285a-4954-a3ac-571a2b817017+11:12477:x1874741481808896:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787893152.123911:0:8535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893152.123939:0:8535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078ad2a37/0x9232577658cf1c21 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62faacf expref: -99 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.123971:0:8535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000991ac37/0x9232577658cf1c1a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faac8 expref: 12 pid: 8420 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.123981:0:8535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893152.123986:0:8535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893152.124004:0:8535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078ad2a37/0x9232577658cf1c21 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faacf expref: 12 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.124041:0:8535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000991ac37/0x9232577658cf1c1a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faac8 expref: 12 pid: 8420 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.124057:0:8535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000991ac37/0x9232577658cf1c1a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faac8 expref: 12 pid: 8420 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893152.124071:0:8535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8506a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8535:1874741493392512:192.168.202.35@tcp:104: 00000100:00100000:3.0:1787893152.125693:0:8535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d7e780 going to sleep for 11 seconds 00000100:00100000:1.0:1787893152.128064:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893152.128336:0:10383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481809024 00000100:00100000:0.0:1787893152.128347:0:10383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481809024 00010000:00010000:0.0:1787893152.128392:0:10383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000991ac37/0x9232577658cf1c1a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faac8 expref: 13 pid: 8420 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893152.128448:0:10383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 99 00000100:00100000:0.0:1787893152.128459:0:10383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58232959-285a-4954-a3ac-571a2b817017+13:2390:x1874741481809024:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893152.128485:0:10383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893152.128545:0:10383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000991ac37/0x9232577658cf1c1a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faac8 expref: 13 pid: 8420 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.128561:0:10383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000991ac37/0x9232577658cf1c1a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faac8 expref: 13 pid: 8420 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.128586:0:10383:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787893152.128592:0:10383:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787893152.128601:0:10383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000078ad2a37/0x9232577658cf1c21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faacf expref: 13 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.128612:0:10383:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078ad2a37/0x9232577658cf1c21 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faacf expref: 13 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.128655:0:10383:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000078ad2a37/0x9232577658cf1c21 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faacf expref: 13 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893152.128687:0:10383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10383:1874741493392640:192.168.202.35@tcp:105: 00000100:00100000:0.0:1787893152.128765:0:10383:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c4d87300 going to sleep for 11 seconds 00010000:00010000:3.0:1787893152.129563:0:8535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000991ac37/0x9232577658cf1c1a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faac8 expref: 13 pid: 8420 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893152.129582:0:8535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8506a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8535:1874741493392512:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787893152.129608:0:8535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000078ad2a37/0x9232577658cf1c21 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faacf expref: 12 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.129620:0:8535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c84f7c00, rc 0) 00000100:00100000:3.0:1787893152.129667:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58232959-285a-4954-a3ac-571a2b817017+12:12477:x1874741481808896:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 5794us (6663us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893152.129676:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 72 00000100:00100000:0.0:1787893152.142182:0:10383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10383:1874741493392640:192.168.202.35@tcp:105: 00010000:00010000:0.0:1787893152.142210:0:10383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893152.142273:0:10383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58232959-285a-4954-a3ac-571a2b817017+11:2390:x1874741481809024:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 13816us (14218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893152.142285:0:10383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 99 00000100:00100000:2.0:1787893152.146944:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893152.150294:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481809152 00000100:00100000:0.0:1787893152.150386:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481809152 00002000:00100000:0.0:1787893152.150454:0:8425:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9fc8c8469500 x1874741481809152/t0(0) o4->58232959-285a-4954-a3ac-571a2b817017@192.168.202.35@tcp:313/0 lens 504/0 e 0 to 0 dl 1787893163 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787893152.150468:0:8425:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc8c8469500 with x1874741481809152 ext(0->12) 00002000:00010000:0.0:1787893152.150474:0:8425:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fc8c8469500 00000100:00100000:0.0:1787893152.150591:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 6 00000100:00100000:0.0:1787893152.150602:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8469500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:58232959-285a-4954-a3ac-571a2b817017+11:2390:x1874741481809152:12345-192.168.202.35@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787893152.151487:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8469500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:58232959-285a-4954-a3ac-571a2b817017+13:2390:x1874741481809152:12345-192.168.202.35@tcp:4:lhsmtool_posix.0 Request processed in 882us (4548us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1787893152.151517:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 6 00002000:00100000:0.0:1787893152.151526:0:8425:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9fc8c8469500 x1874741481809152/t4294967321(0) o4->58232959-285a-4954-a3ac-571a2b817017@192.168.202.35@tcp:313/0 lens 504/448 e 0 to 0 dl 1787893163 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787893152.151536:0:8425:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc8c8469500 with x1874741481809152 ext(0->12) 00002000:00010000:0.0:1787893152.151540:0:8425:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fc8c8469500 00000100:00100000:2.0:1787893152.155255:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893152.155438:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481809280 00000100:00100000:1.0:1787893152.155448:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481809280 00000100:00100000:1.0:1787893152.155546:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 244 00000100:00100000:1.0:1787893152.155557:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c846bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+74:12477:x1874741481809280:12345-192.168.202.35@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787893152.158111:0:6484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967509 is committed 00000004:00080000:2.0:1787893152.158159:0:6484:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1787893152.158188:0:6484:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fc9eee58540 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1787893152.158193:0:6484:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fc9e7110400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fc9eee58240 00000020:00080000:2.0:1787893152.158207:0:6484:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fc9e7110300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fc9e7140400 00000004:00080000:2.0:1787893152.158246:0:6484:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:2.0:1787893152.158289:0:6484:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fc8c70b8840 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1787893152.158294:0:6484:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fc9e70af600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fc8c70b8600 00000020:00080000:2.0:1787893152.158297:0:6484:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fc9e70afe00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fc8c770a200 00010000:00010000:0.0:1787893152.158413:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf1926 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.158425:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf1926 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.158434:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf1926 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.158440:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893152.158446:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf1926 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.158454:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf1926 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.158471:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fc8c6614900) 00010000:00010000:0.0:1787893152.158475:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893152.158479:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf1926 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.158486:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31600/0x9232577658cf1926 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.158539:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf19ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.158545:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf19ce lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.158551:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf19ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.158571:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7fa00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893152.158574:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf19ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.158581:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf19ce lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.158589:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc8c751af00) 00010000:00010000:0.0:1787893152.158591:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893152.158595:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf19ce lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.158600:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf19ce lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.158619:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf1a4c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.158625:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf1a4c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.158631:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf1a4c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.158637:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7e000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893152.158640:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf1a4c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.158647:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf1a4c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.158666:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc8c6615400) 00010000:00010000:0.0:1787893152.158668:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893152.158671:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf1a4c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.158676:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf1a4c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.158688:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fe00/0x9232577658cf1a6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.158693:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fe00/0x9232577658cf1a6f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.158699:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fe00/0x9232577658cf1a6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.158703:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7fe00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893152.158706:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fe00/0x9232577658cf1a6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.158712:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fe00/0x9232577658cf1a6f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.158719:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc8c6615400) 00010000:00010000:0.0:1787893152.158722:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893152.158724:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fe00/0x9232577658cf1a6f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.158729:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fe00/0x9232577658cf1a6f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.158750:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf1b41 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.158756:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf1b41 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.158762:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf1b41 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.158767:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7e400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893152.158770:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf1b41 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.158776:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf1b41 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.158783:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc8c6615800) 00010000:00010000:0.0:1787893152.158786:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893152.158788:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf1b41 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.158793:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf1b41 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.158802:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf1bfe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.158819:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf1bfe lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.158824:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf1bfe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.158835:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7f400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893152.158838:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf1bfe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.158844:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf1bfe lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.158852:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fc8c6615b00) 00010000:00010000:0.0:1787893152.158854:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787893152.158857:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf1bfe lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.158862:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf1bfe lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893152.159035:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787893152.159053:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493392768:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787893152.159117:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893152.159172:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493392768 00000100:00100000:3.0:1787893152.159178:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493392768 00000100:00080000:3.0:1787893152.159204:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787893152.159247:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787893152.159257:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3631:x1874741493392768:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787893152.159284:0:8420:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:3.0:1787893152.159329:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a91159f, atime: 0x6a91159f, ctime: 0x6a91159f, blocks: 0x8 00010000:00010000:3.0:1787893152.159335:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009619658/0x9232577658cf1c28 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.159350:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1787893152.159355:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893152.159361:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009619658/0x9232577658cf1c28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.159373:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009619658/0x9232577658cf1c28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.159381:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009619658/0x9232577658cf1c28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.159388:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009619658/0x9232577658cf1c28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.159407:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787893152.159584:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3631:x1874741493392768:12345-0@lo:6:osp-syn-0-0.0 Request processed in 328us (466us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787893152.159592:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00010000:3.0:1787893152.159620:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787893152.159626:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009619658/0x9232577658cf1c28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.159634:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c84f7a00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:3.0:1787893152.159637:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009619658/0x9232577658cf1c28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.159645:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009619658/0x9232577658cf1c28 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.159657:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009619658/0x9232577658cf1c28 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.159664:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009619658/0x9232577658cf1c28 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.159677:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893152.159678:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893152.159680:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787893152.159708:0:3631:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fc8c8506a00/2, rc 0, transno 4294967311 00000100:00100000:3.0:1787893152.159713:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493392768:0@lo:6:osp-syn-0-0.0 00000020:00080000:1.0:1787893152.160087:0:6536:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1787893152.161247:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787893152.161277:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d29faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493392896:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787893152.161356:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893152.161636:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493392896 00000100:00100000:1.0:1787893152.161644:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493392896 00000100:00100000:1.0:1787893152.161708:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787893152.161718:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3630:x1874741493392896:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787893152.161745:0:8419:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:1.0:1787893152.161782:0:8419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060f5eadb/0x9232577658cf1c2f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.161804:0:8419:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d911091f/0x9232577658cf19dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa27 expref: 12 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.161823:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787893152.161828:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787893152.161833:0:8419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060f5eadb/0x9232577658cf1c2f lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.161867:0:8419:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d911091f/0x9232577658cf19dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa27 expref: 12 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.161882:0:8419:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d911091f/0x9232577658cf19dc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa27 expref: 12 pid: 8421 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893152.161894:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d29f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8419:1874741493393024:192.168.202.35@tcp:104: 00000100:00100000:1.0:1787893152.161953:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d29e3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787893152.162039:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c846bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+21:12477:x1874741481809280:12345-192.168.202.35@tcp:44:lhsmtool_posix.0 Request processed in 6483us (6793us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893152.162048:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 244 00000100:00080000:2.0:1787893152.162190:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:0.0:1787893152.162691:0:6536:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1787893152.162757:0:6536:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1787893152.168694:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893152.168782:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893152.168891:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d29f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8419:1874741493393024:192.168.202.35@tcp:104: 00010000:00010000:0.0:1787893152.168916:0:8419:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000060f5eadb/0x9232577658cf1c2f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893152.169047:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481809408 00000100:00100000:3.0:1787893152.169054:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481809408 00000100:00100000:3.0:1787893152.169089:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 75 00000100:00100000:3.0:1787893152.169095:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+13:2390:x1874741481809408:12345-192.168.202.35@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787893152.170083:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481809536 00000100:00100000:2.0:1787893152.170090:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481809536 00010000:00010000:2.0:1787893152.170117:0:6490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d911091f/0x9232577658cf19dc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa27 expref: 14 pid: 8421 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893152.170152:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 100 00000100:00100000:2.0:1787893152.170158:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+14:2390:x1874741481809536:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787893152.170179:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893152.170187:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d911091f/0x9232577658cf19dc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa27 expref: 14 pid: 8421 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.170200:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d911091f/0x9232577658cf19dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa27 expref: 14 pid: 8421 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.170222:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d911091f/0x9232577658cf19dc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa27 expref: 14 pid: 8421 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.170237:0:6490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787893152.170241:0:6490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787893152.170251:0:6490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000060f5eadb/0x9232577658cf1c2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.170259:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060f5eadb/0x9232577658cf1c2f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.170282:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787893152.170429:0:8419:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000060f5eadb/0x9232577658cf1c2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.170436:0:8419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060f5eadb/0x9232577658cf1c2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.170448:0:8419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060f5eadb/0x9232577658cf1c2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.170453:0:8419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060f5eadb/0x9232577658cf1c2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.170474:0:8419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787893152.170674:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+13:2390:x1874741481809536:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 514us (1890us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893152.170680:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 100 00010000:00010000:1.0:1787893152.170932:0:8435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893152.170939:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060f5eadb/0x9232577658cf1c2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.170959:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540600 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:1.0:1787893152.170964:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060f5eadb/0x9232577658cf1c2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.170971:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060f5eadb/0x9232577658cf1c2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.170980:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060f5eadb/0x9232577658cf1c2f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.170984:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060f5eadb/0x9232577658cf1c2f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.170998:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893152.170999:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893152.171000:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893152.171274:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3630:x1874741493392896:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9557us (9918us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1787893152.171280:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000004:00080000:3.0:1787893152.171646:0:3630:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fc9d29faa00/2, rc 0, transno 4294967322 00000100:00100000:3.0:1787893152.171663:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d29faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493392896:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1787893152.175705:0:9497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:0.0:1787893152.175746:0:9497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000100:00100000:2.0:1787893152.176206:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+7:2390:x1874741481809408:12345-192.168.202.35@tcp:16:lhsmtool_posix.0 Request processed in 7098us (7508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893152.176223:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 75 00000100:00100000:1.0:1787893152.180969:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893152.184722:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481809792 00000100:00100000:2.0:1787893152.184737:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481809792 00000100:00100000:2.0:1787893152.184870:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 245 00000100:00100000:2.0:1787893152.184882:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+21:12477:x1874741481809792:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787893152.184938:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893152.184968:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1c13 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faac1 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.184990:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fc8c6615b00) 00010000:00010000:2.0:1787893152.184995:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787893152.185026:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147d600/0x9232577658cf1c36 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.185040:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147d600/0x9232577658cf1c36 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.185071:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147d600/0x9232577658cf1c36 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787893152.185198:0:6506:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a0ee0935 reply state 000000007907518e transno 4294967510 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147d600/0x9232577658cf1c36 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.185211:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147d600/0x9232577658cf1c36 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.185218:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fc8c6615b00) 00010000:00010000:2.0:1787893152.185221:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787893152.185224:0:6506:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787893152.185348:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+22:12477:x1874741481809792:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 Request processed in 467us (4387us total) trans 4294967510 rc 0/0 00000100:00100000:2.0:1787893152.185355:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 245 00000100:00100000:1.0:1787893152.188583:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893152.188665:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481809920 00000100:00100000:3.0:1787893152.188682:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481809920 00000100:00100000:3.0:1787893152.188768:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 76 00000100:00100000:3.0:1787893152.188784:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58232959-285a-4954-a3ac-571a2b817017+7:2391:x1874741481809920:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787893152.189189:0:8535:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787893152.189194:0:8535:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1787893151 00002000:00010000:3.0:1787893152.189197:0:8535:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1787893151 00002000:00010000:3.0:1787893152.189199:0:8535:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1787893152 -> 1787893151 00002000:00010000:3.0:1787893152.189201:0:8535:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1787893152.189461:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58232959-285a-4954-a3ac-571a2b817017+8:2391:x1874741481809920:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 Request processed in 676us (892us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1787893152.189484:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 76 00000100:00100000:3.0:1787893152.203406:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893152.203539:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481810176 00000100:00100000:2.0:1787893152.203556:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481810176 00000100:00100000:2.0:1787893152.203657:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 246 00000100:00100000:2.0:1787893152.203669:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+22:12477:x1874741481810176:12345-192.168.202.35@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787893152.203749:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf1c3d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.203767:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf1bf7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faab3 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.203776:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf1c3d lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.203822:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf1bf7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faab3 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.203851:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf1bf7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faab3 expref: 22 pid: 6505 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893152.203867:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8468e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6504:1874741493393152:192.168.202.35@tcp:104: 00000100:00100000:2.0:1787893152.203966:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c63db240 going to sleep for 11 seconds 00000100:00100000:2.0:1787893152.206150:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8468e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6504:1874741493393152:192.168.202.35@tcp:104: 00010000:00010000:2.0:1787893152.206181:0:6504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf1c3d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893152.208109:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893152.208209:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481810304 00000100:00100000:1.0:1787893152.208219:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481810304 00010000:00010000:1.0:1787893152.208261:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf1bf7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faab3 expref: 23 pid: 6505 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893152.208319:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 101 00000100:00100000:1.0:1787893152.208330:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8507800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58232959-285a-4954-a3ac-571a2b817017+23:2391:x1874741481810304:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893152.208360:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893152.208368:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf1bf7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faab3 expref: 23 pid: 6505 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.208382:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf1bf7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faab3 expref: 23 pid: 6505 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.208405:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf1bf7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faab3 expref: 23 pid: 6505 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.208428:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fc8c6615b00) 00010000:00010000:1.0:1787893152.208434:0:6492:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf1c3d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.208444:0:6492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf1c3d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.208451:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf1c3d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.208481:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893152.208741:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8507800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58232959-285a-4954-a3ac-571a2b817017+22:2391:x1874741481810304:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 411us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893152.208750:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 101 00010000:00010000:2.0:1787893152.208916:0:6504:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf1c3d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.208925:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf1c3d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.208961:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf1c3d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.208969:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf1c3d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.208976:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf1c3d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.208982:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c147c200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893152.208986:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf1c3d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.209005:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf1c3d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.209016:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fc8c6615b00) 00010000:00010000:2.0:1787893152.209019:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787893152.209023:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf1c3d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.209029:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf1c3d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893152.209091:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+21:12477:x1874741481810176:12345-192.168.202.35@tcp:55:lhsmtool_posix.0 Request processed in 5425us (5702us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787893152.209099:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 246 00000100:00100000:3.0:1787893152.215454:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893152.215798:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481810432 00000100:00100000:0.0:1787893152.215824:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481810432 00000100:00100000:0.0:1787893152.215904:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 77 00000100:00100000:0.0:1787893152.215916:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58232959-285a-4954-a3ac-571a2b817017+8:2390:x1874741481810432:12345-192.168.202.35@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787893152.215962:0:8419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000aea44c4/0x9232577658cf1c44 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.215984:0:8419:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000078ad2a37/0x9232577658cf1c21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faacf expref: 8 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.215992:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787893152.215997:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787893152.216001:0:8419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000aea44c4/0x9232577658cf1c44 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.216056:0:8419:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000078ad2a37/0x9232577658cf1c21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faacf expref: 8 pid: 8535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.216071:0:8419:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000078ad2a37/0x9232577658cf1c21 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faacf expref: 8 pid: 8535 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893152.216086:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8419:1874741493393280:192.168.202.35@tcp:104: 00000100:00100000:0.0:1787893152.216198:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c4d87780 going to sleep for 11 seconds 00000100:00100000:0.0:1787893152.218852:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8419:1874741493393280:192.168.202.35@tcp:104: 00010000:00010000:0.0:1787893152.218880:0:8419:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000aea44c4/0x9232577658cf1c44 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893152.220702:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893152.220791:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481810560 00000100:00100000:2.0:1787893152.220815:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481810560 00010000:00010000:2.0:1787893152.220863:0:6490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000078ad2a37/0x9232577658cf1c21 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faacf expref: 9 pid: 8535 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893152.220904:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 102 00000100:00100000:2.0:1787893152.220915:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8507100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+9:2390:x1874741481810560:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787893152.220928:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893152.220948:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000078ad2a37/0x9232577658cf1c21 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faacf expref: 9 pid: 8535 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.220962:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000078ad2a37/0x9232577658cf1c21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faacf expref: 9 pid: 8535 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.221005:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078ad2a37/0x9232577658cf1c21 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faacf expref: 9 pid: 8535 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.221020:0:6490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787893152.221024:0:6490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787893152.221029:0:6490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000aea44c4/0x9232577658cf1c44 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.221038:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000aea44c4/0x9232577658cf1c44 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.221116:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893152.221187:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8507100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+8:2390:x1874741481810560:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 272us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893152.221194:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 102 00010000:00010000:0.0:1787893152.228275:0:8419:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000aea44c4/0x9232577658cf1c44 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.228297:0:8419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000aea44c4/0x9232577658cf1c44 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.228331:0:8419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000aea44c4/0x9232577658cf1c44 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.228341:0:8419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000aea44c4/0x9232577658cf1c44 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.228373:0:8419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000aea44c4/0x9232577658cf1c44 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.228381:0:8419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd69da00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893152.228386:0:8419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000aea44c4/0x9232577658cf1c44 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.228395:0:8419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000aea44c4/0x9232577658cf1c44 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.228416:0:8419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000aea44c4/0x9232577658cf1c44 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.228423:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000aea44c4/0x9232577658cf1c44 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893152.230823:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58232959-285a-4954-a3ac-571a2b817017+7:2390:x1874741481810432:12345-192.168.202.35@tcp:1:lhsmtool_posix.0 Request processed in 14888us (15362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893152.230839:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 77 00000100:00100000:3.0:1787893152.233621:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893152.234050:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481810816 00000100:00100000:2.0:1787893152.234068:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481810816 00000100:00100000:2.0:1787893152.234150:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 247 00000100:00100000:2.0:1787893152.234161:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+21:12477:x1874741481810816:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787893152.234242:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf1c4b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.234260:0:13436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf1b3a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa7b expref: 21 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.234269:0:13436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf1c4b lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.234321:0:13436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf1b3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa7b expref: 21 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.234336:0:13436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf1b3a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa7b expref: 21 pid: 13436 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893152.234351:0:13436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8468e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13436:1874741493393408:192.168.202.35@tcp:104: 00000100:00100000:2.0:1787893152.234447:0:13436:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c63db240 going to sleep for 11 seconds 00000100:00100000:3.0:1787893152.240459:0:13436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8468e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13436:1874741493393408:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787893152.240532:0:13436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf1c4b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893152.241050:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893152.241145:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481810944 00000100:00100000:1.0:1787893152.241155:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481810944 00010000:00010000:1.0:1787893152.241197:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf1b3a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa7b expref: 22 pid: 13436 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893152.241265:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 103 00000100:00100000:1.0:1787893152.241274:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c846a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58232959-285a-4954-a3ac-571a2b817017+22:2391:x1874741481810944:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893152.241406:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893152.241416:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf1b3a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa7b expref: 22 pid: 13436 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.241429:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf1b3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa7b expref: 22 pid: 13436 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.241453:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf1b3a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa7b expref: 22 pid: 13436 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.241485:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc8c6615800) 00010000:00010000:1.0:1787893152.241687:0:6492:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6400/0x9232577658cf1b9c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa9e expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.241698:0:6492:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf1c4b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.241706:0:6492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf1c4b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.241713:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf1c4b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893152.241740:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893152.241849:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c846a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58232959-285a-4954-a3ac-571a2b817017+21:2391:x1874741481810944:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 576us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893152.241864:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 103 00010000:00010000:3.0:1787893152.242173:0:13436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf1c4b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.242187:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf1c4b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.242471:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1c52 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.242516:0:13436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf1c05 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faaba expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.242527:0:13436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1c52 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.242580:0:13436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf1c05 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faaba expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.242599:0:13436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf1c05 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faaba expref: 21 pid: 6504 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893152.242618:0:13436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8504700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13436:1874741493393536:192.168.202.35@tcp:104: 00000100:00100000:3.0:1787893152.242726:0:13436:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d7e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787893152.255621:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893152.256114:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481811072 00000100:00100000:0.0:1787893152.256128:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481811072 00010000:00010000:0.0:1787893152.256188:0:6490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf1c05 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faaba expref: 22 pid: 6504 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893152.256242:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 104 00000100:00100000:0.0:1787893152.256285:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8468e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+22:2390:x1874741481811072:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893152.256305:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893152.256315:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf1c05 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faaba expref: 22 pid: 6504 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.256331:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf1c05 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faaba expref: 22 pid: 6504 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.256359:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fc8c6615b00) 00010000:00010000:0.0:1787893152.256366:0:6490:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1c52 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.256377:0:6490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1c52 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.256386:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1c52 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.256410:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893152.256482:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8468e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+22:2390:x1874741481811072:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 199us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893152.256519:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 104 00010000:00010000:3.0:1787893152.258627:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf1c05 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faaba expref: 21 pid: 6504 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893152.258772:0:13436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8504700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13436:1874741493393536:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787893152.258814:0:13436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1c52 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.259034:0:13436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1c52 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.259044:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1c52 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787893152.259203:0:13436:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:2.0:1787893152.259424:0:13436:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000001:00080000:2.0:1787893152.259466:0:13436:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:2.0:1787893152.260787:0:13436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8468000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:13436:1874741493393664:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787893152.260893:0:13436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893152.261138:0:13436:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9eee58780 going to sleep for 11 seconds 00000100:00100000:3.0:1787893152.263613:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493393664 00000100:00100000:3.0:1787893152.263636:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493393664 00000100:00100000:2.0:1787893152.264001:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787893152.264014:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7789180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:13436:x1874741493393664:12345-0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787893152.264221:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7789180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:13436:x1874741493393664:12345-0@lo:1000:mdt00_005.0 Request processed in 208us (3328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893152.264229:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787893152.264455:0:13436:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967318 gen 2 00000004:00080000:3.0:1787893152.264471:0:13436:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967318 00000100:00100000:3.0:1787893152.264558:0:13436:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9fc9d29faa00 x1874741493392896/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787893168 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893152.264576:0:13436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8468000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:13436:1874741493393664:0@lo:1000:mdt00_005.0 00000001:00080000:3.0:1787893152.264789:0:13436:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00000100:00100000:3.0:1787893152.264902:0:13436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8504700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:13436:1874741493393792:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1787893152.264970:0:13436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893152.264993:0:13436:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d7ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787893152.265204:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493393792 00000100:00100000:1.0:1787893152.265210:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493393792 00000100:00100000:1.0:1787893152.265254:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787893152.265276:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:13436:x1874741493393792:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1787893152.265418:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:13436:x1874741493393792:12345-0@lo:1000:mdt00_005.0 Request processed in 153us (447us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1787893152.265425:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787893152.265627:0:13436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8504700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:13436:1874741493393792:0@lo:1000:mdt00_005.0 00010000:00010000:3.0:1787893152.265678:0:13436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1c52 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.265691:0:13436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1c52 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.265700:0:13436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1c52 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.265707:0:13436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c84f7a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893152.265712:0:13436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1c52 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.265721:0:13436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1c52 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.265741:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fc8c6615b00) 00010000:00010000:3.0:1787893152.265745:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787893152.265751:0:13436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1c52 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.265774:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1c52 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.265815:0:13436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f200/0x9232577658cf1b95 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.265822:0:13436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f200/0x9232577658cf1b95 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.265828:0:13436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f200/0x9232577658cf1b95 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.265833:0:13436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7f200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893152.265837:0:13436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f200/0x9232577658cf1b95 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.265843:0:13436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f200/0x9232577658cf1b95 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.265853:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc8c6615800) 00010000:00010000:3.0:1787893152.265855:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787893152.265864:0:13436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6400/0x9232577658cf1b9c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa9e expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.265877:0:13436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6400/0x9232577658cf1b9c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa9e expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.265887:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6400/0x9232577658cf1b9c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa9e expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.265943:0:13436:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6400/0x9232577658cf1b9c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa9e expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893152.265956:0:13436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8507480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13436:1874741493393920:192.168.202.35@tcp:105: 00000100:00100000:3.0:1787893152.266043:0:13436:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c63db240 going to sleep for 11 seconds 00000100:00100000:3.0:1787893152.270011:0:13436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8507480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13436:1874741493393920:192.168.202.35@tcp:105: 00010000:00010000:3.0:1787893152.270055:0:13436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f200/0x9232577658cf1b95 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.270068:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f200/0x9232577658cf1b95 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.270112:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6600/0x9232577658cf1c59 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.270131:0:13436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6600/0x9232577658cf1c59 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.270145:0:13436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6600/0x9232577658cf1c59 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.270159:0:13436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6600/0x9232577658cf1c59 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.270166:0:13436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6600/0x9232577658cf1c59 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.270173:0:13436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6600/0x9232577658cf1c59 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.270201:0:13436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c84f6600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893152.270205:0:13436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6600/0x9232577658cf1c59 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.270213:0:13436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6600/0x9232577658cf1c59 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.270228:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc8c6615800) 00010000:00010000:3.0:1787893152.270231:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893152.270234:0:13436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6600/0x9232577658cf1c59 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.270240:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6600/0x9232577658cf1c59 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.270252:0:13436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf1c4b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.270258:0:13436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf1c4b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893152.270576:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00010000:00010000:3.0:1787893152.270856:0:13436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf1c4b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.270865:0:13436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c147cc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893152.270869:0:13436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf1c4b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.270876:0:13436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf1c4b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.270899:0:13436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc8c6615800) 00010000:00010000:3.0:1787893152.270902:0:13436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787893152.270905:0:13436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf1c4b lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.270910:0:13436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf1c4b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13436 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893152.271136:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+24:12477:x1874741481810816:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 Request processed in 36973us (37529us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1787893152.271147:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 247 00000020:00080000:3.0:1787893152.271155:0:13436:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787893152.272239:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787893152.272248:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787893152.272286:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1787893152.272294:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787893152.276530:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481811200 00000100:00100000:0.0:1787893152.276555:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481811200 00000100:00100000:1.0:1787893152.276721:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 61 00000100:00100000:1.0:1787893152.276735:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7789500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+24:12476:x1874741481811200:12345-192.168.202.35@tcp:49:lfs.0 00000100:00100000:1.0:1787893152.276949:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7789500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+24:12476:x1874741481811200:12345-192.168.202.35@tcp:49:lfs.0 Request processed in 217us (6375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893152.276958:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 61 00000100:00100000:0.0:1787893152.277132:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893152.277643:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481811456 00000100:00100000:3.0:1787893152.277651:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481811456 00000100:00100000:3.0:1787893152.277696:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 62 00000100:00100000:3.0:1787893152.277704:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fedc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+24:12477:x1874741481811456:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787893152.278039:0:6508:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787893152.278081:0:6508:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967516 00010000:00010000:3.0:1787893152.278122:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6e00/0x9232577658cf1c60 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.278142:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6e00/0x9232577658cf1c60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.278156:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6e00/0x9232577658cf1c60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.278165:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6e00/0x9232577658cf1c60 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.278195:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6e00/0x9232577658cf1c60 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.278202:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6e00/0x9232577658cf1c60 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.278221:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787893152.278646:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893152.278654:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6e00/0x9232577658cf1c60 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.278663:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c84f6e00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893152.278680:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6e00/0x9232577658cf1c60 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.278688:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6e00/0x9232577658cf1c60 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.278705:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fc8c6615b00) 00010000:00010000:0.0:1787893152.278709:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787893152.278713:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6e00/0x9232577658cf1c60 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.278720:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6e00/0x9232577658cf1c60 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.278737:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893152.278739:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893152.278741:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893152.278935:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fedc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+26:12477:x1874741481811456:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 Request processed in 1227us (1799us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1787893152.278946:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 62 00000020:00080000:3.0:1787893152.278953:0:6508:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787893152.282312:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893152.283356:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481811712 00000100:00100000:1.0:1787893152.283374:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481811712 00000100:00100000:1.0:1787893152.283462:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 248 00000100:00100000:1.0:1787893152.283475:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c778bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+26:12476:x1874741481811712:12345-192.168.202.35@tcp:58:lfs.0 00000040:00080000:1.0:1787893152.283763:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1787893152.284352:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c778bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+26:12476:x1874741481811712:12345-192.168.202.35@tcp:58:lfs.0 Request processed in 876us (2053us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893152.284361:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 248 00000100:00100000:0.0:1787893152.333352:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893152.333550:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481811840 00000100:00100000:3.0:1787893152.333565:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481811840 00000100:00100000:3.0:1787893152.333642:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 249 00000100:00100000:3.0:1787893152.333654:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+26:12479:x1874741481811840:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:3.0:1787893152.333684:0:9515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893152.333711:0:9515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6600/0x9232577658cf1c67 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62faad6 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.333795:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1c6e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.333824:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1c6e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.333838:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1c6e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.333857:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7800/0x9232577658cf1c75 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.333883:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7800/0x9232577658cf1c75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.333891:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7800/0x9232577658cf1c75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.334008:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6800/0x9232577658cf1c7c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.334021:0:9515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1b87 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa97 expref: 27 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.334030:0:9515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6800/0x9232577658cf1c7c lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.334076:0:9515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1b87 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa97 expref: 27 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893152.334092:0:9515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1b87 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa97 expref: 27 pid: 6505 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893152.334109:0:9515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8506680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9515:1874741493394048:192.168.202.35@tcp:104: 00000100:00100000:3.0:1787893152.334425:0:9515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c63db9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787893152.337694:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893152.337793:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481812096 00000100:00100000:0.0:1787893152.337815:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481812096 00000100:00100000:0.0:1787893152.337891:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 63 00000100:00100000:0.0:1787893152.337904:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+28:6163:x1874741481812096:12345-192.168.202.35@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787893152.338227:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+29:6163:x1874741481812096:12345-192.168.202.35@tcp:35:ldlm_bl.0 Request processed in 326us (546us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1787893152.338236:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 63 00000100:00100000:2.0:1787893152.339771:0:9515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8506680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9515:1874741493394048:192.168.202.35@tcp:104: 00000100:00100000:1.0:1787893152.342660:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00010000:00010000:2.0:1787893152.345208:0:9515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6800/0x9232577658cf1c7c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893152.345430:0:10383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481812224 00000100:00100000:0.0:1787893152.345446:0:10383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481812224 00010000:00010000:0.0:1787893152.345540:0:10383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1b87 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa97 expref: 29 pid: 6505 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893152.345618:0:10383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 105 00000100:00100000:0.0:1787893152.345632:0:10383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3eff850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58232959-285a-4954-a3ac-571a2b817017+29:2390:x1874741481812224:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893152.345655:0:10383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893152.345665:0:10383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1b87 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa97 expref: 29 pid: 6505 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.345682:0:10383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1b87 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa97 expref: 29 pid: 6505 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.345710:0:10383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf1b87 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa97 expref: 29 pid: 6505 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.345735:0:10383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc8c6615800) 00010000:00010000:0.0:1787893152.345742:0:10383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6800/0x9232577658cf1c7c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.345754:0:10383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6800/0x9232577658cf1c7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.345763:0:10383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6800/0x9232577658cf1c7c lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893152.345799:0:10383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893152.345894:0:10383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3eff850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58232959-285a-4954-a3ac-571a2b817017+28:2390:x1874741481812224:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 266us (3244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893152.345903:0:10383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 105 00010000:00010000:2.0:1787893152.346645:0:9515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6800/0x9232577658cf1c7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.346657:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6800/0x9232577658cf1c7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893152.346736:0:9515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787893152.346742:0:9515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787893152.346771:0:9515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6800/0x9232577658cf1c7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.346789:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6800/0x9232577658cf1c7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.346801:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1c6e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.346821:0:9515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1c6e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.346830:0:9515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1c6e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.346836:0:9515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c84f7a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893152.346842:0:9515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1c6e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.346868:0:9515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1c6e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.346884:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc9c3918700) 00010000:00010000:2.0:1787893152.346887:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893152.346891:0:9515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1c6e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.346899:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf1c6e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.346916:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7800/0x9232577658cf1c75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.346934:0:9515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7800/0x9232577658cf1c75 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.346940:0:9515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7800/0x9232577658cf1c75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.346946:0:9515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c84f7800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893152.346949:0:9515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7800/0x9232577658cf1c75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.346956:0:9515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7800/0x9232577658cf1c75 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.346965:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc8c7511e00) 00010000:00010000:2.0:1787893152.346969:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893152.346972:0:9515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7800/0x9232577658cf1c75 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.346993:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7800/0x9232577658cf1c75 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.347049:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6600/0x9232577658cf1c67 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faad6 expref: 28 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.347065:0:9515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6800/0x9232577658cf1c7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faad6 expref: 27 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893152.347072:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc8c6615800) 00010000:00010000:2.0:1787893152.347074:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787893152.347077:0:9515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c84f6800, rc 0) 00000100:00100000:2.0:1787893152.347143:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58232959-285a-4954-a3ac-571a2b817017+27:12479:x1874741481811840:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 13491us (13808us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893152.347153:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 249 00000040:00080000:3.0:1787893152.372724:0:13789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787893152.436139:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893152.951154:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787893152.951181:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c778b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493394176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787893152.951273:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893152.951331:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493394176 00000100:00100000:2.0:1787893152.951340:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493394176 00000100:00100000:2.0:1787893152.951449:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787893152.951462:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3633:x1874741493394176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787893152.951487:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787893152.951588:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3633:x1874741493394176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893152.951596:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787893152.952458:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493394304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787893152.952564:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893152.952722:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c778b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493394176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787893152.952833:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493394304 00000100:00100000:1.0:1787893152.952839:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493394304 00000100:00100000:1.0:1787893152.952926:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787893152.952934:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c778b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493394304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787893152.952950:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787893152.952993:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c778b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493394304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893152.953000:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:2.0:1787893152.953039:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787893152.953135:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493394304:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1787893153.335682:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787893153.335692:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787893153.335735:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787893153.335743:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787893153.335895:0:13786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8506300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13786:1874741493394432:192.168.202.35@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787893153.335993:0:13786:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c63db3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787893153.338368:0:13786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8506300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13786:1874741493394432:192.168.202.35@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787893153.343949:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893153.344090:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481812352 00000100:00100000:1.0:1787893153.344100:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481812352 00000100:00100000:1.0:1787893153.344161:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 250 00000100:00100000:1.0:1787893153.344172:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+27:12491:x1874741481812352:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787893153.344204:0:10086:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787893153.344344:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+27:12491:x1874741481812352:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 Request processed in 165us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893153.344352:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 250 00000100:00100000:3.0:1787893153.362059:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893153.362303:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481812608 00000100:00100000:0.0:1787893153.362314:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481812608 00000100:00100000:0.0:1787893153.362376:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 251 00000100:00100000:0.0:1787893153.362386:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+27:12491:x1874741481812608:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787893153.362407:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893153.362430:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c600/0x9232577658cf1c83 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62faadd expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893153.362562:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf1c8a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893153.362576:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf1c8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893153.362589:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf1c8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893153.362601:0:6505:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787893153.362702:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c600/0x9232577658cf1c83 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faadd expref: 30 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893153.362722:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf1c8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faadd expref: 29 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893153.362730:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc8c6615800) 00010000:00010000:0.0:1787893153.362733:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787893153.362736:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9dd69da00, rc 0) 00000100:00100000:0.0:1787893153.362789:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+29:12491:x1874741481812608:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 405us (740us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1787893153.362821:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 251 00000100:00100000:3.0:1787893153.370704:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893153.370734:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893153.370840:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481812992 00000100:00100000:0.0:1787893153.370860:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481812992 00000100:00100000:0.0:1787893153.370929:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 20 00000100:00100000:0.0:1787893153.370949:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8507800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+29:2391:x1874741481812992:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893153.370963:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893153.370988:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf1c8a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faadd expref: 29 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893153.371009:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc8c6615800) 00010000:00010000:0.0:1787893153.371014:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893153.371072:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8507800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58232959-285a-4954-a3ac-571a2b817017+28:2391:x1874741481812992:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 135us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893153.371080:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 20 00000100:00100000:2.0:1787893153.371462:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481812864 00000100:00100000:2.0:1787893153.371468:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481812864 00000100:00100000:2.0:1787893153.371537:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 252 00000100:00100000:2.0:1787893153.371545:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+28:12491:x1874741481812864:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787893153.371611:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf1c98 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893153.371624:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf1c98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893153.371635:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf1c98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893153.371812:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf1c98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893153.371821:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf1c98 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893153.371828:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf1c98 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893153.371834:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c147cc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893153.371838:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf1c98 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893153.371853:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf1c98 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893153.371874:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc8c6615800) 00010000:00010000:2.0:1787893153.371876:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787893153.371880:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf1c98 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893153.371886:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf1c98 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893153.371981:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58232959-285a-4954-a3ac-571a2b817017+29:12491:x1874741481812864:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 Request processed in 437us (1288us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1787893153.371988:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 252 00000040:00080000:0.0:1787893153.372925:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787893153.372932:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787893153.374707:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787893153.374724:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787893153.385845:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000040:00080000:3.0:1787893153.385900:0:14799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787893153.385905:0:14799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1787893153.386072:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481813248 00000100:00100000:0.0:1787893153.386083:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481813248 00000100:00100000:0.0:1787893153.386142:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 64 00000100:00100000:0.0:1787893153.386153:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+29:12491:x1874741481813248:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 00000040:00080000:3.0:1787893153.386213:0:14799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787893153.386221:0:14799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787893153.386777:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:58232959-285a-4954-a3ac-571a2b817017+30:12491:x1874741481813248:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 Request processed in 625us (939us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1787893153.386785:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 64 00010000:00010000:0.0:1787893153.457881:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893153.590852:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893153.590943:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481813504 00000100:00100000:1.0:1787893153.590955:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481813504 00000100:00100000:1.0:1787893153.591017:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 253 00000100:00100000:1.0:1787893153.591028:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c778b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+30:12504:x1874741481813504:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:1.0:1787893153.591053:0:10086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893153.591075:0:10086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1c9f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62faae4 expref: -99 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893153.591198:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf1ca6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893153.591213:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf1ca6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893153.591226:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf1ca6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893153.591238:0:10086:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787893153.591366:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf1c9f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faae4 expref: 33 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893153.591383:0:10086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf1ca6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faae4 expref: 32 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893153.591391:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc8c6615800) 00010000:00010000:1.0:1787893153.591395:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787893153.591398:0:10086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe541c00, rc 0) 00000100:00100000:1.0:1787893153.591465:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c778b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+32:12504:x1874741481813504:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 438us (625us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1787893153.591473:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 253 00000100:00100000:1.0:1787893153.595140:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893153.599214:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481813632 00000100:00100000:0.0:1787893153.599229:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481813632 00000100:00100000:1.0:1787893153.599383:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 254 00000100:00100000:1.0:1787893153.599394:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+32:12504:x1874741481813632:12345-192.168.202.35@tcp:54:lfs.0 00010000:00010000:1.0:1787893153.599465:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf1cb4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893153.599530:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf1cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893153.599543:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf1cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893153.599580:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf1cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893153.599588:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf1cb4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893153.599594:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf1cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893153.599600:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893153.599604:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf1cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893153.599611:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf1cb4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893153.599621:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc8c6615800) 00010000:00010000:1.0:1787893153.599625:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787893153.599629:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf1cb4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893153.599635:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540600/0x9232577658cf1cb4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6505 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893153.599722:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+32:12504:x1874741481813632:12345-192.168.202.35@tcp:54:lfs.0 Request processed in 328us (4590us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893153.599747:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 254 00000100:00100000:2.0:1787893153.745151:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893153.745339:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481813760 00000100:00100000:1.0:1787893153.745349:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481813760 00000100:00100000:1.0:1787893153.745413:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 78 00000100:00100000:1.0:1787893153.745424:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58232959-285a-4954-a3ac-571a2b817017+7:2391:x1874741481813760:12345-192.168.202.35@tcp:101:cat.0 00010000:00010000:1.0:1787893153.745442:0:8421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893153.745460:0:8421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060f5eadb/0x9232577658cf1cbb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62faaeb expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787893153.745483:0:8421:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a91159f, atime: 0x6a91159f, ctime: 0x6a91159f, blocks: 0x8 00010000:00010000:1.0:1787893153.745541:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=397s v=(0 0) 00010000:00010000:1.0:1787893153.745546:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893153.745556:0:8421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060f5eadb/0x9232577658cf1cbb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faaeb expref: 8 pid: 8421 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893153.745573:0:8421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000060f5eadb/0x9232577658cf1cbb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faaeb expref: 8 pid: 8421 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893153.745587:0:8421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe540600, rc 0) 00000100:00100000:1.0:1787893153.745641:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58232959-285a-4954-a3ac-571a2b817017+8:2391:x1874741481813760:12345-192.168.202.35@tcp:101:cat.0 Request processed in 219us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893153.745648:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 78 00000100:00100000:3.0:1787893153.749596:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893153.749663:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481813888 00000100:00100000:2.0:1787893153.749673:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481813888 00002000:00100000:2.0:1787893153.749721:0:8424:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff9fc8c8506680 x1874741481813888/t0(0) o3->58232959-285a-4954-a3ac-571a2b817017@192.168.202.35@tcp:314/0 lens 488/0 e 0 to 0 dl 1787893164 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787893153.749733:0:8424:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc8c8506680 with x1874741481813888 ext(0->4095) 00002000:00010000:2.0:1787893153.749738:0:8424:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fc8c8506680 00000100:00100000:2.0:1787893153.750069:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 7 00000100:00100000:2.0:1787893153.750079:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8506680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:58232959-285a-4954-a3ac-571a2b817017+8:2390:x1874741481813888:12345-192.168.202.35@tcp:3:cat.0 00000100:00100000:2.0:1787893153.750255:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8506680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:58232959-285a-4954-a3ac-571a2b817017+8:2390:x1874741481813888:12345-192.168.202.35@tcp:3:cat.0 Request processed in 177us (668us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787893153.750263:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 7 00002000:00100000:2.0:1787893153.750270:0:8424:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff9fc8c8506680 x1874741481813888/t0(0) o3->58232959-285a-4954-a3ac-571a2b817017@192.168.202.35@tcp:314/0 lens 488/4536 e 0 to 0 dl 1787893164 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787893153.750295:0:8424:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc8c8506680 with x1874741481813888 ext(0->4095) 00002000:00010000:2.0:1787893153.750299:0:8424:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fc8c8506680 00010000:00010000:0.0:1787893154.481749:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893154.482592:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787893154.482618:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493394560:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787893154.482699:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893154.482855:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493394560 00000100:00100000:0.0:1787893154.482864:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493394560 00000100:00100000:0.0:1787893154.482928:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787893154.482937:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c42050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493394560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787893154.482971:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787893154.483032:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c42050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493394560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893154.483039:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787893154.483691:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493394560:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787893155.506898:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893155.507136:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c778b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493394688:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787893155.507207:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893155.507387:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493394688 00000100:00100000:2.0:1787893155.507396:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493394688 00000100:00100000:2.0:1787893155.507453:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787893155.507462:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493394688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787893155.507535:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1787893155.507587:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493394688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893155.507594:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1787893155.507693:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c778b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493394688:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787893156.017904:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493394816:0@lo:400:kworker.0 00000100:00100000:2.0:1787893156.018011:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893156.018080:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493395328:0@lo:400:kworker.0 00000100:00100000:2.0:1787893156.018111:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893156.018146:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1874741493395840:0@lo:400:kworker.0 00000100:00100000:2.0:1787893156.018166:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893156.018193:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787893156.018199:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493394944:0@lo:400:kworker.0 00000100:00100000:2.0:1787893156.018219:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893156.018248:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493395456:0@lo:400:kworker.0 00000100:00100000:2.0:1787893156.018268:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893156.018282:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493395968:0@lo:400:kworker.0 00000100:00100000:2.0:1787893156.018298:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893156.018326:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493395328 00000100:00100000:2.0:1787893156.018348:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493395328 00000100:00100000:2.0:1787893156.018396:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493395840 00000100:00100000:2.0:1787893156.018399:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493395840 00000100:00100000:2.0:1787893156.018411:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493394944 00000100:00100000:2.0:1787893156.018413:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493394944 00000100:00100000:2.0:1787893156.018421:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493395456 00000100:00100000:2.0:1787893156.018424:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493395456 00000100:00100000:2.0:1787893156.018433:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493395968 00000100:00100000:2.0:1787893156.018435:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493395968 00000100:00100000:2.0:1787893156.018448:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1787893156.018456:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7788a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493395328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893156.018545:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7788a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493395328:12345-0@lo:400:kworker.0 Request processed in 89us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893156.018552:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1787893156.018571:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1787893156.018577:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7788380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1874741493395840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893156.018605:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7788380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1874741493395840:12345-0@lo:400:kworker.0 Request processed in 29us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893156.018610:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1787893156.018622:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1787893156.018628:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c778a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493394944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893156.018653:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c778a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493394944:12345-0@lo:400:kworker.0 Request processed in 25us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893156.018659:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1787893156.018670:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1787893156.018676:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c778a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493395456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893156.018703:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c778a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493395456:12345-0@lo:400:kworker.0 Request processed in 27us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893156.018720:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1787893156.018732:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1787893156.018738:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7789f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493395968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893156.018765:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7789f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493395968:12345-0@lo:400:kworker.0 Request processed in 28us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893156.018779:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00080000:2.0:1787893156.018799:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787893156.018803:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787893156.018833:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493394944:0@lo:400:kworker.0 00010000:00080000:2.0:1787893156.018845:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c843f800 x1874741493395456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893156.018854:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493395456:0@lo:400:kworker.0 00010000:00080000:2.0:1787893156.018864:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7cd5f80 x1874741493395968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893156.018871:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493395968:0@lo:400:kworker.0 00000100:00100000:2.0:1787893156.018879:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493395328:0@lo:400:kworker.0 00000100:00100000:2.0:1787893156.018889:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1874741493395840:0@lo:400:kworker.0 00000100:00100000:0.0:1787893156.019367:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493394816 00000100:00100000:0.0:1787893156.019374:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493394816 00000100:00100000:0.0:1787893156.019421:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1787893156.019429:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+24:3632:x1874741493394816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893156.019514:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ad7764-cf95-4087-88aa-57e4229a8397+24:3632:x1874741493394816:12345-0@lo:400:kworker.0 Request processed in 60us (1478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893156.019521:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1787893156.019658:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493395200:0@lo:400:kworker.0 00000100:00100000:1.0:1787893156.019719:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893156.019744:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493395712:0@lo:400:kworker.0 00000100:00100000:1.0:1787893156.019767:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893156.019794:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7cd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493396224:0@lo:400:kworker.0 00000100:00100000:1.0:1787893156.019813:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893156.019828:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787893156.019833:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1874741493395072:0@lo:400:kworker.0 00000100:00100000:1.0:1787893156.019850:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893156.019863:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493395584:0@lo:400:kworker.0 00000100:00100000:1.0:1787893156.019878:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893156.019891:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493396096:0@lo:400:kworker.0 00000100:00100000:1.0:1787893156.019908:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893156.019933:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493395200 00000100:00100000:1.0:1787893156.019937:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493395200 00000100:00100000:1.0:1787893156.019978:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1787893156.019984:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493395200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893156.020017:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493395200:12345-0@lo:400:kworker.0 Request processed in 34us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893156.020022:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1787893156.020048:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493395712 00000100:00100000:1.0:1787893156.020051:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493395712 00000100:00100000:1.0:1787893156.020075:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493396224 00000100:00100000:1.0:1787893156.020077:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493396224 00000100:00100000:1.0:1787893156.020086:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493395584 00000100:00100000:1.0:1787893156.020089:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493395584 00000100:00100000:1.0:1787893156.020098:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493396096 00000100:00100000:1.0:1787893156.020100:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493396096 00000100:00100000:1.0:1787893156.020110:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787893156.020115:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3631:x1874741493395712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893156.020331:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3631:x1874741493395712:12345-0@lo:400:kworker.0 Request processed in 215us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893156.020338:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787893156.020350:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787893156.020356:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3631:x1874741493396224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893156.020383:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3631:x1874741493396224:12345-0@lo:400:kworker.0 Request processed in 27us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893156.020388:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787893156.020398:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787893156.020405:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493395584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893156.020429:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493395584:12345-0@lo:400:kworker.0 Request processed in 24us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893156.020434:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787893156.020444:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787893156.020450:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493396096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893156.020473:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493396096:12345-0@lo:400:kworker.0 Request processed in 24us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893156.020487:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:1.0:1787893156.020551:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787893156.020554:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787893156.020580:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493395072 00000100:00100000:1.0:1787893156.020584:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493395072 00000100:00100000:1.0:1787893156.020609:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1787893156.020615:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1874741493395072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893156.020645:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1874741493395072:12345-0@lo:400:kworker.0 Request processed in 31us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893156.020651:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1787893156.020683:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1874741493395072:0@lo:400:kworker.0 00000100:00100000:1.0:1787893156.020694:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493395584:0@lo:400:kworker.0 00000100:00100000:1.0:1787893156.020703:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493396096:0@lo:400:kworker.0 00000100:00100000:1.0:1787893156.020712:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493395200:0@lo:400:kworker.0 00000100:00100000:1.0:1787893156.020721:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493395712:0@lo:400:kworker.0 00000100:00100000:1.0:1787893156.020731:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7cd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493396224:0@lo:400:kworker.0 00000100:00100000:2.0:1787893156.021373:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d29fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493396352:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787893156.021416:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893156.021462:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493394816:0@lo:400:kworker.0 00000100:00100000:0.0:1787893156.021605:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493396352 00000100:00100000:0.0:1787893156.021610:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493396352 00000100:00100000:0.0:1787893156.021650:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787893156.021660:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7789880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493396352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787893156.021684:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787893156.021734:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7789880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493396352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893156.021739:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000004:00080000:0.0:1787893156.021966:0:10004:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 399843473803ns, next at 400843463287ns, rc = 0 00000100:00100000:3.0:1787893156.022139:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7cd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493396480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787893156.022169:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893156.022385:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493396480 00000100:00100000:0.0:1787893156.022390:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493396480 00000100:00100000:0.0:1787893156.022425:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787893156.022431:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3633:x1874741493396480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787893156.022443:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787893156.022797:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3633:x1874741493396480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 365us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893156.022803:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787893156.022890:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d29fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493396352:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787893156.023093:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7cd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493396480:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787893156.531254:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893156.891639:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893156.891669:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893156.891693:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893156.891717:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893156.891735:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893156.891751:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893156.891783:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893156.891812:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481814528 00000100:00100000:3.0:1787893156.891820:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481814528 00000100:00100000:3.0:1787893156.891873:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481814400 00000100:00100000:3.0:1787893156.891876:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481814400 00000100:00100000:3.0:1787893156.891913:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 145 00000100:00100000:3.0:1787893156.891922:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c846a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+8:2393:x1874741481814528:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893156.891985:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c846a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+8:2393:x1874741481814528:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 64us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893156.891992:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 145 00000100:00100000:3.0:1787893156.892007:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 146 00000100:00100000:3.0:1787893156.892014:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8468380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+7:2393:x1874741481814400:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893156.892034:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8468380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+7:2393:x1874741481814400:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 22us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893156.892041:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 146 00000100:00100000:3.0:1787893156.892058:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481814272 00000100:00100000:3.0:1787893156.892062:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481814272 00000100:00100000:3.0:1787893156.892085:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481814784 00000100:00100000:3.0:1787893156.892087:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481814784 00000100:00100000:3.0:1787893156.892103:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481814144 00000100:00100000:3.0:1787893156.892106:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481814144 00000100:00100000:3.0:1787893156.892117:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481814656 00000100:00100000:3.0:1787893156.892119:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481814656 00000100:00100000:3.0:1787893156.892132:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 375 00000100:00100000:3.0:1787893156.892137:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+5:2393:x1874741481814272:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893156.892161:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+5:2393:x1874741481814272:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 24us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893156.892168:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 375 00000100:00100000:3.0:1787893156.892179:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 376 00000100:00100000:3.0:1787893156.892184:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c846a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2393:x1874741481814784:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893156.892203:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c846a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2393:x1874741481814784:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 20us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893156.892215:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 376 00000100:00100000:3.0:1787893156.892236:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 377 00000100:00100000:3.0:1787893156.892242:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8468e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+32:2393:x1874741481814144:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893156.892274:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8468e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+32:2393:x1874741481814144:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 32us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893156.892279:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 377 00000100:00100000:3.0:1787893156.892291:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 378 00000100:00100000:3.0:1787893156.892297:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2393:x1874741481814656:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893156.892317:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2393:x1874741481814656:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 21us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893156.892323:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 378 00000100:00080000:3.0:1787893156.892345:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787893156.892349:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787893156.892351:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787893156.892353:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787893156.892828:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481814016 00000100:00100000:1.0:1787893156.892834:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481814016 00000100:00100000:1.0:1787893156.892878:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 399 00000100:00100000:1.0:1787893156.892885:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2393:x1874741481814016:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893156.892922:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2393:x1874741481814016:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 38us (1294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893156.892939:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 399 00000001:00080000:3.0:1787893157.052729:0:8413:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:3.0:1787893157.052747:0:8413:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00010000:00010000:0.0:1787893157.554368:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893158.066686:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d15ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493396608:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787893158.066772:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893158.066922:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493396608 00000100:00100000:3.0:1787893158.066930:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493396608 00000100:00100000:3.0:1787893158.067008:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787893158.067017:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493396608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787893158.067044:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787893158.067086:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493396608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893158.067093:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:1.0:1787893158.067340:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787893158.067375:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d15ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493396608:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787893158.067549:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787893158.069091:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493396736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787893158.069154:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893158.069359:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493396736 00000100:00100000:3.0:1787893158.069367:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493396736 00000100:00100000:3.0:1787893158.069471:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787893158.069481:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493396736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787893158.069524:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787893158.069581:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493396736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893158.069588:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787893158.069672:0:3630:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1787893158.069693:0:3630:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:2.0:1787893158.069818:0:3630:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fc8c8506a00, transno 4294967311 00000100:00100000:2.0:1787893158.069836:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493396736:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1787893158.072373:0:9497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:2.0:1787893158.072388:0:9497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000004:00080000:3.0:1787893158.074910:0:6484:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000100:00100000:2.0:1787893158.075087:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c778aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493396864:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787893158.075169:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893158.075251:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493396864 00000100:00100000:2.0:1787893158.075258:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493396864 00000001:00080000:3.0:1787893158.075509:0:6484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:3.0:1787893158.075535:0:6484:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fc8c7d7e480 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1787893158.075539:0:6484:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fc9d26dbf00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fc8c7d7e3c0 00000020:00080000:3.0:1787893158.075541:0:6484:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fc9d26db200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fc9c6e78200 00000020:00080000:3.0:1787893158.075570:0:6484:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000100:00080000:1.0:1787893158.082659:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787893158.082695:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:1.0:1787893158.082721:0:6536:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1787893158.082817:0:6536:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:0.0:1787893158.084261:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147d600/0x9232577658cf1c36 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893158.084280:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147d600/0x9232577658cf1c36 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893158.084290:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147d600/0x9232577658cf1c36 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893158.084296:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c147d600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893158.084302:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147d600/0x9232577658cf1c36 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893158.084311:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147d600/0x9232577658cf1c36 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893158.084334:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fc8c6615b00) 00010000:00010000:0.0:1787893158.084337:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893158.084342:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147d600/0x9232577658cf1c36 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893158.084374:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147d600/0x9232577658cf1c36 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893158.087171:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787893158.087189:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c778b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493396864:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787893158.087631:0:8420:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1787893158.087635:0:8420:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1787893151 -> 1787893151 00002000:00010000:2.0:1787893158.087638:0:8420:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 1787893151 -> 1787893151 00002000:00010000:2.0:1787893158.087641:0:8420:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1787893151 -> 1787893151 00002000:00010000:2.0:1787893158.087643:0:8420:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1787893158.088302:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c778b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3632:x1874741493396864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1117us (13141us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1787893158.088311:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787893158.091560:0:3632:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1787893158.091574:0:3632:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fc9d29faa00, transno 4294967322 00000004:00080000:3.0:1787893158.091595:0:3632:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1787893158.091626:0:3632:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9fc8c778aa00 x1874741493396864/t4294967325(4294967325) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787893174 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1787893158.091639:0:3632:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fc8c778aa00/2, rc 0, transno 4294967325 00000100:00100000:3.0:1787893158.091644:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c778aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493396864:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1787893158.581779:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893159.268904:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893159.269084:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481814912 00000100:00100000:1.0:1787893159.269100:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481814912 00000100:00100000:1.0:1787893159.269220:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 255 00000100:00100000:1.0:1787893159.269235:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+18:12157:x1874741481814912:12345-192.168.202.35@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787893159.269388:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+18:12157:x1874741481814912:12345-192.168.202.35@tcp:60:lhsmtool_posix.0 Request processed in 157us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893159.269397:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 255 00000100:00080000:3.0:1787893159.269664:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787893159.280298:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893159.280391:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481815040 00000100:00100000:3.0:1787893159.280472:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481815040 00000100:00100000:3.0:1787893159.280598:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 256 00000100:00100000:3.0:1787893159.280612:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+5:12157:x1874741481815040:12345-192.168.202.35@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787893159.280787:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:58232959-285a-4954-a3ac-571a2b817017+5:12157:x1874741481815040:12345-192.168.202.35@tcp:60:lhsmtool_posix.0 Request processed in 178us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893159.280796:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 256 00000100:00080000:1.0:1787893159.281314:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787893159.288836:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893159.288943:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481815296 00000100:00100000:1.0:1787893159.288957:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481815296 00000100:00100000:1.0:1787893159.289107:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 65 00000100:00100000:1.0:1787893159.289120:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+18:12157:x1874741481815296:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787893159.289434:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+19:12157:x1874741481815296:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 Request processed in 316us (611us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1787893159.289442:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 65 00000100:00100000:0.0:1787893159.575217:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893159.579123:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481815424 00000100:00100000:2.0:1787893159.579147:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481815424 00000100:00100000:2.0:1787893159.579285:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 257 00000100:00100000:2.0:1787893159.579299:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:12962:x1874741481815424:12345-192.168.202.35@tcp:101:lsof.0 00010000:00010000:2.0:1787893159.579335:0:9515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893159.579364:0:9515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf1cc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62faaf2 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893159.579487:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf1cc9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893159.579525:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf1cc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893159.579543:0:9515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf1cc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893159.579862:0:9515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787893159.579867:0:9515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787893159.579897:0:9515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf1cc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893159.579930:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147c200/0x9232577658cf1cc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faaf2 expref: 7 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893159.579956:0:9515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf1cc9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faaf2 expref: 6 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893159.579967:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc8c6614400) 00010000:00010000:2.0:1787893159.579971:0:9515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787893159.579975:0:9515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9c147cc00, rc 0) 00000100:00100000:2.0:1787893159.580780:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c50492c-5fef-4e80-9bbb-0b2782d59443+6:12962:x1874741481815424:12345-192.168.202.35@tcp:101:lsof.0 Request processed in 1478us (5574us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893159.580792:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 257 00000100:00080000:1.0:1787893159.580897:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787893159.602004:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893159.602248:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787893159.602276:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d15ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493396992:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787893159.602374:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893159.602485:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493396992 00000100:00100000:3.0:1787893159.602518:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493396992 00000100:00100000:3.0:1787893159.602781:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1787893159.602794:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493396992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787893159.602839:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787893159.602896:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493396992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893159.602905:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1787893159.602960:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d15ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493396992:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787893160.628608:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7789180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493397120:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787893160.628739:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893160.628900:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493397120 00000100:00100000:2.0:1787893160.628912:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493397120 00000100:00100000:2.0:1787893160.629011:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787893160.629024:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493397120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787893160.629084:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1787893160.629148:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493397120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 127us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893160.629157:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1787893160.629248:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7789180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493397120:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787893160.629252:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893161.138144:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8469f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874741493397632:0@lo:400:kworker.0 00000100:00100000:0.0:1787893161.138247:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893161.138298:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7789180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874741493397504:0@lo:400:kworker.0 00000100:00100000:0.0:1787893161.138333:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493398144:0@lo:400:kworker.0 00000100:00100000:2.0:1787893161.138341:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893161.139074:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7cd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493397248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787893161.141945:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493397632 00000100:00100000:1.0:1787893161.141960:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493397632 00000100:00100000:1.0:1787893161.142034:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493397504 00000100:00100000:1.0:1787893161.142038:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493397504 00000100:00100000:1.0:1787893161.142135:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1787893161.142146:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874741493397632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893161.144828:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893161.144925:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493398656:0@lo:400:kworker.0 00000100:00100000:0.0:1787893161.144979:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893161.145063:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1874741493398016:0@lo:400:kworker.0 00000100:00100000:2.0:1787893161.145105:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893161.145130:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1874741493398528:0@lo:400:kworker.0 00000100:00100000:2.0:1787893161.145156:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893161.145183:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1787893161.145191:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7789500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493397376:0@lo:400:kworker.0 00000100:00100000:2.0:1787893161.145224:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893161.145248:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1874741493397888:0@lo:400:kworker.0 00000100:00100000:2.0:1787893161.145287:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893161.145300:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1874741493398400:0@lo:400:kworker.0 00000100:00100000:2.0:1787893161.145322:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893161.145346:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493398912:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787893161.145377:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893161.145426:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493397376 00000100:00100000:2.0:1787893161.145436:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493397376 00000100:00100000:2.0:1787893161.145534:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1787893161.145546:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+24:3633:x1874741493397376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893161.145599:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493398912 00000100:00100000:0.0:1787893161.145605:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493398912 00000100:00100000:2.0:1787893161.145640:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+24:3633:x1874741493397376:12345-0@lo:400:kworker.0 Request processed in 92us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893161.145649:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:0.0:1787893161.145657:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787893161.145667:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493398912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787893161.145698:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787893161.145743:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7789500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493397376:0@lo:400:kworker.0 00000100:00100000:0.0:1787893161.145755:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493398912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893161.145763:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787893161.145775:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493398912:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787893161.145791:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493398016 00000100:00100000:0.0:1787893161.145797:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493398016 00000100:00100000:0.0:1787893161.145822:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493398528 00000100:00100000:0.0:1787893161.145825:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493398528 00000100:00100000:0.0:1787893161.145838:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493397888 00000100:00100000:0.0:1787893161.145841:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493397888 00000100:00100000:0.0:1787893161.145854:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493398400 00000100:00100000:0.0:1787893161.145864:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493398400 00000100:00100000:0.0:1787893161.145886:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1787893161.145893:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1874741493397504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893161.145941:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1874741493397504:12345-0@lo:400:kworker.0 Request processed in 48us (7601us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893161.145949:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1787893161.145964:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1787893161.145971:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1874741493398016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893161.146001:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1874741493398016:12345-0@lo:400:kworker.0 Request processed in 31us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893161.146007:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1787893161.146019:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1787893161.146025:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1874741493398528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893161.146053:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1874741493398528:12345-0@lo:400:kworker.0 Request processed in 29us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893161.146060:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1787893161.146071:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1787893161.146077:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1874741493397888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893161.146105:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1874741493397888:12345-0@lo:400:kworker.0 Request processed in 29us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893161.146111:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1787893161.146123:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1787893161.146129:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1874741493398400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893161.146151:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1874741493398400:12345-0@lo:400:kworker.0 Request processed in 23us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893161.146166:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1787893161.147909:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493398144 00000100:00100000:2.0:1787893161.147924:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493398144 00000100:00100000:2.0:1787893161.147985:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493398656 00000100:00100000:2.0:1787893161.147987:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493398656 00000100:00100000:2.0:1787893161.148008:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787893161.148016:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493398144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893161.148195:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493398144:12345-0@lo:400:kworker.0 Request processed in 179us (3378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893161.148201:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787893161.148215:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787893161.148219:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493398656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893161.148241:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493398656:12345-0@lo:400:kworker.0 Request processed in 23us (3263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893161.148245:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787893161.148254:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893161.148373:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493397760:0@lo:400:kworker.0 00000100:00100000:3.0:1787893161.148415:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893161.148435:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493398272:0@lo:400:kworker.0 00000100:00100000:2.0:1787893161.148475:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493398144:0@lo:400:kworker.0 00000100:00100000:2.0:1787893161.148485:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493398656:0@lo:400:kworker.0 00000100:00100000:2.0:1787893161.148538:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1874741493397888:0@lo:400:kworker.0 00000100:00100000:2.0:1787893161.148548:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1874741493398400:0@lo:400:kworker.0 00000100:00100000:2.0:1787893161.148577:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7789180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874741493397504:0@lo:400:kworker.0 00010000:00080000:2.0:1787893161.148589:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c843ed80 x1874741493398016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893161.148598:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1874741493398016:0@lo:400:kworker.0 00010000:00080000:2.0:1787893161.148607:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c843d180 x1874741493398528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893161.148613:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1874741493398528:0@lo:400:kworker.0 00000100:00100000:2.0:1787893161.148687:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493397248 00000100:00100000:2.0:1787893161.148692:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493397248 00000100:00100000:2.0:1787893161.148741:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787893161.148749:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3631:x1874741493397248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787893161.148776:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787893161.148778:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893161.148805:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493398784:0@lo:400:kworker.0 00000100:00080000:0.0:1787893161.148855:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787893161.148863:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787893161.148866:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787893161.148870:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787893161.148894:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493398272 00000100:00100000:0.0:1787893161.148898:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493398272 00000100:00100000:0.0:1787893161.148930:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787893161.148937:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493398272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893161.149302:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3631:x1874741493397248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 553us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893161.149310:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787893161.149352:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493397760 00000100:00100000:2.0:1787893161.149357:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493397760 00000100:00100000:2.0:1787893161.149384:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787893161.149391:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493397760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893161.149442:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493397760:12345-0@lo:400:kworker.0 Request processed in 51us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893161.149449:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:2.0:1787893161.149530:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787893161.149572:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874741493397632:12345-0@lo:400:kworker.0 Request processed in 7425us (11325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893161.149581:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1787893161.149599:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8469f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874741493397632:0@lo:400:kworker.0 00000100:00100000:3.0:1787893161.149916:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893161.149981:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7cd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493397248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787893161.149994:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493397760:0@lo:400:kworker.0 00000100:00100000:0.0:1787893161.150544:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493398272:12345-0@lo:400:kworker.0 Request processed in 1603us (1764us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893161.150554:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787893161.150574:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493398784 00000100:00100000:0.0:1787893161.150578:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493398784 00000100:00100000:0.0:1787893161.150615:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787893161.150622:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3631:x1874741493398784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893161.150664:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3631:x1874741493398784:12345-0@lo:400:kworker.0 Request processed in 43us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893161.150671:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787893161.150813:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493398272:0@lo:400:kworker.0 00000100:00100000:3.0:1787893161.150826:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493398784:0@lo:400:kworker.0 00010000:00010000:1.0:1787893161.665610:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893162.011896:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893162.012014:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893162.012047:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893162.012121:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481815936 00000100:00100000:2.0:1787893162.012135:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481815936 00000100:00100000:2.0:1787893162.012241:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 151 00000100:00100000:2.0:1787893162.012253:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58232959-285a-4954-a3ac-571a2b817017+5:2393:x1874741481815936:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893162.012351:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58232959-285a-4954-a3ac-571a2b817017+5:2393:x1874741481815936:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 100us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893162.012360:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 151 00000100:00080000:1.0:1787893162.016000:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787893162.018660:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893162.018711:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893162.018867:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481815552 00000100:00100000:1.0:1787893162.018882:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481815552 00000100:00100000:1.0:1787893162.018952:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 401 00000100:00100000:1.0:1787893162.018963:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2393:x1874741481815552:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893162.019058:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2393:x1874741481815552:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 97us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893162.019066:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 401 00000100:00100000:0.0:1787893162.022728:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481815680 00000100:00100000:0.0:1787893162.022753:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481815680 00000100:00100000:0.0:1787893162.022877:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481816192 00000100:00100000:0.0:1787893162.022881:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481816192 00000100:00100000:0.0:1787893162.022939:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 385 00000100:00100000:0.0:1787893162.022952:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+19:2393:x1874741481815680:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893162.023110:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+19:2393:x1874741481815680:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 161us (11228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893162.023143:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 385 00000100:00100000:0.0:1787893162.023165:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 386 00000100:00100000:0.0:1787893162.023173:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c50492c-5fef-4e80-9bbb-0b2782d59443+6:2393:x1874741481816192:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893162.023402:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c50492c-5fef-4e80-9bbb-0b2782d59443+6:2393:x1874741481816192:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 229us (11354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893162.023410:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 386 00000100:00080000:1.0:1787893162.023879:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787893162.024385:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893162.024425:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893162.024628:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481815808 00000100:00100000:1.0:1787893162.024636:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481815808 00000100:00100000:1.0:1787893162.024731:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481816320 00000100:00100000:1.0:1787893162.024735:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481816320 00000100:00100000:1.0:1787893162.024761:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 387 00000100:00100000:1.0:1787893162.024771:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+5:2393:x1874741481815808:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893162.024837:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58232959-285a-4954-a3ac-571a2b817017+5:2393:x1874741481815808:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 67us (6125us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893162.024845:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 387 00000100:00100000:1.0:1787893162.024899:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 388 00000100:00100000:1.0:1787893162.024907:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2393:x1874741481816320:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893162.024936:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2393:x1874741481816320:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 30us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893162.024942:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 388 00000100:00100000:0.0:1787893162.025457:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481816064 00000100:00100000:0.0:1787893162.025465:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481816064 00000100:00100000:0.0:1787893162.025566:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 152 00000100:00100000:0.0:1787893162.025575:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58232959-285a-4954-a3ac-571a2b817017+7:2393:x1874741481816064:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893162.025622:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58232959-285a-4954-a3ac-571a2b817017+7:2393:x1874741481816064:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 49us (1244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893162.025630:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 152 00000100:00080000:3.0:1787893162.026585:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787893162.026593:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:3.0:1787893162.611451:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787893162.611464:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787893162.611612:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1787893162.611622:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1787893162.612905:0:13789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787893162.674797:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893163.191487:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d15c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493399040:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787893163.191627:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893163.191985:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493399168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787893163.192022:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893163.192063:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493399040 00000100:00100000:2.0:1787893163.192086:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493399040 00000100:00100000:2.0:1787893163.192147:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493399168 00000100:00100000:2.0:1787893163.192150:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493399168 00000100:00100000:2.0:1787893163.192168:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787893163.192177:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493399040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787893163.192214:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787893163.192265:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493399040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893163.192273:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787893163.192293:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787893163.192299:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493399168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787893163.192309:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787893163.192336:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493399168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893163.192342:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787893163.192386:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493399168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787893163.192434:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d15c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493399040:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787893163.193245:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1787893163.657600:0:14997:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 00:59:22 (1787893162) 00010000:00010000:1.0:1787893163.701815:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787893164.215285:0:6484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000020:00080000:1.0:1787893164.215306:0:6484:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1787893164.215331:0:6536:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1787893164.215343:0:6536:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:0.0:1787893164.215866:0:9497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00010000:00010000:3.0:1787893164.727033:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893164.727164:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787893164.727195:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493399296:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787893164.727287:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893164.727396:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493399296 00000100:00100000:0.0:1787893164.727406:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493399296 00000100:00100000:0.0:1787893164.727471:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787893164.727482:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493399296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787893164.727570:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787893164.727643:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493399296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 161us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893164.727651:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787893164.727721:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493399296:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787893165.745774:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d15cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493399424:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787893165.745878:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893165.746047:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493399424 00000100:00100000:3.0:1787893165.746056:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493399424 00000100:00100000:3.0:1787893165.746159:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787893165.746176:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493399424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787893165.746234:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1787893165.746306:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493399424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 135us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893165.746319:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787893165.746412:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d15cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493399424:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787893165.748067:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893166.257747:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493399552:0@lo:400:kworker.0 00000100:00100000:2.0:1787893166.257786:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493399680:0@lo:400:kworker.0 00000100:00100000:3.0:1787893166.257828:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893166.257833:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893166.257905:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493399936:0@lo:400:kworker.0 00000100:00100000:0.0:1787893166.257937:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893166.257990:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493400064:0@lo:400:kworker.0 00000100:00100000:3.0:1787893166.258015:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893166.258045:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493400576:0@lo:400:kworker.0 00000100:00100000:3.0:1787893166.258070:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893166.258089:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493401088:0@lo:400:kworker.0 00000100:00100000:3.0:1787893166.258108:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893166.258154:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493399552 00000100:00100000:3.0:1787893166.258161:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493399552 00000100:00100000:3.0:1787893166.258208:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:1.0:1787893166.258208:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493400576 00000100:00100000:1.0:1787893166.258215:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493400576 00000100:00100000:3.0:1787893166.258220:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+24:3633:x1874741493399552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893166.258257:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493401088 00000100:00100000:1.0:1787893166.258261:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493401088 00000100:00100000:3.0:1787893166.258275:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+24:3633:x1874741493399552:12345-0@lo:400:kworker.0 Request processed in 57us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893166.258286:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:1.0:1787893166.258287:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787893166.258298:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493400576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893166.258324:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493399808:0@lo:400:kworker.0 00000100:00100000:1.0:1787893166.258343:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493400576:12345-0@lo:400:kworker.0 Request processed in 46us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893166.258356:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893166.258367:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787893166.258377:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1874741493400320:0@lo:400:kworker.0 00000100:00100000:1.0:1787893166.258385:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787893166.258393:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493401088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893166.258401:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893166.258433:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8469f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1874741493400832:0@lo:400:kworker.0 00000100:00100000:1.0:1787893166.258436:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493401088:12345-0@lo:400:kworker.0 Request processed in 43us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893166.258445:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:1.0:1787893166.258463:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787893166.258468:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787893166.258479:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493399680 00000100:00100000:3.0:1787893166.258481:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893166.258484:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493399680 00000100:00100000:1.0:1787893166.258533:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493399936 00000100:00100000:3.0:1787893166.258534:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787893166.258537:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493399936 00000100:00100000:3.0:1787893166.258543:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7525c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493401216:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787893166.258555:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493400320 00000100:00100000:1.0:1787893166.258559:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493400320 00000100:00100000:3.0:1787893166.258571:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893166.258578:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493400832 00000100:00100000:1.0:1787893166.258581:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493400832 00000100:00100000:1.0:1787893166.258600:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1787893166.258607:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493399680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893166.258609:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493400064 00000100:00100000:3.0:1787893166.258615:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493400064 00000100:00100000:3.0:1787893166.258644:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493399808 00000100:00100000:1.0:1787893166.258648:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493399680:12345-0@lo:400:kworker.0 Request processed in 39us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893166.258649:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493399808 00000100:00100000:1.0:1787893166.258658:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1787893166.258671:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787893166.258691:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1787893166.258693:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493400064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893166.258703:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493399936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893166.258735:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493400064:12345-0@lo:400:kworker.0 Request processed in 57us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893166.258746:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787893166.258747:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493399936:12345-0@lo:400:kworker.0 Request processed in 45us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893166.258755:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1787893166.258764:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787893166.258773:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493399808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893166.258776:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1787893166.258793:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1874741493400320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893166.258817:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493399808:12345-0@lo:400:kworker.0 Request processed in 45us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893166.258824:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787893166.258837:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1874741493400320:12345-0@lo:400:kworker.0 Request processed in 46us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893166.258845:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1787893166.258863:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1787893166.258865:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493400576:0@lo:400:kworker.0 00000100:00100000:1.0:1787893166.258872:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1874741493400832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893166.258877:0:3633:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:3.0:1787893166.258884:0:3633:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fc8c778aa00, transno 4294967325 00000100:00100000:3.0:1787893166.258896:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493401088:0@lo:400:kworker.0 00000100:00100000:1.0:1787893166.258906:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1874741493400832:12345-0@lo:400:kworker.0 Request processed in 36us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893166.258911:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493399552:0@lo:400:kworker.0 00000100:00100000:1.0:1787893166.258915:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1787893166.258930:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493400064:0@lo:400:kworker.0 00000100:00080000:1.0:1787893166.258947:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787893166.258977:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493399808:0@lo:400:kworker.0 00010000:00080000:3.0:1787893166.258989:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb68700 x1874741493400320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893166.258998:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1874741493400320:0@lo:400:kworker.0 00010000:00080000:3.0:1787893166.259008:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c8469f80 x1874741493400832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893166.259015:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8469f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1874741493400832:0@lo:400:kworker.0 00000100:00100000:3.0:1787893166.259061:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493401216 00000100:00100000:3.0:1787893166.259065:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493401216 00000100:00100000:3.0:1787893166.259107:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787893166.259114:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493401216:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787893166.259133:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1787893166.259135:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787893166.259181:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493401216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893166.259187:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787893166.259229:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7525c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493401216:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787893166.260329:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493401344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787893166.260378:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893166.260472:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493401344 00000100:00100000:2.0:1787893166.260479:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493401344 00000100:00100000:2.0:1787893166.260543:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787893166.260552:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7525c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493401344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787893166.260567:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787893166.260612:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7525c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493401344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893166.260619:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787893166.260715:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493401344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787893166.261649:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493399680:0@lo:400:kworker.0 00000100:00100000:3.0:1787893166.261661:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493400192:0@lo:400:kworker.0 00000100:00100000:3.0:1787893166.261768:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893166.261803:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1874741493400704:0@lo:400:kworker.0 00000100:00100000:3.0:1787893166.261826:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893166.261986:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493400192 00000100:00100000:1.0:1787893166.261992:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493400192 00000100:00100000:1.0:1787893166.262048:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493400704 00000100:00100000:1.0:1787893166.262052:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493400704 00000100:00100000:1.0:1787893166.262073:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1787893166.262080:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493400192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893166.262125:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493400192:12345-0@lo:400:kworker.0 Request processed in 44us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893166.262131:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1787893166.262150:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00080000:3.0:1787893166.262152:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787893166.262158:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874741493400704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893166.262201:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874741493400704:12345-0@lo:400:kworker.0 Request processed in 45us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893166.262206:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1787893166.262239:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493400192:0@lo:400:kworker.0 00000100:00100000:1.0:1787893166.262249:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1874741493400704:0@lo:400:kworker.0 00000100:00100000:0.0:1787893166.262941:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493399936:0@lo:400:kworker.0 00000100:00100000:0.0:1787893166.262951:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493400448:0@lo:400:kworker.0 00000100:00100000:0.0:1787893166.262981:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893166.262997:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493400960:0@lo:400:kworker.0 00000100:00100000:0.0:1787893166.263017:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893166.263119:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493400448 00000100:00100000:3.0:1787893166.263124:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493400448 00000100:00100000:1.0:1787893166.263145:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493400960 00000100:00100000:1.0:1787893166.263152:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493400960 00000100:00100000:3.0:1787893166.263181:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787893166.263215:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493400448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893166.263262:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493400448:12345-0@lo:400:kworker.0 Request processed in 49us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893166.263324:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493400448:0@lo:400:kworker.0 00000100:00080000:0.0:1787893166.263612:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787893166.266623:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787893166.266657:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787893166.266687:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8480380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493400960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893166.266844:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8480380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493400960:12345-0@lo:400:kworker.0 Request processed in 177us (3825us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893166.266852:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787893166.268884:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493400960:0@lo:400:kworker.0 00010000:00010000:1.0:1787893166.769797:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893167.130163:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893167.130217:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893167.130244:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893167.130278:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893167.130301:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893167.130317:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893167.130338:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893167.130365:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481816448 00000100:00100000:1.0:1787893167.130375:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481816448 00000100:00100000:1.0:1787893167.130426:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 403 00000100:00100000:1.0:1787893167.130436:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2392:x1874741481816448:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893167.130550:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2392:x1874741481816448:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 115us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893167.130758:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481816576 00000100:00100000:3.0:1787893167.130763:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481816576 00000100:00100000:3.0:1787893167.130803:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481817088 00000100:00100000:3.0:1787893167.130806:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481817088 00000100:00100000:3.0:1787893167.130823:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481816704 00000100:00100000:3.0:1787893167.130826:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481816704 00000100:00100000:3.0:1787893167.130837:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481817216 00000100:00100000:3.0:1787893167.130839:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481817216 00000100:00100000:3.0:1787893167.130852:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 395 00000100:00100000:3.0:1787893167.130858:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+18:2392:x1874741481816576:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893167.130892:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+18:2392:x1874741481816576:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 35us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893167.130899:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 395 00000100:00100000:3.0:1787893167.130916:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 396 00000100:00100000:3.0:1787893167.130922:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c50492c-5fef-4e80-9bbb-0b2782d59443+6:2392:x1874741481817088:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893167.130948:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c50492c-5fef-4e80-9bbb-0b2782d59443+6:2392:x1874741481817088:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 27us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893167.130954:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 396 00000100:00100000:3.0:1787893167.130964:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 397 00000100:00100000:3.0:1787893167.130970:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+5:2392:x1874741481816704:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893167.130993:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+5:2392:x1874741481816704:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 24us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893167.131010:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 397 00000100:00100000:3.0:1787893167.131023:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 398 00000100:00100000:3.0:1787893167.131029:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2392:x1874741481817216:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893167.131052:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2392:x1874741481817216:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 23us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893167.131058:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 398 00000100:00100000:3.0:1787893167.131079:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481816832 00000100:00100000:3.0:1787893167.131081:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481816832 00000100:00100000:3.0:1787893167.131105:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481816960 00000100:00100000:3.0:1787893167.131107:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481816960 00000100:00100000:3.0:1787893167.131127:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 157 00000100:00100000:3.0:1787893167.131133:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+5:2392:x1874741481816832:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893167.131160:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+5:2392:x1874741481816832:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 28us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893167.131167:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 157 00000100:00100000:3.0:1787893167.131178:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 158 00000100:00100000:3.0:1787893167.131184:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+7:2392:x1874741481816960:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893167.131204:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+7:2392:x1874741481816960:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 21us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893167.131209:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 158 00000100:00100000:1.0:1787893167.131475:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 403 00000100:00080000:0.0:1787893167.132031:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787893167.132035:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787893167.132038:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787893167.132041:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787893167.795331:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893167.998076:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893167.998265:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481817472 00000100:00100000:3.0:1787893167.998276:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481817472 00000100:00100000:3.0:1787893167.998338:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 66 00000100:00100000:3.0:1787893167.998349:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+18:13185:x1874741481817472:12345-192.168.202.35@tcp:35:umount.0 00000100:00100000:3.0:1787893167.998649:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+19:13185:x1874741481817472:12345-192.168.202.35@tcp:35:umount.0 Request processed in 301us (582us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1787893167.998657:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 66 00000100:00100000:3.0:1787893168.004058:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893168.004305:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481817728 00000100:00100000:1.0:1787893168.004315:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481817728 00000100:00100000:1.0:1787893168.004377:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 67 00000100:00100000:1.0:1787893168.004388:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+19:13185:x1874741481817728:12345-192.168.202.35@tcp:35:umount.0 00000100:00100000:1.0:1787893168.004706:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+20:13185:x1874741481817728:12345-192.168.202.35@tcp:35:umount.0 Request processed in 319us (670us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1787893168.004713:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 67 00000100:00100000:1.0:1787893168.007373:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893168.007463:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481817984 00000100:00100000:3.0:1787893168.007472:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481817984 00000100:00100000:3.0:1787893168.007560:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 68 00000100:00100000:3.0:1787893168.007572:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fec050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+20:13185:x1874741481817984:12345-192.168.202.35@tcp:35:umount.0 00000100:00100000:3.0:1787893168.007815:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fec050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+21:13185:x1874741481817984:12345-192.168.202.35@tcp:35:umount.0 Request processed in 245us (452us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1787893168.007824:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 68 00000100:00100000:3.0:1787893168.012374:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893168.012530:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481818240 00000100:00100000:1.0:1787893168.012539:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481818240 00000100:00100000:1.0:1787893168.012599:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 69 00000100:00100000:1.0:1787893168.012609:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+21:13185:x1874741481818240:12345-192.168.202.35@tcp:35:umount.0 00000100:00100000:1.0:1787893168.014221:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58232959-285a-4954-a3ac-571a2b817017+22:13185:x1874741481818240:12345-192.168.202.35@tcp:35:umount.0 Request processed in 1605us (1848us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1787893168.014233:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 69 00000100:00100000:1.0:1787893168.023205:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893168.023244:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893168.023268:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893168.023301:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893168.023361:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481818368 00000100:00100000:3.0:1787893168.023371:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481818368 00000100:00100000:3.0:1787893168.023432:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481819008 00000100:00100000:3.0:1787893168.023436:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481819008 00000100:00100000:3.0:1787893168.023449:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481818496 00000100:00100000:3.0:1787893168.023451:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481818496 00000100:00100000:3.0:1787893168.023465:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 21 00000100:00100000:3.0:1787893168.023474:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7525180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+15:2392:x1874741481818368:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893168.023514:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893168.023533:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c771f200/0x9232577658cf0ca0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa645 expref: 15 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893168.023551:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893168.023605:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7525180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+14:2392:x1874741481818368:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 131us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893168.023629:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 21 00000100:00100000:3.0:1787893168.023646:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 22 00000100:00100000:3.0:1787893168.023652:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7524a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+13:2391:x1874741481819008:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893168.023671:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893168.023682:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c7c7f000/0x9232577658cf0ebb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa71e expref: 13 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893168.023691:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893168.023710:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7524a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+12:2391:x1874741481819008:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 58us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893168.023717:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 22 00000100:00100000:3.0:1787893168.023729:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 23 00000100:00100000:3.0:1787893168.023735:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7527800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+11:2392:x1874741481818496:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893168.023742:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893168.023750:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c771e200/0x9232577658cf0be3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa606 expref: 11 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893168.023759:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893168.023789:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7527800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:2392:x1874741481818496:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 53us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893168.023796:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 23 00000100:00100000:3.0:1787893168.023901:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481818880 00000100:00100000:3.0:1787893168.023905:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481818880 00000100:00100000:3.0:1787893168.023934:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 80 00000100:00100000:3.0:1787893168.023941:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+7:2389:x1874741481818880:12345-192.168.202.35@tcp:9:umount.0 00000020:00000080:3.0:1787893168.023971:0:8420:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf1234 00000020:00010000:3.0:1787893168.023979:0:8420:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9fc9d0f71000: total 0 00000100:00080000:3.0:1787893168.023983:0:8420:0:(import.c:65:import_set_state_nolock()) ffff9fc9d0f77800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787893168.024025:0:8420:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1787893168.024281:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58232959-285a-4954-a3ac-571a2b817017+5:2389:x1874741481818880:12345-192.168.202.35@tcp:9:umount.0 Request processed in 339us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893168.024287:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 80 00000020:00010000:2.0:1787893168.024645:0:8435:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9fc9d0f71000: total 0 00010000:00010000:2.0:1787893168.024696:0:8435:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fc9d0f71000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1787893168.024741:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060f5eadb/0x9232577658cf1cbb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faaeb expref: 4 pid: 8421 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893168.024774:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e727c74a/0x9232577658cf15ec lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa908 expref: 3 pid: 8421 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893168.024802:0:8435:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fc9d0f71000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1787893168.024815:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893168.024817:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893168.024825:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893168.033530:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893168.034166:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481819136 00000100:00100000:0.0:1787893168.034176:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481819136 00000100:00100000:0.0:1787893168.034232:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 81 00000100:00100000:0.0:1787893168.034243:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58232959-285a-4954-a3ac-571a2b817017+5:2389:x1874741481819136:12345-192.168.202.35@tcp:9:umount.0 00000020:00000080:0.0:1787893168.034271:0:8419:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf0fbe 00000100:00080000:0.0:1787893168.034282:0:8419:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7f34000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787893168.034340:0:8419:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1787893168.034524:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58232959-285a-4954-a3ac-571a2b817017+2:2389:x1874741481819136:12345-192.168.202.35@tcp:9:umount.0 Request processed in 281us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893168.034546:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 81 00010000:00010000:3.0:1787893168.035075:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893168.045357:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893168.045486:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481820160 00000100:00100000:3.0:1787893168.045532:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481820160 00000100:00100000:3.0:1787893168.045596:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 258 00000100:00100000:3.0:1787893168.045607:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+22:2389:x1874741481820160:12345-192.168.202.35@tcp:39:umount.0 00000020:00000080:3.0:1787893168.045639:0:6505:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf0bf1 00000020:00010000:3.0:1787893168.045655:0:6505:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9fc9e71fe000: total 0 00000100:00080000:3.0:1787893168.045669:0:6505:0:(import.c:65:import_set_state_nolock()) ffff9fc9e71f8000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787893168.045693:0:6505:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:3.0:1787893168.045914:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58232959-285a-4954-a3ac-571a2b817017+21:2389:x1874741481820160:12345-192.168.202.35@tcp:39:umount.0 Request processed in 308us (566us total) trans 4294967528 rc 0/0 00000100:00100000:3.0:1787893168.045923:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 258 00000020:00010000:0.0:1787893168.046125:0:6493:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9fc9e71fe000: total 0 00010000:00010000:0.0:1787893168.046178:0:6493:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fc9e71fe000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1787893168.046211:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc9d0fd6700) 00010000:00010000:0.0:1787893168.046215:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787893168.046222:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0031200/0x9232577658cf128f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa821 expref: 20 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893168.046252:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc8c6615800) 00010000:00010000:0.0:1787893168.046255:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787893168.046259:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6400/0x9232577658cf1b9c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa9e expref: 19 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893168.046270:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc9c3918e00) 00010000:00010000:0.0:1787893168.046272:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787893168.046276:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771e400/0x9232577658cf14cd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8bb expref: 18 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893168.046287:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fc9d5c29600) 00010000:00010000:0.0:1787893168.046289:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787893168.046293:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147ca00/0x9232577658cf0f1d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa72c expref: 17 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893168.046309:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc9c3918700) 00010000:00010000:0.0:1787893168.046311:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787893168.046315:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c0030c00/0x9232577658cf1671 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa92b expref: 16 pid: 13436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893168.046345:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc8c6615800) 00010000:00010000:0.0:1787893168.046347:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787893168.046350:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6800/0x9232577658cf1c7c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faad6 expref: 15 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893168.046361:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc8c6615800) 00010000:00010000:0.0:1787893168.046363:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787893168.046366:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541c00/0x9232577658cf1ca6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faae4 expref: 14 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893168.046382:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc9d0fd6700) 00010000:00010000:0.0:1787893168.046385:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787893168.046388:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f600/0x9232577658cf0f94 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa748 expref: 13 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893168.046403:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc9c3918700) 00010000:00010000:0.0:1787893168.046405:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787893168.046409:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fc00/0x9232577658cf195e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faa04 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893168.046423:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc8c6614400) 00010000:00010000:0.0:1787893168.046425:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787893168.046429:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f800/0x9232577658cf1655 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa924 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893168.046441:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fc9d5c29800) 00010000:00010000:0.0:1787893168.046443:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893168.046453:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771f600/0x9232577658cf0f39 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa733 expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893168.046469:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc9c3918e00) 00010000:00010000:0.0:1787893168.046472:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787893168.046476:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c771ec00/0x9232577658cf15ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa8f3 expref: 9 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893168.046538:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc9c3918e00) 00010000:00010000:0.0:1787893168.046542:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787893168.046546:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf15d7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa901 expref: 8 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893168.046560:0:6493:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fc9e71fe000, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1787893168.046574:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893168.046576:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893168.046578:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893168.062528:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893168.062654:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481820288 00000100:00100000:3.0:1787893168.062673:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481820288 00000100:00100000:3.0:1787893168.062736:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 259 00000100:00100000:3.0:1787893168.062746:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+5:2389:x1874741481820288:12345-192.168.202.35@tcp:39:umount.0 00000020:00000080:3.0:1787893168.062779:0:6506:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf0bf8 00000100:00080000:3.0:1787893168.062796:0:6506:0:(import.c:65:import_set_state_nolock()) ffff9fc9e71f9800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787893168.062828:0:6506:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787893168.062995:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58232959-285a-4954-a3ac-571a2b817017+3:2389:x1874741481820288:12345-192.168.202.35@tcp:39:umount.0 Request processed in 250us (517us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787893168.063016:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 259 00010000:00010000:2.0:1787893168.063451:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893168.308487:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787893168.308536:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493401472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787893168.308608:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893168.308700:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493401472 00000100:00100000:1.0:1787893168.308708:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493401472 00000100:00100000:1.0:1787893168.308759:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787893168.308769:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493401472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787893168.308799:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787893168.308843:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493401472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893168.308850:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787893168.308895:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493401472:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787893168.309006:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787893168.309059:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493401600:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787893168.309086:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893168.309168:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493401600 00000100:00100000:0.0:1787893168.309172:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493401600 00000100:00100000:0.0:1787893168.309213:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787893168.309220:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7526d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493401600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787893168.309231:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787893168.309266:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7526d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493401600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893168.309272:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:1.0:1787893168.309337:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787893168.309360:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493401600:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787893168.817741:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893169.841705:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493401728:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787893169.841728:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893169.841787:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893169.841912:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493401728 00000100:00100000:3.0:1787893169.841919:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493401728 00000100:00100000:3.0:1787893169.841958:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1787893169.841964:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493401728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787893169.841991:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787893169.842033:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493401728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893169.842037:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1787893169.842118:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493401728:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787893170.171965:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893170.172009:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893170.172039:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481820544 00000100:00100000:1.0:1787893170.172118:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893170.172266:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481820416 00000100:00100000:2.0:1787893170.172272:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481820416 00000100:00100000:2.0:1787893170.172332:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481820672 00000100:00100000:2.0:1787893170.172335:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481820672 00000100:00100000:2.0:1787893170.172355:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 24 00000100:00100000:2.0:1787893170.172364:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+11:2393:x1874741481820416:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787893170.172377:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893170.172396:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9edb31800/0x9232577658cf0cfb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa68b expref: 11 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893170.172413:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893170.172462:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+10:2393:x1874741481820416:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 99us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893170.172469:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 24 00000100:00100000:2.0:1787893170.172486:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 25 00000100:00100000:2.0:1787893170.172538:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3efc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+9:2393:x1874741481820672:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787893170.172546:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893170.172554:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c771fc00/0x9232577658cf0cf4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa65a expref: 9 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893170.172562:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893170.172578:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3efc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+8:2393:x1874741481820672:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 86us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893170.172584:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 25 00000100:00100000:3.0:1787893170.173315:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481820544 00000100:00100000:3.0:1787893170.173606:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 26 00000100:00100000:3.0:1787893170.173616:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+8:2393:x1874741481820544:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893170.173628:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893170.173722:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9edb31a00/0x9232577658cf0eb4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa717 expref: 8 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893170.173736:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893170.173836:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+7:2393:x1874741481820544:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 221us (1880us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893170.173843:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 26 00000100:00100000:0.0:1787893170.181590:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893170.181704:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481820928 00000100:00100000:2.0:1787893170.181725:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481820928 00000100:00100000:2.0:1787893170.181799:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 260 00000100:00100000:2.0:1787893170.181811:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9c50492c-5fef-4e80-9bbb-0b2782d59443+6:2389:x1874741481820928:12345-192.168.202.35@tcp:39:umount.0 00000020:00000080:2.0:1787893170.181849:0:13436:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf0d09 00000020:00010000:2.0:1787893170.181856:0:13436:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9fc8c75fc800: total 0 00000100:00080000:2.0:1787893170.181860:0:13436:0:(import.c:65:import_set_state_nolock()) ffff9fc8c75fe800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787893170.181889:0:13436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00100000:2.0:1787893170.182037:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2389:x1874741481820928:12345-192.168.202.35@tcp:39:umount.0 Request processed in 228us (456us total) trans 4294967529 rc 0/0 00000100:00100000:2.0:1787893170.182045:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 260 00000100:00080000:1.0:1787893170.182476:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:0.0:1787893170.182721:0:8435:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9fc8c75fc800: total 0 00010000:00010000:0.0:1787893170.182733:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893170.182783:0:8435:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fc8c75fc800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787893170.182817:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc8c6614400) 00010000:00010000:0.0:1787893170.182821:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787893170.182829:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9c147cc00/0x9232577658cf1cc9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faaf2 expref: 4 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893170.182852:0:8435:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fc8c75fc800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1787893170.182863:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893170.182865:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893170.182867:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893170.188913:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893170.188991:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481821056 00000100:00100000:3.0:1787893170.189001:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481821056 00000100:00100000:3.0:1787893170.189169:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 261 00000100:00100000:3.0:1787893170.189180:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c50492c-5fef-4e80-9bbb-0b2782d59443+5:2389:x1874741481821056:12345-192.168.202.35@tcp:39:umount.0 00000020:00000080:3.0:1787893170.189231:0:6505:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf0d10 00000100:00080000:3.0:1787893170.189241:0:6505:0:(import.c:65:import_set_state_nolock()) ffff9fc8c75f9000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787893170.189271:0:6505:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00080000:1.0:1787893170.189425:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787893170.189446:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c50492c-5fef-4e80-9bbb-0b2782d59443+3:2389:x1874741481821056:12345-192.168.202.35@tcp:39:umount.0 Request processed in 269us (543us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787893170.189454:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 261 00010000:00010000:0.0:1787893170.189566:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893170.210840:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893170.211030:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481821312 00000100:00100000:1.0:1787893170.211041:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481821312 00000100:00100000:1.0:1787893170.211118:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 404 00000100:00100000:1.0:1787893170.211128:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+7:2389:x1874741481821312:12345-192.168.202.35@tcp:251:umount.0 00000020:00000080:1.0:1787893170.211172:0:6499:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf0bce 00000020:00010000:1.0:1787893170.211193:0:6499:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9fc8c76ad000: total 0 00000100:00080000:1.0:1787893170.211197:0:6499:0:(import.c:65:import_set_state_nolock()) ffff9fc8c76ac800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787893170.211283:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d9a2dc2-4f6b-4ee1-a460-1d8351124f58+3:2389:x1874741481821312:12345-192.168.202.35@tcp:251:umount.0 Request processed in 156us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893170.211291:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 404 00000020:00010000:0.0:1787893170.211447:0:6493:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9fc8c76ad000: total 0 00010000:00010000:0.0:1787893170.211535:0:6493:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fc8c76ad000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787893170.211570:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9c147d800/0x9232577658cf0ca7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fa64c expref: 2 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893170.211584:0:6493:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fc8c76ad000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1787893170.211593:0:6493:0:(genops.c:885:class_export_put()) final put ffff9fc8c76ad000/3d9a2dc2-4f6b-4ee1-a460-1d8351124f58 00010000:00010000:0.0:1787893170.211606:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893170.211608:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893170.211610:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787893170.212381:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c76ad000/3d9a2dc2-4f6b-4ee1-a460-1d8351124f58 for MGS 00000020:00000080:1.0:1787893170.212421:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc8c76ac800 for MGS 00010000:00010000:0.0:1787893170.867022:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893170.868466:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493401856:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787893170.868560:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893170.868654:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493401856 00000100:00100000:1.0:1787893170.868661:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493401856 00000100:00100000:1.0:1787893170.868708:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787893170.868716:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493401856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787893170.868750:0:7865:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1787893170.868793:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493401856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893170.868800:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787893170.868841:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493401856:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787893171.377947:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493401984:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787893171.378022:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893171.378102:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493401984 00000100:00100000:0.0:1787893171.378110:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493401984 00000100:00100000:0.0:1787893171.378166:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787893171.378177:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8482680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493401984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787893171.378220:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787893171.378266:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8482680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493401984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893171.378273:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00080000:0.0:1787893171.378293:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787893171.378334:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493401984:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787893171.381739:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493402112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787893171.381823:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893171.381927:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493402112 00000100:00100000:2.0:1787893171.381943:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493402112 00000100:00100000:2.0:1787893171.382048:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787893171.382061:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493402112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787893171.382101:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787893171.382157:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493402240:0@lo:400:kworker.0 00000100:00100000:2.0:1787893171.382193:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493402112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893171.382208:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787893171.382215:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893171.382253:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8481f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493402752:0@lo:400:kworker.0 00000100:00100000:0.0:1787893171.382279:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893171.382288:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1874741493402368:0@lo:400:kworker.0 00000100:00100000:0.0:1787893171.382304:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493403264:0@lo:400:kworker.0 00000100:00100000:2.0:1787893171.382354:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893171.382360:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893171.382396:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1874741493402880:0@lo:400:kworker.0 00000100:00100000:0.0:1787893171.382416:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493402240 00000100:00100000:0.0:1787893171.382425:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493402240 00000100:00100000:2.0:1787893171.382433:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893171.382461:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1874741493403392:0@lo:400:kworker.0 00000100:00100000:0.0:1787893171.382521:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:0.0:1787893171.382532:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+24:3630:x1874741493402240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893171.382540:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893171.382584:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493402368 00000100:00100000:2.0:1787893171.382590:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493402368 00000100:00100000:0.0:1787893171.382597:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ad7764-cf95-4087-88aa-57e4229a8397+24:3630:x1874741493402240:12345-0@lo:400:kworker.0 Request processed in 64us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893171.382607:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:0.0:1787893171.382662:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493402752 00000100:00100000:0.0:1787893171.382667:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493402752 00000100:00100000:0.0:1787893171.382697:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787893171.382704:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493402752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893171.382737:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493402752:12345-0@lo:400:kworker.0 Request processed in 33us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893171.382760:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787893171.382805:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493402240:0@lo:400:kworker.0 00000100:00100000:0.0:1787893171.382818:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8481f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493402752:0@lo:400:kworker.0 00000100:00100000:2.0:1787893171.382869:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493402880 00000100:00100000:2.0:1787893171.382875:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493402880 00000100:00100000:2.0:1787893171.382910:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493403392 00000100:00100000:2.0:1787893171.382912:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493403392 00000100:00100000:2.0:1787893171.382934:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:2.0:1787893171.382941:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1874741493402368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893171.382990:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1874741493402368:12345-0@lo:400:kworker.0 Request processed in 49us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893171.382997:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:2.0:1787893171.383012:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1787893171.383019:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3631:x1874741493402880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893171.383046:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3631:x1874741493402880:12345-0@lo:400:kworker.0 Request processed in 28us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893171.383051:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1787893171.383063:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1787893171.383070:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1874741493403392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893171.383106:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1874741493403392:12345-0@lo:400:kworker.0 Request processed in 37us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893171.383112:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1787893171.383146:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8481c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493402496:0@lo:400:kworker.0 00000100:00100000:2.0:1787893171.383174:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893171.383191:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493403008:0@lo:400:kworker.0 00000100:00100000:2.0:1787893171.383209:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893171.383222:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493403520:0@lo:400:kworker.0 00000100:00100000:2.0:1787893171.383239:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893171.383253:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787893171.383267:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493402624:0@lo:400:kworker.0 00000100:00100000:2.0:1787893171.383288:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893171.383297:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493403136:0@lo:400:kworker.0 00000100:00100000:2.0:1787893171.383315:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893171.383336:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493403008 00000100:00100000:2.0:1787893171.383339:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493403008 00000100:00100000:2.0:1787893171.383356:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493403520 00000100:00100000:2.0:1787893171.383359:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493403520 00000100:00100000:2.0:1787893171.383367:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493402624 00000100:00100000:2.0:1787893171.383369:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493402624 00000100:00100000:2.0:1787893171.383379:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1787893171.383384:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493403008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893171.383415:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493403008:12345-0@lo:400:kworker.0 Request processed in 31us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893171.383421:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1787893171.383432:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:2.0:1787893171.383438:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493403520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893171.383465:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493403520:12345-0@lo:400:kworker.0 Request processed in 27us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893171.383471:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:2.0:1787893171.383482:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:2.0:1787893171.383488:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c778aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493402624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893171.383825:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493403264 00000100:00100000:3.0:1787893171.383831:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493403264 00000100:00100000:3.0:1787893171.383864:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493403136 00000100:00100000:3.0:1787893171.383867:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493403136 00000100:00100000:3.0:1787893171.383891:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787893171.383898:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493403264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893171.383943:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493403264:12345-0@lo:400:kworker.0 Request processed in 45us (1593us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893171.383950:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787893171.383965:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787893171.383971:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7789180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493403136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893171.383998:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7789180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493403136:12345-0@lo:400:kworker.0 Request processed in 27us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893171.384003:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787893171.384030:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493402496 00000100:00100000:3.0:1787893171.384034:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493402496 00000100:00100000:3.0:1787893171.384057:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787893171.384064:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493402496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893171.384125:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493402496:12345-0@lo:400:kworker.0 Request processed in 61us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893171.384132:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00080000:3.0:1787893171.384157:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787893171.384163:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787893171.384165:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787893171.384167:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787893171.384215:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493402112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787893171.384253:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493403264:0@lo:400:kworker.0 00000100:00100000:3.0:1787893171.384900:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1874741493402368:0@lo:400:kworker.0 00000100:00100000:3.0:1787893171.384915:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1874741493402880:0@lo:400:kworker.0 00000100:00100000:3.0:1787893171.384927:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1874741493403392:0@lo:400:kworker.0 00000100:00100000:2.0:1787893171.385029:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c778aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493402624:12345-0@lo:400:kworker.0 Request processed in 1539us (1737us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893171.385038:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:2.0:1787893171.385075:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493402624:0@lo:400:kworker.0 00000100:00100000:2.0:1787893171.385465:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493403136:0@lo:400:kworker.0 00000100:00100000:2.0:1787893171.385479:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8481c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493402496:0@lo:400:kworker.0 00010000:00080000:2.0:1787893171.385523:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c8481500 x1874741493403008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893171.386180:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493403008:0@lo:400:kworker.0 00010000:00080000:2.0:1787893171.386206:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7ce0380 x1874741493403520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893171.386213:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493403520:0@lo:400:kworker.0 00000020:01000004:0.0:1787893171.713199:0:15193:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1787893171.729954:0:15193:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1787893171.730016:0:15193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf0c76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0c7d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.730030:0:15193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf0c76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0c7d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.730038:0:15193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf0c76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf0c7d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.730061:0:15193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf0c76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf0c7d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.730079:0:15193:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787893171.730407:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893171.730415:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf0c76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf0c7d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893171.730423:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c147d000 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:2.0:1787893171.730427:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf0c76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf0c7d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893171.730436:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf0c76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x9232577658cf0c7d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787893171.730443:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf0c76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x9232577658cf0c7d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893171.730450:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787893171.730453:0:6494:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00010000:00010000:2.0:1787893171.730504:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf0c76 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf0c7d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893171.730521:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787893171.730543:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf0c76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf0c7d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893171.730552:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893171.730554:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893171.730556:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893171.730572:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7789500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493403648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787893171.730644:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787893171.731037:0:15193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf0c76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf0c7d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893171.731051:0:15193:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 10000000:01000000:1.0:1787893171.731056:0:15193:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00100000:1.0:1787893171.731254:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493403648 00000100:00100000:1.0:1787893171.731262:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493403648 00000100:00100000:1.0:1787893171.731327:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787893171.731336:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe34a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ad7764-cf95-4087-88aa-57e4229a8397+24:3633:x1874741493403648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787893171.731350:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893171.731365:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c771e800/0x9232577658cf0c7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9232577658cf0c76 expref: 24 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.731377:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893171.731413:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe34a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ad7764-cf95-4087-88aa-57e4229a8397+23:3633:x1874741493403648:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893171.731421:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1787893171.731445:0:15193:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787893171.731449:0:15193:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787893171.731456:0:15193:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787893171.731470:0:15193:0:(import.c:65:import_set_state_nolock()) ffff9fc9d29ea000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787893171.731661:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7789500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493403648:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787893171.732177:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874741493403776:0@lo:39:umount.0 00000100:00100000:3.0:1787893171.732218:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893171.732577:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493403776 00000100:00100000:2.0:1787893171.732583:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493403776 00000100:00100000:2.0:1787893171.732636:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787893171.732645:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1874741493403776:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787893171.732669:0:6506:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf07e5 00000100:00080000:2.0:1787893171.732678:0:6506:0:(import.c:65:import_set_state_nolock()) ffff9fc9fd125000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787893171.734815:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3629:x1874741493403776:12345-0@lo:39:umount.0 Request processed in 2164us (2589us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893171.734828:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:2.0:1787893171.734842:0:6506:0:(genops.c:885:class_export_put()) final put ffff9fc9c7e93000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1787893171.734885:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787893171.735884:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9c7e93000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787893171.735944:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc9fd125000 for lustre-MDT0000 00000100:00080000:3.0:1787893171.737925:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9d29ea000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787893171.738005:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874741493403776:0@lo:39:umount.0 00000100:00080000:1.0:1787893171.744189:0:15193:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787893171.744198:0:15193:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787893171.744220:0:15193:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787893171.748354:0:15193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541800/0x9232577658cf0c84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0c8b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.748373:0:15193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541800/0x9232577658cf0c84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0c8b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.748381:0:15193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541800/0x9232577658cf0c84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf0c8b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.748388:0:15193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541800/0x9232577658cf0c84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf0c8b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.748401:0:15193:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787893171.748407:0:15193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540000/0x9232577658cf0b88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0b8f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.748413:0:15193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540000/0x9232577658cf0b88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0b8f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.748419:0:15193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540000/0x9232577658cf0b88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf0b8f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.748425:0:15193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540000/0x9232577658cf0b88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf0b8f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.748440:0:15193:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787893171.748446:0:15193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7ec00/0x9232577658cf0eec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0ef3 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.748453:0:15193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7ec00/0x9232577658cf0eec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0ef3 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.748473:0:15193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7ec00/0x9232577658cf0eec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf0ef3 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.748479:0:15193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7ec00/0x9232577658cf0eec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf0ef3 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.748509:0:15193:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1787893171.748515:0:15193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728800/0x9232577658cf0744 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf074b expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.748522:0:15193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728800/0x9232577658cf0744 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf074b expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.748528:0:15193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728800/0x9232577658cf0744 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf074b expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.748534:0:15193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728800/0x9232577658cf0744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf074b expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.748542:0:15193:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1787893171.748544:0:15193:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1787893171.748571:0:15193:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1787893171.748575:0:15193:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1787893171.748578:0:15193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787893171.748584:0:15193:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:1.0:1787893171.748590:0:15193:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9fc9ffb40800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787893171.748596:0:15193:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9fc9ffa87800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787893171.748600:0:15193:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9fc9fe132800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787893171.748610:0:15193:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9fc9fd344800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:1.0:1787893171.748617:0:15193:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9fc8c75fc800 9c50492c-5fef-4e80-9bbb-0b2782d59443 192.168.202.35@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787893171.748622:0:15193:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9fc9e71fe000 58232959-285a-4954-a3ac-571a2b817017 192.168.202.35@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967523 stale:0 00000020:00080000:1.0:1787893171.748638:0:15193:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9fc9e2e399b8) has exports, disconnecting them 00000020:00080000:1.0:1787893171.748643:0:15193:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9fc9ffb40800), last request at 1787893171 00000020:00000080:1.0:1787893171.748650:0:15193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf0af5 00000100:00080000:1.0:1787893171.748670:0:15193:0:(import.c:65:import_set_state_nolock()) ffff9fc9ffb44000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787893171.748717:0:15193:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc9ffb40800): rc 0 00000020:00000080:1.0:1787893171.748719:0:15193:0:(genops.c:885:class_export_put()) final put ffff9fc9ffb40800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1787893171.748728:0:15193:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9fc9ffa87800), last request at 1787893171 00000020:00000080:1.0:1787893171.748731:0:15193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf09cf 00000100:00080000:1.0:1787893171.748735:0:15193:0:(import.c:65:import_set_state_nolock()) ffff9fc9ffa81800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787893171.748946:0:8435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787893171.748953:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541800/0x9232577658cf0c84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf0c8b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893171.748960:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe541800 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:0.0:1787893171.748964:0:8435:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541800/0x9232577658cf0c84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf0c8b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893171.748983:0:8435:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541800/0x9232577658cf0c84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x9232577658cf0c8b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787893171.748990:0:8435:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541800/0x9232577658cf0c84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x9232577658cf0c8b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787893171.748996:0:8435:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787893171.748999:0:8435:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:0.0:1787893171.749002:0:8435:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1787893171.749036:0:8435:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541800/0x9232577658cf0c84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf0c8b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893171.749042:0:8435:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787893171.749074:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541800/0x9232577658cf0c84 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf0c8b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893171.749081:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541800/0x9232577658cf0c84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf0c8b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893171.749215:0:8435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787893171.749218:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540000/0x9232577658cf0b88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf0b8f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893171.749224:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540000 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:0.0:1787893171.749226:0:8435:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540000/0x9232577658cf0b88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf0b8f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893171.749234:0:8435:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540000/0x9232577658cf0b88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9232577658cf0b8f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787893171.749240:0:8435:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540000/0x9232577658cf0b88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9232577658cf0b8f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787893171.749245:0:8435:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1787893171.749248:0:8435:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1787893171.749249:0:8435:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1787893171.749264:0:8435:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540000/0x9232577658cf0b88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf0b8f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893171.749270:0:8435:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787893171.749276:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540000/0x9232577658cf0b88 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf0b8f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893171.749282:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540000/0x9232577658cf0b88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf0b8f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893171.749291:0:8435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787893171.749294:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7ec00/0x9232577658cf0eec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf0ef3 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893171.749305:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7ec00 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:0.0:1787893171.749307:0:8435:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7ec00/0x9232577658cf0eec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf0ef3 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893171.749314:0:8435:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7ec00/0x9232577658cf0eec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x9232577658cf0ef3 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787893171.749321:0:8435:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7ec00/0x9232577658cf0eec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x9232577658cf0ef3 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787893171.749326:0:8435:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787893171.749329:0:8435:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787893171.749331:0:8435:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787893171.749343:0:8435:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7ec00/0x9232577658cf0eec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf0ef3 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893171.749349:0:8435:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787893171.749361:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7ec00/0x9232577658cf0eec lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf0ef3 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893171.749368:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7ec00/0x9232577658cf0eec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf0ef3 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893171.749376:0:8435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893171.749379:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728800/0x9232577658cf0744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf074b expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893171.749385:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd728800 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:0.0:1787893171.749388:0:8435:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728800/0x9232577658cf0744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf074b expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893171.749399:0:8435:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728800/0x9232577658cf0744 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9232577658cf074b expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787893171.749405:0:8435:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728800/0x9232577658cf0744 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9232577658cf074b expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787893171.749410:0:8435:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787893171.749412:0:8435:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787893171.749413:0:8435:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1787893171.749425:0:8435:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728800/0x9232577658cf0744 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf074b expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893171.749430:0:8435:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787893171.749436:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728800/0x9232577658cf0744 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf074b expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893171.749442:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728800/0x9232577658cf0744 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf074b expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893171.749451:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893171.749453:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893171.749455:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893171.749470:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493403904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787893171.749558:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893171.749604:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787893171.749610:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493404032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787893171.749640:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893171.749670:0:10383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493403904 00000100:00100000:0.0:1787893171.749677:0:10383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493403904 00000100:00100000:0.0:1787893171.749726:0:10383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493404032 00000100:00100000:0.0:1787893171.749729:0:10383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493404032 00000100:00100000:0.0:1787893171.749761:0:10383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787893171.749771:0:10383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:19ad7764-cf95-4087-88aa-57e4229a8397+24:3630:x1874741493403904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787893171.749792:0:10383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893171.749805:0:10383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c771f000/0x9232577658cf0c8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9232577658cf0c84 expref: 24 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893171.749816:0:10383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787893171.749953:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893171.749964:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493404160:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1787893171.751047:0:15193:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc9ffa87800): rc 0 00000020:00000080:1.0:1787893171.751051:0:15193:0:(genops.c:885:class_export_put()) final put ffff9fc9ffa87800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1787893171.751059:0:15193:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9fc9fe132800), last request at 1787892919 00000020:00000080:1.0:1787893171.751066:0:15193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf08d3 00000100:00080000:1.0:1787893171.751073:0:15193:0:(import.c:65:import_set_state_nolock()) ffff9fc9fe132000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787893171.751084:0:15193:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc9fe132800): rc 0 00000020:00000080:1.0:1787893171.751086:0:15193:0:(genops.c:885:class_export_put()) final put ffff9fc9fe132800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1787893171.751090:0:15193:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9fc9fd344800), last request at 1787892919 00000020:00000080:1.0:1787893171.751093:0:15193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf088d 00000100:00080000:1.0:1787893171.751096:0:15193:0:(import.c:65:import_set_state_nolock()) ffff9fc9d29ec000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787893171.751102:0:15193:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00100000:1.0:1787893171.751624:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787893171.751646:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ad7764-cf95-4087-88aa-57e4229a8397+23:3630:x1874741493404032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787893171.751662:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893171.751687:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c771e000/0x9232577658cf0b8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9232577658cf0b88 expref: 23 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.751700:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893171.751767:0:10383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:19ad7764-cf95-4087-88aa-57e4229a8397+22:3630:x1874741493403904:12345-0@lo:103:ldlm_bl.0 Request processed in 1996us (2208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893171.751776:0:10383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787893171.752433:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493404288:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787893171.753037:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787893171.753096:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893171.753107:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493404160 00000100:00100000:2.0:1787893171.753114:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493404160 00000100:00100000:2.0:1787893171.753148:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787893171.753156:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe349c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ad7764-cf95-4087-88aa-57e4229a8397+22:3632:x1874741493404160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787893171.753166:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893171.753179:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9fe540400/0x9232577658cf0ef3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9232577658cf0eec expref: 22 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893171.753191:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893171.753219:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe349c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ad7764-cf95-4087-88aa-57e4229a8397+21:3632:x1874741493404160:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893171.753226:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787893171.753274:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ad7764-cf95-4087-88aa-57e4229a8397:3632:1874741493404160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787893171.753539:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ad7764-cf95-4087-88aa-57e4229a8397+20:3630:x1874741493404032:12345-0@lo:103:ldlm_bl.0 Request processed in 1896us (3896us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893171.753547:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000020:00080000:1.0:1787893171.753733:0:15193:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc9fd344800): rc 0 00000020:00000080:2.0:1787893171.754042:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9ffb40800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1787893171.754080:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9ffa87800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787893171.754099:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9fe132800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1787893171.754120:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc9ffb44000 for lustre-MDT0000 00000020:00000080:2.0:1787893171.754125:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc9ffa81800 for lustre-MDT0000 00000020:00000080:2.0:1787893171.754128:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc9fe132000 for lustre-MDT0000 00000004:00000080:1.0:1787893171.754177:0:15193:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbaa0c1a33ae0 00000100:00080000:1.0:1787893171.754223:0:15193:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787893171.754227:0:15193:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00080000:1.0:1787893171.755432:0:15193:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787893171.755457:0:15193:0:(import.c:65:import_set_state_nolock()) ffff9fc9c7e92800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1787893171.755640:0:15193:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787893171.755645:0:15193:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:1.0:1787893171.755657:0:15193:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787893171.755722:0:15193:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1787893171.755731:0:15193:0:(import.c:65:import_set_state_nolock()) ffff9fc8c64bd000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1787893171.755737:0:15193:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787893171.755749:0:15193:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:1.0:1787893171.755757:0:15193:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787893171.756391:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493404416:0@lo:39:umount.0 00000100:00100000:2.0:1787893171.756455:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893171.756487:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493404544:0@lo:9:umount.0 00000100:00100000:2.0:1787893171.756524:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893171.756558:0:7865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493404416 00000100:00100000:2.0:1787893171.756565:0:7865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493404416 00000100:00100000:2.0:1787893171.756605:0:7865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787893171.756637:0:7865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe349180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1874741493404416:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787893171.756667:0:7865:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf0927 00000100:00080000:2.0:1787893171.756674:0:7865:0:(import.c:65:import_set_state_nolock()) ffff9fc9fe301800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787893171.756693:0:7865:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1787893171.756836:0:7865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe349180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3629:x1874741493404416:12345-0@lo:39:umount.0 Request processed in 211us (381us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787893171.757023:0:7865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787893171.757048:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493404544 00000100:00100000:2.0:1787893171.757052:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493404544 00000100:00100000:2.0:1787893171.757076:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787893171.757082:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe348e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1874741493404544:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787893171.757096:0:8420:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf0a77 00000100:00080000:2.0:1787893171.757101:0:8420:0:(import.c:65:import_set_state_nolock()) ffff9fc8c64bb000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787893171.757128:0:8420:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1787893171.757198:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe348e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3629:x1874741493404544:12345-0@lo:9:umount.0 Request processed in 116us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893171.757204:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:2.0:1787893171.757224:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787893171.757248:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9c7e92800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787893171.757254:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493404416:0@lo:39:umount.0 00000100:00080000:2.0:1787893171.757263:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc8c64bd000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787893171.757272:0:3629:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787893171.757274:0:3629:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787893171.757276:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493404544:0@lo:9:umount.0 00000100:00080000:1.0:1787893171.757671:0:15193:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1787893171.757686:0:15193:0:(import.c:65:import_set_state_nolock()) ffff9fc9e71fd000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787893171.757957:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493403904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787893171.757989:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493404032:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787893171.758016:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787893171.758123:0:15193:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9fc9e2e399b8) has no exports 00000100:00100000:2.0:1787893171.758351:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493404672:0@lo:9:umount.0 00000100:00100000:2.0:1787893171.758391:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893171.758439:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493404672 00000100:00100000:2.0:1787893171.758444:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493404672 00000100:00100000:2.0:1787893171.758471:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787893171.758478:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe34a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3629:x1874741493404672:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787893171.758513:0:8535:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf0bb9 00000100:00080000:2.0:1787893171.758520:0:8535:0:(import.c:65:import_set_state_nolock()) ffff9fc9e71fb000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787893171.758548:0:8535:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1787893171.758650:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe34a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3629:x1874741493404672:12345-0@lo:9:umount.0 Request processed in 171us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893171.758657:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:2.0:1787893171.758676:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787893171.758692:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9e71fd000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787893171.758703:0:3629:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787893171.758704:0:3629:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787893171.758707:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493404672:0@lo:9:umount.0 00000001:00100000:0.0:1787893171.758816:0:6484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9c50492c-5fef-4e80-9bbb-0b2782d59443 00000001:00080000:0.0:1787893171.758826:0:6484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000020:00000080:0.0:1787893171.758830:0:6484:0:(genops.c:885:class_export_put()) final put ffff9fc8c75fc800/9c50492c-5fef-4e80-9bbb-0b2782d59443 00000001:00100000:0.0:1787893171.759000:0:6484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 58232959-285a-4954-a3ac-571a2b817017 00000001:00080000:0.0:1787893171.759007:0:6484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:0.0:1787893171.759015:0:6484:0:(genops.c:885:class_export_put()) final put ffff9fc9e71fe000/58232959-285a-4954-a3ac-571a2b817017 00000100:00100000:3.0:1787893171.759591:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787893171.759663:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893171.759685:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493404288 00000100:00100000:3.0:1787893171.759690:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493404288 00000100:00100000:3.0:1787893171.759726:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787893171.759733:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ad7764-cf95-4087-88aa-57e4229a8397+20:3633:x1874741493404288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787893171.759964:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893171.760022:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9edb30400/0x9232577658cf074b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9232577658cf0744 expref: 20 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893171.760037:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893171.760075:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ad7764-cf95-4087-88aa-57e4229a8397+19:3633:x1874741493404288:12345-0@lo:103:ldlm_bl.0 Request processed in 342us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893171.760081:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787893171.760146:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493404288:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1787893171.760197:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c75fc800/9c50492c-5fef-4e80-9bbb-0b2782d59443 for lustre-MDT0000 00000020:00000080:2.0:1787893171.760276:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc8c75fe800 for lustre-MDT0000 00000020:00000080:2.0:1787893171.760515:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9e71fe000/58232959-285a-4954-a3ac-571a2b817017 for lustre-MDT0000 00000020:00000080:2.0:1787893171.760548:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc9e71f8000 for lustre-MDT0000 00000020:00080000:1.0:1787893171.767389:0:15193:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9fc9e2e399b8) has no exports 00000020:00000080:1.0:1787893171.810249:0:15193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf079f 00000020:00000080:1.0:1787893171.810264:0:15193:0:(genops.c:885:class_export_put()) final put ffff9fc9e5eaa000/lustre-QMT0000_UUID 00000020:01000000:1.0:1787893171.810336:0:15193:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1787893171.810394:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9e5eaa000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1787893171.810417:0:15193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787893171.810428:0:15193:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787893171.810431:0:15193:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9fc9ed5799b8) has no exports 00000020:00000080:2.0:1787893171.811085:0:15193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf0798 00000020:00000080:2.0:1787893171.811092:0:15193:0:(genops.c:885:class_export_put()) final put ffff9fc9ed571800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787893171.811143:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9ed571800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787893171.811198:0:15193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787893171.811206:0:15193:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787893171.811209:0:15193:0:(genops.c:885:class_export_put()) final put ffff9fc9ed592000/lustre-QMT0000_UUID 00000020:00000080:2.0:1787893171.811211:0:15193:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9ed592000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1787893171.811223:0:15193:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:0.0:1787893171.891537:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787893172.853317:0:13789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787893172.913757:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893173.426862:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787893173.426886:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493404800:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787893173.427353:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893173.427526:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493404800 00000100:00100000:0.0:1787893173.427535:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493404800 00000100:00100000:0.0:1787893173.427618:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787893173.427629:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493404800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787893173.427824:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787893173.427887:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493404800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 260us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893173.427894:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:3.0:1787893173.428279:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787893173.428312:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493404800:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787893173.942592:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787893173.944074:0:7436:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1787893173.944089:0:7436:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:3.0:1787893173.944094:0:7436:0:(genops.c:885:class_export_put()) final put ffff9fc9fe137800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787893173.944268:0:7436:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 9c50492c-5fef-4e80-9bbb-0b2782d59443 00000001:00080000:3.0:1787893173.944276:0:7436:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:3.0:1787893173.944278:0:7436:0:(genops.c:885:class_export_put()) final put ffff9fc8c75fd800/9c50492c-5fef-4e80-9bbb-0b2782d59443 00000001:00100000:3.0:1787893173.944286:0:7436:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 58232959-285a-4954-a3ac-571a2b817017 00000001:00080000:3.0:1787893173.944289:0:7436:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:3.0:1787893173.944291:0:7436:0:(genops.c:885:class_export_put()) final put ffff9fc9e71ff800/58232959-285a-4954-a3ac-571a2b817017 00000020:00000080:2.0:1787893173.945474:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9fe137800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1787893173.945569:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c75fd800/9c50492c-5fef-4e80-9bbb-0b2782d59443 for lustre-MDT0001 00000020:00000080:2.0:1787893173.945596:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9e71ff800/58232959-285a-4954-a3ac-571a2b817017 for lustre-MDT0001 00000020:00000080:2.0:1787893173.945629:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc9fe301800 for lustre-MDT0001 00000020:00000080:2.0:1787893173.945634:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc8c75f9000 for lustre-MDT0001 00000020:00000080:2.0:1787893173.945637:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc9e71f9800 for lustre-MDT0001 00000001:00100000:3.0:1787893173.948591:0:8413:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787893173.948602:0:8413:0:(genops.c:885:class_export_put()) final put ffff9fc8c64bb800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787893173.948669:0:8413:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 58232959-285a-4954-a3ac-571a2b817017 00000020:00000080:3.0:1787893173.948672:0:8413:0:(genops.c:885:class_export_put()) final put ffff9fc8c7f30000/58232959-285a-4954-a3ac-571a2b817017 00000001:00100000:2.0:1787893173.949139:0:9497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787893173.949144:0:9497:0:(genops.c:885:class_export_put()) final put ffff9fc9e71fa000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787893173.949152:0:9497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 58232959-285a-4954-a3ac-571a2b817017 00000020:00000080:2.0:1787893173.949154:0:9497:0:(genops.c:885:class_export_put()) final put ffff9fc9d0f71000/58232959-285a-4954-a3ac-571a2b817017 00000020:00000080:0.0:1787893173.950177:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c64bb800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1787893173.950232:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c7f30000/58232959-285a-4954-a3ac-571a2b817017 for lustre-OST0000 00000020:00000080:0.0:1787893173.950249:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9e71fa000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787893173.950264:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9d0f71000/58232959-285a-4954-a3ac-571a2b817017 for lustre-OST0001 00000020:00000080:0.0:1787893173.950280:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc8c64bb000 for lustre-OST0000 00000020:00000080:0.0:1787893173.950285:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc8c7f34000 for lustre-OST0000 00000020:00000080:0.0:1787893173.950289:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc9e71fb000 for lustre-OST0001 00000020:00000080:0.0:1787893173.950293:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc9d0f77800 for lustre-OST0001 00010000:00010000:3.0:1787893174.961943:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893175.985711:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893175.985912:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493404928:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787893175.986039:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893175.986617:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493404928 00000100:00100000:0.0:1787893175.986626:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493404928 00000100:00100000:0.0:1787893175.986718:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1787893175.986728:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3631:x1874741493404928:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1787893175.986746:0:6510:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787893175.986801:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3631:x1874741493404928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (762us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787893175.986807:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:02020000:3.0:1787893175.986874:0:3631:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1787893176.002300:0:3631:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787893176.002311:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9fc9e6fb8800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787893176.002316:0:3631:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787893176.027775:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9fc9e6fb8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787893176.027789:0:3631:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 163 00000100:00080000:3.0:1787893176.027798:0:3631:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9fc9e6fb8800 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:3.0:1787893176.027866:0:3631:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c76f7b80 x1874741493405056/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787893176.028026:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493405056:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1787893176.028102:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893176.029339:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493405056 00000100:00100000:3.0:1787893176.029351:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493405056 00000100:00100000:3.0:1787893176.032774:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1787893176.032787:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3629:x1874741493405056:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1787893176.032808:0:6509:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787893176.042645:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3629:x1874741493405056:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 9847us (14531us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787893176.042660:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00080000:1.0:1787893176.042961:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9e6fb8800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787893176.042968:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787893176.042973:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493405056:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:0.0:1787893176.497733:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787893176.497742:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787893176.497746:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fc9e6fb8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787893176.497757:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 419 00000100:00080000:0.0:1787893176.497763:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787893176.497772:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9fc9e6fb8800 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:0.0:1787893176.497800:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c7ce1c00 x1874741493405312/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787893176.498111:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874741493405440:0@lo:400:kworker.0 00000100:00100000:1.0:1787893176.498233:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893176.498296:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1874741493405952:0@lo:400:kworker.0 00000100:00100000:1.0:1787893176.498319:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893176.498341:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787893176.498347:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493405184:0@lo:400:kworker.0 00000100:00100000:1.0:1787893176.498376:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893176.498399:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493405824:0@lo:400:kworker.0 00000100:00100000:1.0:1787893176.498425:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893176.498452:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493405312:0@lo:38:kworker.0 00000100:00100000:1.0:1787893176.498476:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893176.498528:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493405440 00000100:00100000:1.0:1787893176.498537:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493405440 00000100:00100000:1.0:1787893176.498569:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493405952 00000100:00100000:1.0:1787893176.498572:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493405952 00000100:00100000:1.0:1787893176.498601:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787893176.498607:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3633:x1874741493405440:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787893176.498615:0:6505:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787893176.498656:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3633:x1874741493405440:12345-0@lo:400:kworker.0 Request processed in 48us (424us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787893176.498675:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787893176.498693:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787893176.498697:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3633:x1874741493405952:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787893176.498702:0:6505:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787893176.498725:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3633:x1874741493405952:12345-0@lo:400:kworker.0 Request processed in 26us (405us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787893176.498731:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787893176.498747:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493405184 00000100:00100000:1.0:1787893176.498751:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493405184 00000100:00100000:1.0:1787893176.498776:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:1.0:1787893176.498783:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f352dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+19:3633:x1874741493405184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893176.498818:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f352dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ad7764-cf95-4087-88aa-57e4229a8397+19:3633:x1874741493405184:12345-0@lo:400:kworker.0 Request processed in 35us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893176.498824:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:1.0:1787893176.498861:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493405184:0@lo:400:kworker.0 00000100:00080000:1.0:1787893176.498872:0:3633:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787893176.498876:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9fc9fe093000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787893176.498879:0:3633:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787893176.498884:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9fc9fe093000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787893176.498887:0:3633:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 163 00000100:00080000:1.0:1787893176.498892:0:3633:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9fc9fe093000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:1.0:1787893176.498909:0:3633:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9ffb7f800 x1874741493406336/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787893176.498924:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874741493405440:0@lo:400:kworker.0 00000100:00080000:1.0:1787893176.498943:0:3633:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787893176.498945:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9fc9e70be000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787893176.498948:0:3633:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787893176.498951:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9fc9e70be000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787893176.498954:0:3633:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 205 00000100:00080000:1.0:1787893176.498958:0:3633:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fc9e70be000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:1.0:1787893176.498971:0:3633:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9ffb7e300 x1874741493406464/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787893176.498981:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1874741493405952:0@lo:400:kworker.0 00000100:00100000:1.0:1787893176.499028:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3629:1874741493406336:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1787893176.499210:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787893176.499219:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493406592:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787893176.499251:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893176.499281:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1874741493405696:0@lo:400:kworker.0 00000100:00100000:3.0:1787893176.499307:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893176.499328:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493405696 00000100:00100000:3.0:1787893176.499339:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493405696 00000100:00100000:3.0:1787893176.499377:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:3.0:1787893176.499385:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1874741493405696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893176.499417:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1874741493405696:12345-0@lo:400:kworker.0 Request processed in 34us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893176.499423:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00080000:3.0:1787893176.499438:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787893176.499456:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7ce1500 x1874741493405696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893176.499467:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1874741493405696:0@lo:400:kworker.0 00000100:00100000:3.0:1787893176.499473:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493406208:0@lo:400:kworker.0 00000100:00100000:3.0:1787893176.499509:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893176.499533:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787893176.499539:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1874741493405568:0@lo:400:kworker.0 00000100:00100000:3.0:1787893176.499561:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893176.499579:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1874741493406080:0@lo:400:kworker.0 00000100:00100000:3.0:1787893176.499612:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893176.499632:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493405568 00000100:00100000:3.0:1787893176.499636:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493405568 00000100:00100000:3.0:1787893176.499655:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493406080 00000100:00100000:3.0:1787893176.499658:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493406080 00000100:00100000:3.0:1787893176.499677:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:3.0:1787893176.499684:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1874741493406080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893176.499714:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1874741493406080:12345-0@lo:400:kworker.0 Request processed in 31us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893176.499719:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:3.0:1787893176.499739:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787893176.499743:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3631:x1874741493405568:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787893176.499749:0:10086:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787893176.499772:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3631:x1874741493405568:12345-0@lo:400:kworker.0 Request processed in 28us (211us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787893176.499778:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:3.0:1787893176.499790:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787893176.499806:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7ce0a80 x1874741493406080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893176.499815:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1874741493406080:0@lo:400:kworker.0 00000100:00080000:3.0:1787893176.499829:0:3631:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787893176.499833:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9fc9fe097800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787893176.499836:0:3631:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787893176.499840:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9fc9fe097800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787893176.499844:0:3631:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 185 00000100:00080000:3.0:1787893176.499848:0:3631:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9fc9fe097800 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:3.0:1787893176.499864:0:3631:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c76f6680 x1874741493406720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787893176.499876:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1874741493405568:0@lo:400:kworker.0 00000100:00100000:2.0:1787893176.499997:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493405824 00000100:00100000:2.0:1787893176.500002:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493405824 00000100:00100000:2.0:1787893176.500056:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493406208 00000100:00100000:2.0:1787893176.500060:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493406208 00000100:00100000:2.0:1787893176.500082:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787893176.500089:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493405824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893176.500129:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493405824:12345-0@lo:400:kworker.0 Request processed in 41us (1703us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893176.500134:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787893176.500145:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787893176.500150:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493406208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893176.500175:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493406208:12345-0@lo:400:kworker.0 Request processed in 26us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893176.500187:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787893176.500210:0:9932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493406592 00000100:00100000:2.0:1787893176.500213:0:9932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493406592 00000100:00100000:2.0:1787893176.500232:0:9932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787893176.500238:0:9932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493406592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787893176.500257:0:9932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787893176.500283:0:9932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493406592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893176.500287:0:9932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787893176.500330:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493406592:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787893176.500340:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493405824:0@lo:400:kworker.0 00000100:00100000:2.0:1787893176.500380:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493406208:0@lo:400:kworker.0 00000100:00100000:0.0:1787893176.500655:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493405312 00000100:00100000:0.0:1787893176.500660:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493405312 00000100:00100000:0.0:1787893176.500696:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1787893176.500702:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3629:x1874741493405312:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1787893176.500718:0:6510:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787893176.500756:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3629:x1874741493405312:12345-0@lo:38:kworker.0 Request processed in 53us (2279us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787893176.500762:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00080000:3.0:1787893176.500824:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787893176.500828:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787893176.502014:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893176.502136:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3629:1874741493406464:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1787893176.502169:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787893176.502217:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9e6fb8800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787893176.502222:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787893176.502226:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493405312:0@lo:38:kworker.0 00000100:00100000:1.0:1787893176.502251:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3629:1874741493406720:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1787893176.502275:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893176.503100:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493406336 00000100:00100000:0.0:1787893176.503110:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493406336 00000100:00100000:0.0:1787893176.503153:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493406464 00000100:00100000:0.0:1787893176.503157:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493406464 00000100:00100000:0.0:1787893176.503179:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493406720 00000100:00100000:0.0:1787893176.503182:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493406720 00000100:00100000:0.0:1787893176.503203:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787893176.503211:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3629:x1874741493406336:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1787893176.503231:0:9515:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787893176.503286:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3629:x1874741493406336:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 75us (1276us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787893176.503293:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787893176.503308:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787893176.503311:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3629:x1874741493406464:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1787893176.503317:0:9515:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787893176.503341:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3629:x1874741493406464:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 27us (1171us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787893176.503346:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787893176.503357:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787893176.503374:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3629:x1874741493406720:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1787893176.503382:0:9515:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787893176.503407:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3629:x1874741493406720:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 32us (1131us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787893176.503412:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:1.0:1787893176.503631:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9fe097800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787893176.503637:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787893176.503641:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3629:1874741493406720:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:1.0:1787893176.503651:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9fe093000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787893176.503661:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787893176.503663:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3629:1874741493406336:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:1.0:1787893176.503674:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9e70be000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787893176.503677:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787893176.503679:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3629:1874741493406464:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:3.0:1787893177.009811:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787893177.011732:0:6484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787893177.011741:0:6484:0:(genops.c:885:class_export_put()) final put ffff9fc9fd344800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787893177.011825:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9fd344800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1787893177.011889:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc9d29ec000 for lustre-MDT0000 00000020:01000000:2.0:1787893177.905733:0:15193:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fc8c10a01e0 - data ffff9fc9f43275e8/ffff9fc8c7501800 00000020:01000000:2.0:1787893177.905935:0:15193:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fc9c297da80 - data ffff9fc9f4046000/ffff9fc9e5f8d400 00000001:00000004:2.0:1787893177.915890:0:15193:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00080000:3.0:1787893177.992048:0:15193:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787893177.992058:0:15193:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1787893177.992073:0:15193:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9fc9ffb7dc00 x1874741493404416/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787893181 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893177.992117:0:15193:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1787893177.993733:0:15193:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787893177.993740:0:15193:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:3.0:1787893177.993819:0:15193:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787893177.993823:0:15193:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787893177.994961:0:8533:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787893177.994966:0:8533:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1787893177.994976:0:8533:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1787893177.995971:0:15193:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787893177.995977:0:15193:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:1.0:1787893177.995990:0:15193:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787893177.995992:0:15193:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787893177.996233:0:10003:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787893177.996237:0:10003:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:3.0:1787893177.996246:0:10003:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1787893177.997579:0:15193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf0767 00000020:00000080:1.0:1787893177.997590:0:15193:0:(genops.c:885:class_export_put()) final put ffff9fc9ed577800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787893178.003261:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9ed577800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787893178.006926:0:15193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf077c 00000020:00000080:0.0:1787893178.006941:0:15193:0:(genops.c:885:class_export_put()) final put ffff9fc9ed590800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787893178.006999:0:15193:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1787893178.007005:0:15193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787893178.007014:0:15193:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787893178.007036:0:15193:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9fc9e2e3cd28) has no exports 00000004:01000000:0.0:1787893178.007254:0:15193:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1787893178.007264:0:15193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf0bb2 00000020:00000080:0.0:1787893178.007270:0:15193:0:(genops.c:885:class_export_put()) final put ffff9fc9e71fa800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787893178.008143:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9ed590800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787893178.008339:0:15193:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787893178.008349:0:15193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787893178.008362:0:15193:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787893178.008367:0:15193:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff9fc8c7733370) has no exports 00000020:00000080:0.0:1787893178.008376:0:15193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf0bab 00000020:00000080:0.0:1787893178.008383:0:15193:0:(genops.c:885:class_export_put()) final put ffff9fc9e71fc800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787893178.008413:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9e71fa800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:0.0:1787893178.008885:0:15193:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787893178.008889:0:15193:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787893178.008894:0:15193:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:0.0:1787893178.008900:0:15193:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787893178.008911:0:15193:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787893178.009301:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9e71fc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787893178.009396:0:15193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787893178.009409:0:15193:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787893178.009417:0:15193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf0a70 00000020:00000080:0.0:1787893178.009423:0:15193:0:(genops.c:885:class_export_put()) final put ffff9fc8c64be000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787893178.009442:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc9e71fd000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787893178.009448:0:38:0:(genops.c:885:class_export_put()) final put ffff9fc9e71fc000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787893178.009450:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9e71fc000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1787893178.009455:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787893178.009629:0:15193:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787893178.009633:0:15193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787893178.009640:0:15193:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787893178.009643:0:15193:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9fc9d911cd28) has no exports 00000020:00000080:0.0:1787893178.009649:0:15193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf0a69 00000020:00000080:0.0:1787893178.009653:0:15193:0:(genops.c:885:class_export_put()) final put ffff9fc8c64bc800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787893178.009672:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c64be000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:0.0:1787893178.010090:0:15193:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787893178.010094:0:15193:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787893178.010097:0:15193:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:0.0:1787893178.010102:0:15193:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787893178.010103:0:15193:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787893178.010429:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c64bc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787893178.010536:0:15193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787893178.010545:0:15193:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1787893178.010558:0:15193:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1787893178.010566:0:15193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf0920 00000020:00000080:0.0:1787893178.010613:0:15193:0:(genops.c:885:class_export_put()) final put ffff9fc9fe300000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787893178.010647:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc8c64bd000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787893178.010653:0:38:0:(genops.c:885:class_export_put()) final put ffff9fc8c64bc000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787893178.010655:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c64bc000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1787893178.010659:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787893178.010769:0:15193:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1787893178.010773:0:15193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787893178.010778:0:15193:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787893178.010782:0:15193:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9fc9ed57b370) has no exports 00000020:00000080:0.0:1787893178.010787:0:15193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf0919 00000020:00000080:0.0:1787893178.010790:0:15193:0:(genops.c:885:class_export_put()) final put ffff9fc9e2ebf000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787893178.010821:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9fe300000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1787893178.011342:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9e2ebf000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1787893178.013590:0:15193:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1787893178.013598:0:15193:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787893178.013602:0:15193:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1787893178.013610:0:15193:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787893178.013657:0:15193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787893178.013670:0:15193:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787893178.013697:0:15193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787893178.013700:0:15193:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787893178.013706:0:15193:0:(genops.c:885:class_export_put()) final put ffff9fc9ed576000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787893178.013711:0:15193:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9ed576000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1787893178.013717:0:15193:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787893178.013814:0:15193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf0783 00000020:00000080:1.0:1787893178.013821:0:15193:0:(genops.c:885:class_export_put()) final put ffff9fc9ed596000/lustre-MDD0000_UUID 00000020:01000000:1.0:1787893178.013826:0:15193:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1787893178.013829:0:15193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787893178.013834:0:15193:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787893178.013837:0:15193:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9fc9ed57cd28) has no exports 00000020:00000080:1.0:1787893178.013856:0:15193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787893178.013870:0:15193:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1787893178.013874:0:15193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf078a 00000020:00000080:1.0:1787893178.013878:0:15193:0:(genops.c:885:class_export_put()) final put ffff9fc9ed594800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787893178.013887:0:15193:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc9d909c800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1787893178.013890:0:15193:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc9d909c800 3 00000020:01000004:1.0:1787893178.013893:0:15193:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fc9d909c800 from lustre-MDT0000 00000020:00000080:1.0:1787893178.013910:0:15193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787893178.013913:0:15193:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1787893178.013915:0:15193:0:(genops.c:885:class_export_put()) final put ffff9fc9ed576800/lustre-MDT0000_UUID 00000020:00000080:1.0:1787893178.013917:0:15193:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9ed576800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1787893178.013923:0:15193:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1787893178.013953:0:15193:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1787893178.013956:0:15193:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1787893178.013959:0:15193:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1787893178.013961:0:15193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787893178.013964:0:15193:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787893178.013972:0:15193:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9fc9c5fda800 19ad7764-cf95-4087-88aa-57e4229a8397 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787893178.013977:0:15193:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9fc9c2f3b370) has exports, disconnecting them 00000020:00080000:1.0:1787893178.013981:0:15193:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9fc9c5fda800), last request at 1787892899 00000020:00000080:1.0:1787893178.013996:0:15193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf0728 00000020:00010000:1.0:1787893178.014000:0:15193:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9fc9c5fda800: total 2 00000100:00080000:1.0:1787893178.014004:0:15193:0:(import.c:65:import_set_state_nolock()) ffff9fc9c5fda000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787893178.014016:0:15193:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc9c5fda800): rc 0 00000020:00080000:1.0:1787893178.014021:0:15193:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9fc9c2f3b370) has no exports 00000100:00100000:1.0:1787893178.014093:0:6500:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9fc9edae9e00:6500] 2 exiting: rc = 0 00000100:00100000:1.0:1787893178.014366:0:6499:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9fc9c5e94000:6499] 1 exiting: rc = 0 00000100:00100000:1.0:1787893178.014446:0:6497:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9fc9edae9800:6497] 0 exiting: rc = 1 00000100:00100000:1.0:1787893178.014521:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014529:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014534:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014540:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014546:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014558:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014565:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014585:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014591:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014597:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014602:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014614:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014620:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014626:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014631:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014637:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014642:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014647:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014653:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014659:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014665:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014670:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014676:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014682:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014688:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014694:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014700:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014706:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014711:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014718:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014724:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014729:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014733:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014739:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014744:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014750:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014756:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014762:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014768:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014773:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014786:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014792:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014797:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014803:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014808:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014813:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014818:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014823:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014828:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014834:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014839:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014844:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014849:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014854:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014859:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014864:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014869:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014873:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014879:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014884:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014889:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014894:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014899:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893178.014904:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00010000:3.0:1787893178.016072:0:8435:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9fc9c5fda800: total 2 00010000:00010000:3.0:1787893178.016129:0:8435:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fc9c5fda800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1787893178.016357:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9fe541000/0x9232577658cf0c37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9232577658cf0c30 expref: 14 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893178.016386:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9dd729400/0x9232577658cf0b49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9232577658cf0b42 expref: 13 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893178.016400:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9c147c800/0x9232577658cf0c45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9232577658cf0c3e expref: 12 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893178.016410:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9c147d200/0x9232577658cf0c53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9232577658cf0c4c expref: 11 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893178.016419:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c771f800/0x9232577658cf0c61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9232577658cf0c5a expref: 10 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893178.016429:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9dd729600/0x9232577658cf0832 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9232577658cf082b expref: 9 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893178.016440:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf0ec9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9232577658cf0ec2 expref: 8 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893178.016449:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9fe540200/0x9232577658cf0c6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9232577658cf0c68 expref: 7 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893178.016461:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9c147dc00/0x9232577658cf0ed7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9232577658cf0ed0 expref: 6 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893178.016470:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9fe541400/0x9232577658cf0ee5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9232577658cf0ede expref: 5 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893178.016480:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c771ea00/0x9232577658cf0c99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9232577658cf0c92 expref: 4 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893178.016518:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9edb30a00/0x9232577658cf0c29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9232577658cf0c22 expref: 3 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893178.016528:0:8435:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fc9c5fda800, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1787893178.016548:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893178.016551:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893178.016553:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787893178.016563:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc9c7e92800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1787893178.016579:0:38:0:(genops.c:885:class_export_put()) final put ffff9fc9fd159800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787893178.016583:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9fd159800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1787893178.016588:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787893178.016632:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9ed596000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1787893178.016636:0:38:0:(genops.c:885:class_export_put()) final put ffff9fc9ed571000/lustre-MDD0000_UUID 00000020:00000080:3.0:1787893178.016639:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9ed571000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1787893178.016642:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1787893178.016667:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9ed594800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1787893178.016715:0:15193:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9fc9dd729800/0x9232577658cf0824 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x9232577658cf081d expref: 14 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893178.016726:0:15193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9dd729800/0x9232577658cf0824 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x9232577658cf081d expref: 1 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1787893178.016733:0:15193:0:(genops.c:885:class_export_put()) final put ffff9fc9c5fda800/19ad7764-cf95-4087-88aa-57e4229a8397 00000020:00000080:3.0:1787893178.016792:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9c5fda800/19ad7764-cf95-4087-88aa-57e4229a8397 for MGS 00000020:00000080:3.0:1787893178.016830:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc9c5fda000 for MGS 00000020:01000000:1.0:1787893178.016889:0:15193:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fc8c7184d80 - data ffff9fc8c582d438/ffff9fc8c769ec00 00000020:01000000:1.0:1787893178.017010:0:15193:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fc9d0c52e40 - data ffff9fc9f4069510/ffff9fc9c876e000 00000020:00000080:1.0:1787893178.017766:0:15193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf070c 00000020:00000080:1.0:1787893178.017782:0:15193:0:(genops.c:885:class_export_put()) final put ffff9fc9c4b36000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787893178.017799:0:15193:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc9d909c800 from MGS, refs=2 00000020:01000004:1.0:1787893178.017801:0:15193:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc9d909c800 2 00000020:01000004:1.0:1787893178.017804:0:15193:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fc9d909c800 from MGS 00000020:00000080:1.0:1787893178.017822:0:15193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787893178.017828:0:15193:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1787893178.017830:0:15193:0:(genops.c:885:class_export_put()) final put ffff9fc9c4b37000/MGS 00000020:00000080:1.0:1787893178.017832:0:15193:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9c4b37000/MGS for MGS 00000020:01000000:1.0:1787893178.017837:0:15193:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1787893178.017893:0:15193:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1787893178.017897:0:15193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787893178.017903:0:15193:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787893178.017907:0:15193:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9fc9d29eb000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787893178.017913:0:15193:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9fc9c2f38000) has exports, disconnecting them 00000020:00080000:1.0:1787893178.017917:0:15193:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9fc9d29eb000), last request at 1787892899 00000020:00000080:1.0:1787893178.017921:0:15193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf07d7 00000020:00080000:1.0:1787893178.017932:0:15193:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc9d29eb000): rc 0 00000020:00000080:1.0:1787893178.017936:0:15193:0:(genops.c:885:class_export_put()) final put ffff9fc9d29eb000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787893178.018233:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9c4b36000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787893178.018240:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9d29eb000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1787893178.066636:0:15193:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1787893178.066645:0:15193:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787893178.066650:0:15193:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787893178.066657:0:15193:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787893178.066864:0:15193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787893178.066881:0:15193:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1787893178.066888:0:15193:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc9d909c800 1 00000020:00000080:0.0:1787893178.066895:0:15193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf06fe 00000020:00000080:0.0:1787893178.066902:0:15193:0:(genops.c:885:class_export_put()) final put ffff9fc9c4b33800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1787893178.066908:0:15193:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1787893178.066911:0:15193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787893178.066915:0:15193:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787893178.066918:0:15193:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9fc9d91199b8) has no exports 00000020:00000080:3.0:1787893178.067112:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc9d29ea000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787893178.067121:0:8:0:(genops.c:885:class_export_put()) final put ffff9fc9d29ed800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1787893178.067124:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9d29ed800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1787893178.067133:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1787893178.067214:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9c4b33800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1787893178.283918:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787893178.304481:0:15193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787893178.304519:0:15193:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1787893178.304525:0:15193:0:(genops.c:885:class_export_put()) final put ffff9fc9d909d800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787893178.304530:0:15193:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9d909d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787893178.304537:0:15193:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1787893178.304671:0:15193:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9fc9d9099000 00000020:02000400:0.0:1787893178.304728:0:15193:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:0.0:1787893178.551950:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493406848:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787893178.552078:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893178.552151:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493406848 00000100:00100000:0.0:1787893178.552159:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493406848 00000100:00100000:0.0:1787893178.552212:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787893178.552222:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493406848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787893178.552251:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787893178.552292:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493406848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893178.552299:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:0.0:1787893178.552320:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787893178.552352:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493406848:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787893179.313683:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893180.349635:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893181.361673:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787893181.617946:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787893181.617959:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787893181.617963:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fc9e6fb8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787893181.617971:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 420 00000100:00100000:2.0:1787893181.618128:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493406976:0@lo:400:kworker.0 00000100:00100000:3.0:1787893181.618143:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493407104:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787893181.618196:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787893181.618204:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9fc9e6fb8800 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:0.0:1787893181.618227:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c7ce2680 x1874741493407232/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787893181.618249:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787893181.618253:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787893181.618254:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fc9fe093000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787893181.618258:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 420 00000100:00080000:0.0:1787893181.618260:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787893181.618264:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9fc9fe093000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:0.0:1787893181.618275:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c7ce1880 x1874741493407360/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787893181.618283:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787893181.618286:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787893181.618288:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fc9fe097800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787893181.618291:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 420 00000100:00080000:0.0:1787893181.618293:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787893181.618296:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9fc9fe097800 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:0.0:1787893181.618306:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c7ce0a80 x1874741493407488/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787893181.618335:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787893181.618343:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787893181.618345:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fc9e70be000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787893181.618349:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 420 00000100:00080000:0.0:1787893181.618352:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787893181.618356:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fc9e70be000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:0.0:1787893181.618368:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c7ce3100 x1874741493407872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787893181.618400:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493407616:0@lo:400:kworker.0 00000100:00100000:1.0:1787893181.618465:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493407232:0@lo:38:kworker.0 00000100:00100000:3.0:1787893181.623268:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893181.623353:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493408128:0@lo:400:kworker.0 00000100:00100000:3.0:1787893181.623396:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893181.623420:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787893181.623426:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1874741493408000:0@lo:400:kworker.0 00000100:00100000:3.0:1787893181.623452:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893181.623590:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493407104 00000100:00100000:3.0:1787893181.623598:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493407104 00000100:00100000:3.0:1787893181.623649:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787893181.623658:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493407104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787893181.623835:0:8422:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787893181.623879:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493407104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 222us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893181.623886:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787893181.623908:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493408000 00000100:00100000:3.0:1787893181.623912:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493408000 00000100:00100000:3.0:1787893181.623939:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:3.0:1787893181.623945:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1874741493408000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893181.623975:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1874741493408000:12345-0@lo:400:kworker.0 Request processed in 31us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893181.623982:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00080000:3.0:1787893181.623996:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787893181.624001:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787893181.624029:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9fc8c7ce1f80 x1874741493408000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893181.624042:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1874741493408000:0@lo:400:kworker.0 00000100:00100000:3.0:1787893181.624075:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493407104:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787893181.627207:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493408128 00000100:00100000:3.0:1787893181.627221:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493408128 00000100:00100000:3.0:1787893181.627436:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787893181.627447:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493408128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893181.627613:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493408128:12345-0@lo:400:kworker.0 Request processed in 168us (4215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893181.627622:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787893181.627661:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493408128:0@lo:400:kworker.0 00000100:00100000:3.0:1787893181.627709:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493407744:0@lo:400:kworker.0 00000100:00100000:3.0:1787893181.627746:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893181.627797:0:8535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493407744 00000100:00100000:3.0:1787893181.627801:0:8535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493407744 00000100:00100000:3.0:1787893181.627834:0:8535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787893181.627853:0:8535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7524a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493407744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893181.627889:0:8535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7524a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493407744:12345-0@lo:400:kworker.0 Request processed in 49us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893181.627896:0:8535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:3.0:1787893181.627910:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787893181.627928:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493407744:0@lo:400:kworker.0 00000400:00000100:2.0:1787893181.633996:0:3630:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874741493406976 offset 0 length 224: 4 00000100:00100000:0.0:1787893181.638101:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893181.639406:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493407616 00000100:00100000:2.0:1787893181.639419:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493407616 00000100:00100000:2.0:1787893181.639518:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:2.0:1787893181.639529:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493407616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893181.639635:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493407616:12345-0@lo:400:kworker.0 Request processed in 108us (1540us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893181.639643:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00010000:00080000:2.0:1787893181.639691:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9fc8c7ce1500 x1874741493407616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893181.639706:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493407616:0@lo:400:kworker.0 00000100:00080000:3.0:1787893181.640641:0:6501:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787893181.642931:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893181.642966:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3629:1874741493407360:0@lo:38:kworker.0 00000100:00100000:1.0:1787893181.643012:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893181.643038:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3629:1874741493407488:0@lo:38:kworker.0 00000100:00100000:1.0:1787893181.643056:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893181.643092:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493407360 00000100:00100000:1.0:1787893181.643098:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493407360 00000100:00100000:1.0:1787893181.643131:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493407488 00000100:00100000:1.0:1787893181.643134:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493407488 00000100:00100000:1.0:1787893181.643149:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1787893181.643155:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3629:x1874741493407360:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787893181.643184:0:6505:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787893181.643216:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3629:x1874741493407360:12345-0@lo:38:kworker.0 Request processed in 61us (204us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787893181.643224:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1787893181.643239:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1787893181.643243:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3629:x1874741493407488:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787893181.643252:0:6505:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787893181.643270:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3629:x1874741493407488:12345-0@lo:38:kworker.0 Request processed in 26us (212us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787893181.643275:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00080000:1.0:1787893181.643312:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9fe097800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787893181.643317:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787893181.643320:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3629:1874741493407488:0@lo:38:kworker.0 00000100:00100000:1.0:1787893181.643327:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3629:1874741493407872:0@lo:38:kworker.0 00000100:00100000:1.0:1787893181.643348:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893181.643370:0:13436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493407872 00000100:00100000:1.0:1787893181.643373:0:13436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493407872 00000100:00100000:2.0:1787893181.643434:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493407232 00000100:00100000:2.0:1787893181.643439:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493407232 00000100:00100000:2.0:1787893181.643464:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1787893181.643468:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3629:x1874741493407232:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787893181.643479:0:6509:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787893181.643530:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3629:x1874741493407232:12345-0@lo:38:kworker.0 Request processed in 61us (604us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787893181.643547:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787893181.645114:0:13436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1787893181.645124:0:13436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3629:x1874741493407872:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787893181.645144:0:13436:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787893181.645201:0:13436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3629:x1874741493407872:12345-0@lo:38:kworker.0 Request processed in 76us (1851us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787893181.645208:0:13436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:0.0:1787893181.653655:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9e70be000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787893181.653669:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787893181.653674:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3629:1874741493407872:0@lo:38:kworker.0 00000100:00080000:0.0:1787893181.653708:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9e6fb8800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787893181.653712:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787893181.653715:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493407232:0@lo:38:kworker.0 00000100:00080000:0.0:1787893181.653724:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9fe093000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787893181.653726:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787893181.653729:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3629:1874741493407360:0@lo:38:kworker.0 00000040:00080000:3.0:1787893182.066193:0:13789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:1.0:1787893182.259787:0:15394:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1787893182.272038:0:15394:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1787893182.272097:0:15394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf0c5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0c61 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893182.272133:0:15394:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf0c5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0c61 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893182.272140:0:15394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf0c5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf0c61 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893182.272148:0:15394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf0c5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf0c61 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893182.272169:0:15394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787893182.272174:0:15394:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787893182.272200:0:15394:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787893182.272205:0:15394:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787893182.272211:0:15394:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787893182.272218:0:15394:0:(import.c:65:import_set_state_nolock()) ffff9fc9fe093000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1787893182.272222:0:15394:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787893182.272224:0:15394:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787893182.272227:0:15394:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787893182.273269:0:15394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf0c68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0c6f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893182.273283:0:15394:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf0c68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0c6f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893182.273290:0:15394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf0c68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf0c6f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893182.273296:0:15394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf0c68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf0c6f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893182.273336:0:15394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787893182.273343:0:15394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf0b42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0b49 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893182.273350:0:15394:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf0b42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0b49 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893182.273356:0:15394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf0b42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf0b49 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893182.273362:0:15394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf0b42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf0b49 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893182.273378:0:15394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787893182.273384:0:15394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541e00/0x9232577658cf0ede lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0ee5 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893182.273390:0:15394:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541e00/0x9232577658cf0ede lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0ee5 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893182.273396:0:15394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541e00/0x9232577658cf0ede lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf0ee5 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893182.273402:0:15394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541e00/0x9232577658cf0ede lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf0ee5 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893182.273409:0:15394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1787893182.273414:0:15394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728000/0x9232577658cf082b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0832 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893182.273426:0:15394:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728000/0x9232577658cf082b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0832 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893182.273433:0:15394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728000/0x9232577658cf082b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf0832 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893182.273439:0:15394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728000/0x9232577658cf082b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf0832 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893182.273447:0:15394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:3.0:1787893182.273450:0:15394:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1787893182.273477:0:15394:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1787893182.273481:0:15394:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1787893182.273485:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787893182.273511:0:15394:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1787893182.273519:0:15394:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9fc8c5f16800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787893182.273524:0:15394:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9fc9ffa84800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787893182.273528:0:15394:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9fc9fd3399b8) has exports, disconnecting them 00000020:00080000:3.0:1787893182.273545:0:15394:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9fc8c5f16800), last request at 1787893181 00000020:00000080:3.0:1787893182.273552:0:15394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf0b0a 00000100:00080000:3.0:1787893182.273568:0:15394:0:(import.c:65:import_set_state_nolock()) ffff9fc8c5f17000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787893182.273616:0:15394:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc8c5f16800): rc 0 00000020:00000080:3.0:1787893182.273619:0:15394:0:(genops.c:885:class_export_put()) final put ffff9fc8c5f16800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1787893182.273629:0:15394:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9fc9ffa84800), last request at 1787893181 00000020:00000080:3.0:1787893182.273631:0:15394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf09e4 00000100:00080000:3.0:1787893182.273636:0:15394:0:(import.c:65:import_set_state_nolock()) ffff9fc9fd0b2000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787893182.273642:0:15394:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc9ffa84800): rc 0 00000020:00000080:3.0:1787893182.273650:0:15394:0:(genops.c:885:class_export_put()) final put ffff9fc9ffa84800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1787893182.273656:0:15394:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffbaa0c1a3bae0 00000100:00080000:3.0:1787893182.273674:0:15394:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787893182.273683:0:15394:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9fc9ffb7d880 x1874741493404928/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787893191 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893182.273697:0:15394:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00010000:00010000:1.0:1787893182.273940:0:8435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787893182.273954:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf0c5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf0c61 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893182.273961:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c147ce00 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:1.0:1787893182.273964:0:8435:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf0c5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf0c61 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893182.273973:0:8435:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf0c5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x9232577658cf0c61 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787893182.273980:0:8435:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf0c5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x9232577658cf0c61 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893182.274057:0:8435:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787893182.274061:0:8435:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787893182.274064:0:8435:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787893182.274101:0:8435:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf0c5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf0c61 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893182.274108:0:8435:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787893182.274131:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf0c5a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf0c61 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893182.274139:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf0c5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf0c61 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893182.274152:0:8435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787893182.274155:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf0c68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf0c6f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893182.274161:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31200 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:1.0:1787893182.274169:0:8435:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf0c68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf0c6f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893182.274176:0:8435:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf0c68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x9232577658cf0c6f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787893182.274182:0:8435:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf0c68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x9232577658cf0c6f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893182.274187:0:8435:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787893182.274190:0:8435:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:1.0:1787893182.274192:0:8435:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:1.0:1787893182.274209:0:8435:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf0c68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf0c6f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893182.274214:0:8435:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787893182.274219:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf0c68 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf0c6f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893182.274226:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf0c68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf0c6f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893182.274234:0:8435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787893182.274238:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf0b42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf0b49 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893182.274244:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd728200 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:1.0:1787893182.274247:0:8435:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf0b42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf0b49 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893182.274253:0:8435:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf0b42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9232577658cf0b49 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787893182.274264:0:8435:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf0b42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9232577658cf0b49 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893182.274270:0:8435:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1787893182.274272:0:8435:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1787893182.274273:0:8435:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1787893182.274285:0:8435:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf0b42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf0b49 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893182.274291:0:8435:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787893182.274301:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf0b42 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf0b49 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893182.274307:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf0b42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf0b49 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893182.274321:0:8435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787893182.274324:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541e00/0x9232577658cf0ede lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf0ee5 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893182.274330:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe541e00 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:1.0:1787893182.274333:0:8435:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541e00/0x9232577658cf0ede lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf0ee5 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893182.274340:0:8435:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541e00/0x9232577658cf0ede lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9232577658cf0ee5 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787893182.274346:0:8435:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541e00/0x9232577658cf0ede lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9232577658cf0ee5 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893182.274361:0:8435:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787893182.274363:0:8435:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787893182.274365:0:8435:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787893182.274379:0:8435:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541e00/0x9232577658cf0ede lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf0ee5 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893182.274385:0:8435:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787893182.274391:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541e00/0x9232577658cf0ede lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf0ee5 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893182.274397:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541e00/0x9232577658cf0ede lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf0ee5 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893182.274406:0:8435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893182.274410:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728000/0x9232577658cf082b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf0832 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893182.274414:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd728000 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:1.0:1787893182.274417:0:8435:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728000/0x9232577658cf082b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf0832 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893182.274423:0:8435:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728000/0x9232577658cf082b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9232577658cf0832 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787893182.274429:0:8435:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728000/0x9232577658cf082b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9232577658cf0832 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893182.274434:0:8435:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1787893182.274436:0:8435:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1787893182.274438:0:8435:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1787893182.274456:0:8435:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728000/0x9232577658cf082b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf0832 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893182.274462:0:8435:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787893182.274467:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728000/0x9232577658cf082b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf0832 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893182.274474:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728000/0x9232577658cf082b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf0832 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893182.274485:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893182.274487:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893182.274512:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893182.274528:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493408384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787893182.274602:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893182.274654:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787893182.274660:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493408256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787893182.274681:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893182.274697:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493408768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787893182.274716:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893182.274744:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493408384 00000100:00100000:1.0:1787893182.274750:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493408384 00000100:00100000:1.0:1787893182.274779:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493408256 00000100:00100000:1.0:1787893182.274782:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493408256 00000100:00100000:1.0:1787893182.274793:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493408768 00000100:00100000:1.0:1787893182.274795:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493408768 00000100:00100000:1.0:1787893182.274806:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787893182.274813:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3633:x1874741493408384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787893182.275511:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787893182.275522:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c5f16800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1787893182.275572:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9ffa84800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1787893182.275597:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc8c5f17000 for lustre-MDT0001 00000020:00000080:0.0:1787893182.275601:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc9fd0b2000 for lustre-MDT0001 00000100:00100000:3.0:1787893182.275674:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493408640:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787893182.275717:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893182.275744:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493404928:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787893182.275765:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787893182.275771:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493408512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787893182.275792:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787893182.275811:0:15394:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00010000:00020000:1.0:1787893182.275942:0:6491:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787893182 with bad export cookie 10534578644180731688 00010000:00010000:2.0:1787893182.276020:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787893182.277163:0:15394:0:(import.c:65:import_set_state_nolock()) ffff9fc9e6fb8800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00100000:0.0:1787893182.277428:0:10383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493408640 00000100:00100000:0.0:1787893182.277449:0:10383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493408640 00000100:00100000:0.0:1787893182.277475:0:10383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493408512 00000100:00100000:0.0:1787893182.277477:0:10383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493408512 00000100:00100000:0.0:1787893182.277514:0:10383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787893182.277522:0:10383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3efb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3633:x1874741493408256:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787893182.277528:0:10383:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787893182 with bad export cookie 10534578644180731688 00000100:00100000:0.0:1787893182.277610:0:10383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3efb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3633:x1874741493408256:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (2926us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787893182.277617:0:10383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787893182.277637:0:10383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787893182.277641:0:10383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3633:x1874741493408768:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787893182.277645:0:10383:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787893182 with bad export cookie 10534578644180731688 00000100:00100000:0.0:1787893182.277671:0:10383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3633:x1874741493408768:12345-0@lo:103:ldlm_bl.0 Request processed in 29us (2954us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787893182.277677:0:10383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787893182.277689:0:10383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787893182.277694:0:10383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7527800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3631:x1874741493408640:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787893182.277698:0:10383:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787893182 with bad export cookie 10534578644180731688 00000100:00100000:0.0:1787893182.277728:0:10383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7527800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3631:x1874741493408640:12345-0@lo:103:ldlm_bl.0 Request processed in 32us (2011us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787893182.277734:0:10383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787893182.277744:0:10383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787893182.277748:0:10383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3631:x1874741493408512:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787893182.277752:0:10383:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787893182 with bad export cookie 10534578644180731688 00000100:00100000:0.0:1787893182.277775:0:10383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3631:x1874741493408512:12345-0@lo:103:ldlm_bl.0 Request processed in 25us (1982us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787893182.277780:0:10383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1787893182.277826:0:3631:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.135@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787893182.277830:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9fc9c5f50000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1787893182.277833:0:3631:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.135@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1787893182.277968:0:15394:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787893182.277973:0:15394:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1787893182.278043:0:15394:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787893182.278101:0:15394:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1787893182.278122:0:15394:0:(import.c:65:import_set_state_nolock()) ffff9fc9fe303800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1787893182.278137:0:15394:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787893182.278139:0:15394:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1787893182.278147:0:15394:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787893182.278212:0:15394:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1787893182.278221:0:15394:0:(import.c:65:import_set_state_nolock()) ffff9fc9ffb13000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1787893182.278243:0:15394:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9fc9fd3399b8) has no exports 00000100:00080000:3.0:1787893182.279588:0:3633:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.135@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:1.0:1787893182.283952:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3633:x1874741493408384:12345-0@lo:103:ldlm_bl.0 Request processed in 9134us (9346us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787893182.283978:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787893182.285575:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493408896:0@lo:9:umount.0 00000100:00100000:1.0:1787893182.285632:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893182.285666:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8507800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493409024:0@lo:9:umount.0 00000100:00100000:1.0:1787893182.285687:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893182.285724:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493408896 00000100:00100000:1.0:1787893182.285732:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493408896 00000100:00100000:1.0:1787893182.285771:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493409024 00000100:00100000:1.0:1787893182.285774:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493409024 00000100:00100000:1.0:1787893182.285796:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787893182.285805:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1874741493408896:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787893182.285845:0:8421:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf0a31 00000100:00080000:1.0:1787893182.285857:0:8421:0:(import.c:65:import_set_state_nolock()) ffff9fc9fd158000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787893182.285903:0:8421:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1787893182.286091:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3629:x1874741493408896:12345-0@lo:9:umount.0 Request processed in 286us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893182.286099:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787893182.286115:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787893182.286122:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1874741493409024:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787893182.286134:0:8421:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf0b73 00000100:00080000:1.0:1787893182.286141:0:8421:0:(import.c:65:import_set_state_nolock()) ffff9fc8c75fc000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787893182.286163:0:8421:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1787893182.286236:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3629:x1874741493409024:12345-0@lo:9:umount.0 Request processed in 113us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893182.286243:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00010000:1.0:1787893182.286267:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787893182.286307:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9fe303800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787893182.286319:0:3629:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787893182.286322:0:3629:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787893182.286325:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493408896:0@lo:9:umount.0 00000100:00080000:1.0:1787893182.286336:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9ffb13000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787893182.286344:0:3629:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787893182.286346:0:3629:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787893182.286349:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8507800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493409024:0@lo:9:umount.0 00010000:00010000:1.0:1787893182.286392:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787893182.300454:0:3631:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.135@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1787893182.300460:0:3631:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787893182.300470:0:3631:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc8c7ce1c00 x1874741493406976/t0(0) o400->MGC192.168.202.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787893197 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893182.300600:0:3631:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc8c64b7800 x1874741493408384/t0(0) o103->MGC192.168.202.135@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787893198 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893182.300610:0:3631:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc9ffb7dc00 x1874741493408256/t0(0) o103->MGC192.168.202.135@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787893198 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893182.300617:0:3631:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc8c64b4a80 x1874741493408768/t0(0) o103->MGC192.168.202.135@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787893198 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893182.300624:0:3631:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc8c64b4700 x1874741493408640/t0(0) o103->MGC192.168.202.135@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787893198 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893182.300633:0:3631:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc8c64b6680 x1874741493408512/t0(0) o103->MGC192.168.202.135@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787893198 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787893182.300745:0:3633:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9fc9c5f50000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1787893182.300786:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493408768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787893182.300794:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493408384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787893182.300899:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ad7764-cf95-4087-88aa-57e4229a8397:3630:1874741493406976:0@lo:400:kworker.0 00000100:00100000:3.0:1787893182.300943:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ad7764-cf95-4087-88aa-57e4229a8397:3633:1874741493408256:0@lo:103:ldlm_bl.0 10000000:01000000:0.0:1787893182.300983:0:3631:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787893182.301048:0:3631:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787893182.301050:0:3631:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787893182.301055:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9fc9c5f50000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787893182.301060:0:3631:0:(import.c:510:import_select_connection()) MGC192.168.202.135@tcp: connect to NID 0@lo last attempt 143 00000100:00080000:0.0:1787893182.301067:0:3631:0:(import.c:624:import_select_connection()) MGC192.168.202.135@tcp: import ffff9fc9c5f50000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:1.0:1787893182.301180:0:3631:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c64b4e00 x1874741493409152/t0(0) o250->MGC192.168.202.135@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787893182.301227:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:19ad7764-cf95-4087-88aa-57e4229a8397:3629:1874741493409152:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:2.0:1787893182.301269:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874741493409152 offset 0 length 520: 4 00000100:00100000:1.0:1787893182.301323:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493408640:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787893182.301336:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ad7764-cf95-4087-88aa-57e4229a8397:3631:1874741493408512:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1787893182.304945:0:15394:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9fc9fd3399b8) has no exports 00000020:01000000:0.0:1787893182.384703:0:15394:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fc8c10a07e0 - data ffff9fc9f40975e8/ffff9fc8c7500400 00000020:01000000:0.0:1787893182.385121:0:15394:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fc9e5f643c0 - data ffff9fc9f41b6870/ffff9fc9e6f95c00 00010000:00010000:2.0:1787893182.385684:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1787893182.399645:0:15394:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1787893182.465152:0:15394:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787893182.465160:0:15394:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1787893182.465167:0:15394:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787893182.467897:0:15394:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787893182.467903:0:15394:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1787893182.468237:0:15394:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787893182.468249:0:15394:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787893182.468551:0:8528:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787893182.468556:0:8528:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:1.0:1787893182.468565:0:8528:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1787893182.469380:0:15394:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787893182.469384:0:15394:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1787893182.469404:0:15394:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787893182.469406:0:15394:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787893182.469690:0:9999:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787893182.469694:0:9999:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:3.0:1787893182.469720:0:9999:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1787893182.471525:0:15394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf084e 00000020:00000080:2.0:1787893182.471543:0:15394:0:(genops.c:885:class_export_put()) final put ffff9fc9fd347000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787893182.471716:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9fd347000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787893182.478435:0:15394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf0863 00000020:00000080:3.0:1787893182.478448:0:15394:0:(genops.c:885:class_export_put()) final put ffff9fc9fd343800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1787893182.478468:0:15394:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1787893182.478474:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787893182.478484:0:15394:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787893182.478488:0:15394:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9fc9fd33cd28) has no exports 00000004:01000000:3.0:1787893182.478679:0:15394:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787893182.478689:0:15394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf0b6c 00000020:00000080:3.0:1787893182.478693:0:15394:0:(genops.c:885:class_export_put()) final put ffff9fc8c741f000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1787893182.478698:0:15394:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1787893182.478701:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787893182.478709:0:15394:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787893182.478711:0:15394:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff9fc8c77319b8) has no exports 00000020:00000080:3.0:1787893182.478717:0:15394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf0b65 00000020:00000080:3.0:1787893182.478720:0:15394:0:(genops.c:885:class_export_put()) final put ffff9fc9ffb10000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787893182.479618:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9fd343800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:1.0:1787893182.479629:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c741f000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1787893182.479633:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9ffb10000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1787893182.481383:0:15394:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1787893182.481390:0:15394:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787893182.481394:0:15394:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1787893182.481400:0:15394:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787893182.481402:0:15394:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787893182.481446:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787893182.481469:0:15394:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787893182.481478:0:15394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf0a2a 00000020:00000080:3.0:1787893182.481486:0:15394:0:(genops.c:885:class_export_put()) final put ffff9fc9ffb16800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1787893182.481516:0:15394:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1787893182.481521:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787893182.481538:0:15394:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787893182.481542:0:15394:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9fc9e7358000) has no exports 00000020:00000080:3.0:1787893182.481548:0:15394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf0a23 00000020:00000080:3.0:1787893182.481551:0:15394:0:(genops.c:885:class_export_put()) final put ffff9fc9fe303000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787893182.481792:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc9ffb13000 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1787893182.481801:0:38:0:(genops.c:885:class_export_put()) final put ffff9fc9fd0b4800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787893182.481804:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9fd0b4800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1787893182.481811:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787893182.481902:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9ffb16800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1787893182.481907:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9fe303000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1787893182.483125:0:15394:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1787893182.483131:0:15394:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787893182.483134:0:15394:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1787893182.483140:0:15394:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787893182.483142:0:15394:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787893182.483183:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787893182.483191:0:15394:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1787893182.483206:0:15394:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1787893182.483213:0:15394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf0886 00000020:00000080:3.0:1787893182.483220:0:15394:0:(genops.c:885:class_export_put()) final put ffff9fc9fe133800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1787893182.483226:0:15394:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1787893182.483231:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787893182.483236:0:15394:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787893182.483238:0:15394:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9fc9fd338000) has no exports 00000020:00000080:3.0:1787893182.483243:0:15394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf087f 00000020:00000080:3.0:1787893182.483246:0:15394:0:(genops.c:885:class_export_put()) final put ffff9fc9e6fbe000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787893182.483520:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc9fe303800 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1787893182.483546:0:38:0:(genops.c:885:class_export_put()) final put ffff9fc8c5f15000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787893182.483548:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c5f15000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1787893182.483553:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787893182.483613:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9fe133800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1787893182.483618:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9e6fbe000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1787893182.493578:0:15394:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1787893182.493587:0:15394:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787893182.493591:0:15394:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1787893182.493600:0:15394:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787893182.493657:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787893182.493668:0:15394:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787893182.493694:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787893182.493698:0:15394:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787893182.493704:0:15394:0:(genops.c:885:class_export_put()) final put ffff9fc9fd121800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787893182.493708:0:15394:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9fd121800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1787893182.493720:0:15394:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787893182.493888:0:15394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf086a 00000020:00000080:2.0:1787893182.493895:0:15394:0:(genops.c:885:class_export_put()) final put ffff9fc9fd343000/lustre-MDD0001_UUID 00000020:01000000:2.0:1787893182.493900:0:15394:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1787893182.493904:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787893182.493922:0:15394:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787893182.493926:0:15394:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9fc9fd33b370) has no exports 00000020:00000080:2.0:1787893182.493945:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787893182.493948:0:15394:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1787893182.493952:0:15394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf0871 00000020:00000080:2.0:1787893182.493956:0:15394:0:(genops.c:885:class_export_put()) final put ffff9fc9fd342000/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1787893182.493963:0:15394:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc9ed573800 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1787893182.493966:0:15394:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc9ed573800 2 00000020:01000004:2.0:1787893182.493969:0:15394:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fc9ed573800 from lustre-MDT0001 00000020:00000080:2.0:1787893182.493987:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787893182.494002:0:15394:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1787893182.494005:0:15394:0:(genops.c:885:class_export_put()) final put ffff9fc9fd345000/lustre-MDT0001_UUID 00000020:00000080:2.0:1787893182.494007:0:15394:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9fd345000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1787893182.494014:0:15394:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1787893182.494045:0:15394:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1787893182.494049:0:15394:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1787893182.494051:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787893182.494055:0:15394:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787893182.494061:0:15394:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9fc9fe093800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787893182.494066:0:15394:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9fc9fe143370) has exports, disconnecting them 00000020:00080000:2.0:1787893182.494071:0:15394:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9fc9fe093800), last request at 1787892919 00000020:00000080:2.0:1787893182.494074:0:15394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf08c5 00000020:00080000:2.0:1787893182.494086:0:15394:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc9fe093800): rc 0 00000020:00000080:2.0:1787893182.494090:0:15394:0:(genops.c:885:class_export_put()) final put ffff9fc9fe093800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1787893182.494820:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc9e6fb8800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1787893182.494830:0:38:0:(genops.c:885:class_export_put()) final put ffff9fc9e6fb9800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787893182.494833:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9e6fb9800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1787893182.494840:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787893182.494958:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9fd343000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1787893182.494963:0:38:0:(genops.c:885:class_export_put()) final put ffff9fc9fd341800/lustre-MDD0001_UUID 00000020:00000080:1.0:1787893182.494965:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9fd341800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1787893182.494968:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1787893182.495184:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9fd342000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787893182.495189:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9fe093800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1787893182.495899:0:15394:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1787893182.495905:0:15394:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787893182.495921:0:15394:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787893182.495928:0:15394:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787893182.495949:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc9fe093000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1787893182.496082:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787893182.496090:0:15394:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1787893182.496094:0:15394:0:(genops.c:885:class_export_put()) final put ffff9fc9fe091000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1787893182.496096:0:15394:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9fe091000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1787893182.496100:0:15394:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1787893182.496140:0:15394:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc9ed573800 1 00000020:00000080:1.0:1787893182.496145:0:15394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf0801 00000020:00000080:1.0:1787893182.496151:0:15394:0:(genops.c:885:class_export_put()) final put ffff9fc9fd124000/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1787893182.496168:0:15394:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1787893182.496175:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9fd124000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787893182.496183:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787893182.496188:0:15394:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787893182.496192:0:15394:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9fc9c2f3cd28) has no exports 00000020:00000080:0.0:1787893182.728980:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787893182.728994:0:15394:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1787893182.729009:0:15394:0:(genops.c:885:class_export_put()) final put ffff9fc9ed574000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1787893182.729013:0:15394:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9ed574000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1787893182.729023:0:15394:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1787893182.729130:0:15394:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9fc9ed570800 00000020:01000000:0.0:1787893182.729151:0:15394:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1787893182.729155:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787893182.729160:0:15394:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787893182.729164:0:15394:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9fc9e2e38000) has no exports 00000100:00100000:0.0:1787893182.729259:0:6506:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9fc9c3cd9a00:6506] 2 exiting: rc = 0 00000100:00100000:0.0:1787893182.729390:0:9515:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9fc8c5f96000:9515] 3 exiting: rc = 0 00000100:00100000:0.0:1787893182.729458:0:6505:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9fc9d265f800:6505] 1 exiting: rc = 0 00000100:00100000:0.0:1787893182.729562:0:6504:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9fc9d9132600:6504] 0 exiting: rc = 1 00000100:00100000:0.0:1787893182.729651:0:13436:0:(service.c:3183:ptlrpc_main()) mdt00_005: service thread [ffff9fc8c706c400:13436] 5 exiting: rc = 0 00000100:00100000:3.0:1787893182.731809:0:10086:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9fc9e7113600:10086] 4 exiting: rc = 0 00000100:00100000:0.0:1787893182.732369:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732377:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732383:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732389:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732394:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732399:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732405:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732410:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732417:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732422:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732428:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732433:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732438:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732443:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732448:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732454:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732459:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732464:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732468:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732474:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732632:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732639:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732645:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732649:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732662:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732668:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732674:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732679:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732684:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732688:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732693:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732699:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732705:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732710:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732715:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732720:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732725:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732730:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732734:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732740:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732748:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732752:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732758:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732763:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732768:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732773:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732778:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732782:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732788:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732793:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732798:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732802:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732807:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732812:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732816:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732831:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732837:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732842:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732847:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732853:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732858:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732863:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732868:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.732873:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893182.736393:0:6507:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9fc9c3a58400:6507] 0 exiting: rc = 1 00000100:00100000:0.0:1787893182.736654:0:6508:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9fc9d8dc8800:6508] 1 exiting: rc = 0 00000100:00100000:3.0:1787893182.736821:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.736830:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.736836:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.736842:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.736850:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.736855:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.736860:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.736878:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.736883:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.736889:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.736896:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.736901:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.736908:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.736913:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.736919:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.736924:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.736930:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.736936:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.736941:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.736945:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.736951:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.736956:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.736961:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.736965:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.736970:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.736974:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.736980:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.736985:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.736991:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.737065:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.737073:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.737078:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.737083:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.737087:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.737092:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.737097:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.737102:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.737107:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.737113:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.737118:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.737123:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.737129:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.737141:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.737146:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.737151:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.737157:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.737162:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.737167:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.737172:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.737177:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.737181:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.737187:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.737192:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.737197:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.737201:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.737206:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.737211:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.737216:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.737221:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.737225:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.737230:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.737236:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.737241:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.737246:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.737911:0:6509:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9fc9c3ef7a00:6509] 0 exiting: rc = 1 00000100:00100000:1.0:1787893182.738066:0:7865:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9fc9fd2bf800:7865] 2 exiting: rc = 0 00000100:00100000:0.0:1787893182.738189:0:6510:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9fc9d1c42a00:6510] 1 exiting: rc = 0 00000100:00100000:3.0:1787893182.738284:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738292:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738301:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738307:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738313:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738319:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738325:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738332:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738337:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738343:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738349:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738366:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738375:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738394:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738399:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738405:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738410:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738416:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738422:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738428:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738435:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738441:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738447:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738468:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738475:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738481:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738661:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738669:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738676:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738682:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738688:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738694:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738700:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738708:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738713:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738736:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738744:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738750:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738756:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738762:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738767:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738773:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738778:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738785:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738792:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738797:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738804:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738823:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738836:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738841:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738847:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738852:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738858:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738864:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738870:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738876:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738883:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738888:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738894:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738913:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738919:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738925:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738930:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893182.738943:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893182.746847:0:6512:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9fc9c5f7ce00:6512] 1 exiting: rc = 0 00000100:00100000:0.0:1787893182.746990:0:6511:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9fc9c5f7c000:6511] 0 exiting: rc = 1 00000100:00100000:2.0:1787893182.747161:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747168:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747174:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747179:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747186:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747192:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747197:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747203:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747209:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747214:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747219:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747224:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747229:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747233:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747239:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747243:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747248:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747266:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747271:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747275:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747280:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747284:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747289:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747294:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747299:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747305:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747310:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747315:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747319:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747324:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747328:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747333:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747338:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747343:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747349:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747355:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747360:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747364:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747369:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747374:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747379:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747384:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747389:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747394:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747399:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747404:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747410:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747415:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747420:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747425:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747430:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747435:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747450:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747455:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747461:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747466:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747471:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747476:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747481:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747487:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747533:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747539:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747544:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.747549:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.747930:0:6513:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9fc9c5f7d400:6513] 0 exiting: rc = 1 00000100:00100000:1.0:1787893182.748107:0:6514:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9fc9c5f7d600:6514] 1 exiting: rc = 0 00000100:00100000:2.0:1787893182.748181:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748188:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748193:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748197:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748203:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748209:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748214:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748220:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748225:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748229:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748235:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748240:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748245:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748250:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748255:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748260:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748264:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748269:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748274:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748279:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748284:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748289:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748294:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748308:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748313:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748318:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748323:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748328:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748333:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748338:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748342:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748347:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748352:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748357:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748362:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748367:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748372:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748377:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748382:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748387:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748392:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748397:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748402:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748407:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748411:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748417:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748422:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748427:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748432:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748436:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748441:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748445:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748450:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748455:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748460:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748465:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748471:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748475:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748487:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748654:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748659:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748664:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748669:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.748674:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749091:0:6515:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9fc9c3ef7400:6515] 0 exiting: rc = 1 00000100:00100000:0.0:1787893182.749238:0:6516:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9fc9c3ef7600:6516] 1 exiting: rc = 0 00000100:00100000:2.0:1787893182.749316:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749322:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749328:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749333:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749339:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749344:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749349:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749353:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749358:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749363:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749368:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749373:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749379:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749384:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749390:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749395:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749400:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749405:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749411:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749416:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749420:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749425:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749430:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749435:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749439:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749444:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749449:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749453:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749468:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749472:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749477:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749481:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749486:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749620:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749626:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749631:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749635:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749640:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749645:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749651:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749655:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749660:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749664:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749670:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749675:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749680:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749684:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749688:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749693:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749697:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749703:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749708:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749712:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749717:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749722:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749727:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749732:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749737:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749742:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749746:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749750:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749755:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749761:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893182.749776:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.750447:0:6517:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9fc9f6d96200:6517] 0 exiting: rc = 1 00000100:00100000:3.0:1787893182.750899:0:6518:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9fc9c3ef7200:6518] 1 exiting: rc = 0 00000100:00100000:1.0:1787893182.751147:0:6519:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9fc9d29cfa00:6519] 2 exiting: rc = 0 00000100:00100000:0.0:1787893182.751366:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751374:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751379:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751384:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751398:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751405:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751410:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751416:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751421:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751427:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751432:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751438:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751443:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751456:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751462:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751467:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751472:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751477:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751482:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751536:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751543:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751549:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751554:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751560:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751564:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751570:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751575:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751580:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751586:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751591:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751597:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751602:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751607:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751613:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751618:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751623:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751629:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751647:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751653:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751658:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751664:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751669:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751675:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751681:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751686:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751692:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751697:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751703:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751708:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751713:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751719:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751724:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751730:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751735:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751746:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751752:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751757:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751762:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751768:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751773:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751779:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751784:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751790:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893182.751802:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787893182.757969:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787893182.757984:0:15394:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1787893182.757990:0:15394:0:(genops.c:885:class_export_put()) final put ffff9fc9c4b37800/MDS_uuid 00000020:00000080:3.0:1787893182.757994:0:15394:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9c4b37800/MDS_uuid for MDS 00000020:01000000:3.0:1787893182.758016:0:15394:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1787893182.758140:0:15394:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1787893183.409654:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893184.438961:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893185.458634:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893186.489123:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787893186.737875:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 19ad7764-cf95-4087-88aa-57e4229a8397->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787893186.737887:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 19ad7764-cf95-4087-88aa-57e4229a8397->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787893186.737891:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787893186.737894:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787893186.737898:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fc9fe097800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787893186.737908:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 425 00000100:00080000:2.0:1787893186.737914:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787893186.737921:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9fc9fe097800 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:2.0:1787893186.738104:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9fe34b480 x1874741493409280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787893186.738198:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787893186.738324:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe34b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3629:1874741493409280:0@lo:38:kworker.0 00000400:00000100:1.0:1787893186.738406:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874741493409280 offset 0 length 520: 4 00000100:00080000:2.0:1787893186.738761:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787893186.738766:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787893186.738768:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fc9e70be000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787893186.738772:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 425 00000100:00080000:2.0:1787893186.738775:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787893186.738780:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fc9e70be000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:2.0:1787893186.738796:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9fe349500 x1874741493409536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787893186.739040:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe34aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1874741493409664:0@lo:400:kworker.0 00000400:00000100:3.0:1787893186.739067:0:3630:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874741493409664 offset 0 length 224: 4 00000100:00100000:1.0:1787893186.739118:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe349500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3629:1874741493409536:0@lo:38:kworker.0 00000400:00000100:1.0:1787893186.739138:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874741493409536 offset 0 length 520: 4 00000100:00100000:0.0:1787893186.739347:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe349f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493409408:0@lo:400:kworker.0 00000400:00000100:0.0:1787893186.739370:0:3632:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874741493409408 offset 0 length 224: 4 00000020:01000004:0.0:1787893187.259013:0:15595:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1787893187.275821:0:15595:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1787893187.275876:0:15595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30200/0x9232577658cf0c3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0c45 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893187.275891:0:15595:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30200/0x9232577658cf0c3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0c45 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893187.275899:0:15595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30200/0x9232577658cf0c3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf0c45 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893187.275906:0:15595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30200/0x9232577658cf0c3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf0c45 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893187.275970:0:15595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787893187.275978:0:15595:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787893187.276005:0:15595:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787893187.276017:0:15595:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc9fe34b480 x1874741493409280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787893206 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893187.276054:0:15595:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787893187.276060:0:15595:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787893187.276066:0:15595:0:(import.c:65:import_set_state_nolock()) ffff9fc9fe097800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1787893187.276071:0:15595:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787893187.276075:0:15595:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc9fe34b480 x1874741493409280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787893206 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893187.276081:0:15595:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787893187.276084:0:15595:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00000100:00100000:2.0:1787893187.276737:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe34b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3629:1874741493409280:0@lo:38:kworker.0 00000100:00080000:0.0:1787893187.278952:0:15595:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787893187.278970:0:15595:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc9fe349f80 x1874741493409408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893202 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893187.278997:0:15595:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787893187.279003:0:15595:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787893187.279028:0:15595:0:(import.c:65:import_set_state_nolock()) ffff9fc9ffa86000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787893187.279189:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3629:1874741493409792:0@lo:39:umount.0 00000100:00100000:2.0:1787893187.279226:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe349f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493409408:0@lo:400:kworker.0 00000400:00000100:3.0:1787893187.279248:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874741493409792 offset 0 length 224: 4 00010000:00010000:1.0:1787893187.282431:0:8435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893187.282446:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30200/0x9232577658cf0c3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf0c45 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893187.282459:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30200 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:1.0:1787893187.282463:0:8435:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30200/0x9232577658cf0c3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf0c45 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893187.282474:0:8435:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30200/0x9232577658cf0c3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x9232577658cf0c45 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787893187.282507:0:8435:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30200/0x9232577658cf0c3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x9232577658cf0c45 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893187.282531:0:8435:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787893187.282534:0:8435:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787893187.282538:0:8435:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787893187.282557:0:8435:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fc9c5f50000 00010000:00010000:1.0:1787893187.282561:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30200/0x9232577658cf0c3e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x9232577658cf0c45 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893187.282568:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30200/0x9232577658cf0c3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x9232577658cf0c45 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893187.282583:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893187.282585:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893187.282587:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893187.507889:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787893187.764519:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 19ad7764-cf95-4087-88aa-57e4229a8397->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787893187.764538:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 19ad7764-cf95-4087-88aa-57e4229a8397->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787893187.764541:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787893187.764559:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787893187.764740:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1874741493409920:0@lo:400:kworker.0 00000400:00000100:1.0:1787893187.764791:0:3631:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874741493409920 offset 0 length 224: 4 00000001:00100000:2.0:1787893188.282981:0:9497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787893188.283000:0:9497:0:(genops.c:885:class_export_put()) final put ffff9fc8c75f8000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787893188.283217:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c75f8000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000001:00100000:3.0:1787893188.287969:0:8413:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787893188.287979:0:8413:0:(genops.c:885:class_export_put()) final put ffff9fc9fd158800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787893188.295536:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc8c75fc000 for lustre-OST0001 00000020:00000080:0.0:1787893188.299694:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9fd158800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1787893188.299754:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc9fd158000 for lustre-OST0000 00010000:00010000:0.0:1787893188.531300:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893189.553908:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893190.577755:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893191.601947:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787893191.793680:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 19ad7764-cf95-4087-88aa-57e4229a8397->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787893191.793691:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 19ad7764-cf95-4087-88aa-57e4229a8397->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787893191.793705:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787893191.793708:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787893191.793876:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787893191.793896:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1874741493410048:0@lo:400:kworker.0 00000400:00000100:3.0:1787893191.793961:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874741493410048 offset 0 length 224: 4 00000100:00100000:3.0:1787893192.434966:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787893182/real 1787893182] req@ffff9fc8c64b4e00 x1874741493409152/t0(0) o250->MGC192.168.202.135@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787893192 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893192.435001:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc8c64b4e00 x1874741493409152/t0(0) o250->MGC192.168.202.135@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787893192 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787893192.435023:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9c5f50000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787893192.435052:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1787893192.435057:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:19ad7764-cf95-4087-88aa-57e4229a8397:3629:1874741493409152:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:0.0:1787893192.442110:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 19ad7764-cf95-4087-88aa-57e4229a8397->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787893192.442137:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1787893192.442141:0:38:0:(import.c:65:import_set_state_nolock()) ffff9fc9c5f50000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787893192.442150:0:38:0:(import.c:510:import_select_connection()) MGC192.168.202.135@tcp: connect to NID 0@lo last attempt 426 00000100:00080000:0.0:1787893192.442155:0:38:0:(import.c:589:import_select_connection()) MGC192.168.202.135@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787893192.442163:0:38:0:(import.c:624:import_select_connection()) MGC192.168.202.135@tcp: import ffff9fc9c5f50000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:0.0:1787893192.442198:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c7ce2680 x1874741493410176/t0(0) o250->MGC192.168.202.135@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787893192.442242:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787893192.442246:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787893192.442325:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787893192.442345:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493410304:0@lo:400:kworker.0 00000400:00000100:2.0:1787893192.442406:0:3632:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874741493410304 offset 0 length 224: 4 00000100:00100000:3.0:1787893192.442537:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:19ad7764-cf95-4087-88aa-57e4229a8397:3629:1874741493410176:0@lo:250:kworker.0 00000400:00000100:3.0:1787893192.442568:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874741493410176 offset 0 length 520: 4 00010000:00010000:1.0:1787893192.627752:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893193.649654:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893194.676857:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893195.699639:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893196.721660:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787893197.489696:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 19ad7764-cf95-4087-88aa-57e4229a8397->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787893197.489707:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 19ad7764-cf95-4087-88aa-57e4229a8397->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787893197.489710:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787893197.489712:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787893197.489834:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe349f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1874741493410432:0@lo:400:kworker.0 00000400:00000100:3.0:1787893197.489899:0:3630:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874741493410432 offset 0 length 224: 4 00000100:00100000:3.0:1787893197.553634:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787893187/real 1787893187] req@ffff9fc8c7ce1180 x1874741493409792/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787893197 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893197.553669:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc8c7ce1180 x1874741493409792/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787893197 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787893197.553691:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9ffa86000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787893197.553714:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3629:1874741493409792:0@lo:39:umount.0 00000100:00080000:0.0:1787893197.553833:0:15595:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787893197.553837:0:15595:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787893197.553843:0:15595:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787893197.555007:0:15595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c771e600/0x9232577658cf0c4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0c53 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893197.555023:0:15595:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c771e600/0x9232577658cf0c4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0c53 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893197.555030:0:15595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c771e600/0x9232577658cf0c4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf0c53 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893197.555037:0:15595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff9fc8c771e600/0x9232577658cf0c4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf0c53 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893197.555129:0:15595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787893197.555136:0:15595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30e00/0x9232577658cf0ed0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0ed7 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893197.555157:0:15595:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30e00/0x9232577658cf0ed0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0ed7 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893197.555163:0:15595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30e00/0x9232577658cf0ed0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf0ed7 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893197.555169:0:15595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30e00/0x9232577658cf0ed0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf0ed7 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893197.559696:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787893197.559714:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc8c771e600/0x9232577658cf0c4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf0c53 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893197.559726:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c771e600 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:1.0:1787893197.559731:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc8c771e600/0x9232577658cf0c4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf0c53 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893197.559742:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc8c771e600/0x9232577658cf0c4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x9232577658cf0c53 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787893197.559771:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc8c771e600/0x9232577658cf0c4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x9232577658cf0c53 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893197.559778:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787893197.559781:0:6494:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:1.0:1787893197.559795:0:6494:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fc9c5f50000 00010000:00010000:1.0:1787893197.559799:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc8c771e600/0x9232577658cf0c4c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x9232577658cf0c53 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893197.559806:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc8c771e600/0x9232577658cf0c4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x9232577658cf0c53 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893197.559823:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893197.559827:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30e00/0x9232577658cf0ed0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf0ed7 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893197.559832:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30e00 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:1.0:1787893197.559836:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30e00/0x9232577658cf0ed0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf0ed7 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893197.559842:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30e00/0x9232577658cf0ed0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9232577658cf0ed7 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787893197.559849:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30e00/0x9232577658cf0ed0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9232577658cf0ed7 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893197.559853:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787893197.559856:0:6494:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1787893197.559859:0:6494:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fc9c5f50000 00010000:00010000:1.0:1787893197.559868:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30e00/0x9232577658cf0ed0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9232577658cf0ed7 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893197.559875:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893197.559876:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893197.559878:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893197.560014:0:15595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787893197.560022:0:15595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30e00/0x9232577658cf0ed0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9232577658cf0ed7 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787893197.560034:0:15595:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1787893197.560101:0:15595:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:0.0:1787893197.560104:0:15595:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1787893197.560139:0:15595:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1787893197.560143:0:15595:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1787893197.560150:0:15595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787893197.560156:0:15595:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787893197.560160:0:15595:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9fc9c2f399b8) has no exports 00000020:00080000:0.0:1787893197.560195:0:15595:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9fc9c2f399b8) has no exports 00010000:00010000:2.0:1787893197.566780:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787893197.572764:0:15595:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fc8c10a0600 - data ffff9fc8c5839a20/ffff9fc8c7500800 00000020:01000000:0.0:1787893197.572939:0:15595:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fc8c5d160c0 - data ffff9fc9f42b8af8/ffff9fc9e7107400 00100000:10000000:2.0:1787893197.598183:0:15595:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787893197.606909:0:15595:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf099e 00000020:00000080:3.0:1787893197.606921:0:15595:0:(genops.c:885:class_export_put()) final put ffff9fc9fd159000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1787893197.606945:0:15595:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc9fe136000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1787893197.606949:0:15595:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc9fe136000 2 00000020:01000004:3.0:1787893197.606953:0:15595:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fc9fe136000 from lustre-OST0000 00000020:00000080:3.0:1787893197.606983:0:15595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787893197.606993:0:15595:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1787893197.606996:0:15595:0:(genops.c:885:class_export_put()) final put ffff9fc9fd15c800/lustre-OST0000_UUID 00000020:00000080:3.0:1787893197.606999:0:15595:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9fd15c800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1787893197.607006:0:15595:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1787893197.607052:0:15595:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1787893197.607057:0:15595:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1787893197.607060:0:15595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787893197.607065:0:15595:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787893197.607072:0:15595:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9fc8c64bf000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787893197.607077:0:15595:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9fc9fe140000) has exports, disconnecting them 00000020:00080000:3.0:1787893197.607094:0:15595:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9fc8c64bf000), last request at 1787892941 00000020:00000080:3.0:1787893197.607099:0:15595:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf09c8 00000020:00080000:3.0:1787893197.607109:0:15595:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc8c64bf000): rc 0 00000020:00000080:3.0:1787893197.607114:0:15595:0:(genops.c:885:class_export_put()) final put ffff9fc8c64bf000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787893197.608103:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9fd159000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787893197.608119:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c64bf000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1787893197.613097:0:15595:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787893197.613106:0:15595:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787893197.613110:0:15595:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787893197.613116:0:15595:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787893197.613305:0:15595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787893197.613326:0:15595:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1787893197.613333:0:15595:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787893197.613337:0:15595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787893197.613341:0:15595:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787893197.613348:0:15595:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9fc9ffa80800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787893197.613354:0:15595:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff9fc9ed578000) has exports, disconnecting them 00000020:00080000:0.0:1787893197.613358:0:15595:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9fc9ffa80800), last request at 1787892941 00000020:00000080:0.0:1787893197.613362:0:15595:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf09dd 00000020:00080000:0.0:1787893197.613379:0:15595:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc9ffa80800): rc 0 00000020:00000080:0.0:1787893197.613383:0:15595:0:(genops.c:885:class_export_put()) final put ffff9fc9ffa80800/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1787893197.614100:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc9fe097800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787893197.614109:0:8:0:(genops.c:885:class_export_put()) final put ffff9fc9fd0b3800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787893197.614111:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9fd0b3800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787893197.614116:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1787893197.614183:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9ffa80800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1787893197.614205:0:15595:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1787893197.614208:0:15595:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787893197.614211:0:15595:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787893197.614215:0:15595:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787893197.614230:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc9ffa86000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1787893197.614356:0:15595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787893197.614362:0:15595:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1787893197.614365:0:15595:0:(genops.c:885:class_export_put()) final put ffff9fc9ffa81000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1787893197.614368:0:15595:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9ffa81000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1787893197.614372:0:15595:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1787893197.614410:0:15595:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc9fe136000 1 00000020:00000080:1.0:1787893197.614415:0:15595:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf0966 00000020:00000080:1.0:1787893197.614419:0:15595:0:(genops.c:885:class_export_put()) final put ffff9fc9e5ea9800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1787893197.614427:0:15595:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1787893197.614434:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9e5ea9800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787893197.614442:0:15595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787893197.614452:0:15595:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787893197.614455:0:15595:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9fc9d911b370) has no exports 00000020:00000080:1.0:1787893197.836198:0:15595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787893197.836211:0:15595:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1787893197.836216:0:15595:0:(genops.c:885:class_export_put()) final put ffff9fc9d29e9800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1787893197.836221:0:15595:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9d29e9800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1787893197.836231:0:15595:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1787893197.836340:0:15595:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9fc9ed595000 00000020:02000400:1.0:1787893197.836382:0:15595:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1787893198.036677:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893199.090802:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893200.115724:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893201.138593:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893202.164274:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787893202.538148:0:15797:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1787893202.567763:0:15797:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1787893202.567848:0:15797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540800/0x9232577658cf0c22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0c29 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893202.567863:0:15797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540800/0x9232577658cf0c22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0c29 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893202.567871:0:15797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540800/0x9232577658cf0c22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf0c29 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893202.567879:0:15797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540800/0x9232577658cf0c22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf0c29 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893202.567909:0:15797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787893202.567915:0:15797:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1787893202.567943:0:8435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893202.567949:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540800/0x9232577658cf0c22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf0c29 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893202.567956:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540800 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:2.0:1787893202.567960:0:8435:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540800/0x9232577658cf0c22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf0c29 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893202.567968:0:8435:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540800/0x9232577658cf0c22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9232577658cf0c29 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787893202.567976:0:8435:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540800/0x9232577658cf0c22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9232577658cf0c29 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893202.567982:0:8435:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787893202.567985:0:8435:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787893202.567986:0:8435:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787893202.567999:0:8435:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fc9c5f50000 00010000:00010000:2.0:1787893202.568003:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540800/0x9232577658cf0c22 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9232577658cf0c29 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893202.568010:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540800/0x9232577658cf0c22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9232577658cf0c29 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893202.568021:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893202.568023:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893202.568025:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787893202.568042:0:15797:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787893202.568053:0:15797:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc9fe349500 x1874741493409536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787893206 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893202.568068:0:15797:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787893202.568095:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9e70be000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787893202.568108:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:2.0:1787893202.568112:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe349500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3629:1874741493409536:0@lo:38:kworker.0 00000100:00080000:2.0:1787893202.568136:0:15797:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787893202.568141:0:15797:0:(import.c:65:import_set_state_nolock()) ffff9fc9e70be000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1787893202.568146:0:15797:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787893202.568148:0:15797:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787893202.568152:0:15797:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1787893202.568359:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 19ad7764-cf95-4087-88aa-57e4229a8397->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787893202.568364:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 19ad7764-cf95-4087-88aa-57e4229a8397->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787893202.568422:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787893202.568435:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1874741493410560:0@lo:400:kworker.0 00000400:00000100:3.0:1787893202.568511:0:3630:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874741493410560 offset 0 length 224: 4 00000100:00080000:0.0:1787893202.570918:0:15797:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787893202.570934:0:15797:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc9fe34aa00 x1874741493409664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893202 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893202.570963:0:15797:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc8c8504700 x1874741493409920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893203 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893202.570983:0:15797:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc8c7ce1880 x1874741493410048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893207 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893202.571000:0:15797:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc8c7ce3100 x1874741493410304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893208 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893202.571011:0:15797:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc9fe349f80 x1874741493410432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893213 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893202.571019:0:15797:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc8c8507480 x1874741493410560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893218 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893202.571026:0:15797:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787893202.571031:0:15797:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1787893202.571046:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1874741493409920:0@lo:400:kworker.0 00000100:00080000:0.0:1787893202.571051:0:15797:0:(import.c:65:import_set_state_nolock()) ffff9fc9e5eac000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787893202.571091:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1874741493410048:0@lo:400:kworker.0 00000100:00100000:3.0:1787893202.571094:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1874741493410560:0@lo:400:kworker.0 00000100:00100000:2.0:1787893202.574415:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493410304:0@lo:400:kworker.0 00000100:00100000:3.0:1787893202.574705:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe349f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1874741493410432:0@lo:400:kworker.0 00000100:00100000:3.0:1787893202.574732:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe34aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1874741493409664:0@lo:400:kworker.0 00000100:00100000:0.0:1787893202.580672:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3629:1874741493410688:0@lo:39:umount.0 00000400:00000100:1.0:1787893202.580976:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874741493410688 offset 0 length 224: 4 00010000:00010000:2.0:1787893203.185826:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893204.210736:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893205.233673:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893206.257690:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893207.284997:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893207.729731:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787893192/real 1787893192] req@ffff9fc8c7ce2680 x1874741493410176/t0(0) o250->MGC192.168.202.135@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787893207 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893207.729764:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc8c7ce2680 x1874741493410176/t0(0) o250->MGC192.168.202.135@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787893207 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787893207.729783:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9c5f50000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787893207.729803:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1787893207.729807:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:19ad7764-cf95-4087-88aa-57e4229a8397:3629:1874741493410176:0@lo:250:kworker.0 00000100:00080000:3.0:1787893207.730022:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 19ad7764-cf95-4087-88aa-57e4229a8397->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787893207.730027:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1787893207.730029:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fc9c5f50000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787893207.730034:0:8:0:(import.c:510:import_select_connection()) MGC192.168.202.135@tcp: connect to NID 0@lo last attempt 436 00000100:00080000:3.0:1787893207.730039:0:8:0:(import.c:589:import_select_connection()) MGC192.168.202.135@tcp: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787893207.730045:0:8:0:(import.c:624:import_select_connection()) MGC192.168.202.135@tcp: import ffff9fc9c5f50000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:3.0:1787893207.730079:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c8507480 x1874741493410816/t0(0) o250->MGC192.168.202.135@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787893207.730213:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:19ad7764-cf95-4087-88aa-57e4229a8397:3629:1874741493410816:0@lo:250:kworker.0 00000400:00000100:1.0:1787893207.730346:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874741493410816 offset 0 length 520: 4 00010000:00010000:2.0:1787893208.305755:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893209.329653:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893210.354216:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893211.377659:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893212.401654:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787893212.849818:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 19ad7764-cf95-4087-88aa-57e4229a8397->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787893212.849833:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 19ad7764-cf95-4087-88aa-57e4229a8397->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787893212.851264:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787893202/real 1787893202] req@ffff9fc8c7ce0a80 x1874741493410688/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787893212 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893212.851320:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc8c7ce0a80 x1874741493410688/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787893212 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787893212.851342:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9e5eac000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787893212.851369:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3629:1874741493410688:0@lo:39:umount.0 00000100:00080000:2.0:1787893212.852355:0:15797:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787893212.852362:0:15797:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787893212.852367:0:15797:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787893212.853680:0:15797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31400/0x9232577658cf0c30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0c37 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893212.853698:0:15797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31400/0x9232577658cf0c30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0c37 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893212.853719:0:15797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31400/0x9232577658cf0c30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf0c37 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893212.853726:0:15797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31400/0x9232577658cf0c30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf0c37 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893212.853754:0:15797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787893212.853762:0:15797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d400/0x9232577658cf0ec2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf0ec9 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893212.853769:0:15797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d400/0x9232577658cf0ec2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf0ec9 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893212.853774:0:15797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d400/0x9232577658cf0ec2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf0ec9 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893212.853779:0:15797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d400/0x9232577658cf0ec2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf0ec9 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893212.853807:0:15797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1787893212.853811:0:15797:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1787893212.853838:0:15797:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1787893212.853842:0:15797:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1787893212.853846:0:15797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787893212.853852:0:15797:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787893212.853856:0:15797:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9fc8c71b99b8) has no exports 00000020:00080000:2.0:1787893212.853878:0:15797:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9fc8c71b99b8) has no exports 00010000:00010000:1.0:1787893212.855538:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787893212.855552:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31400/0x9232577658cf0c30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf0c37 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893212.855564:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31400 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:1.0:1787893212.855569:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31400/0x9232577658cf0c30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf0c37 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893212.855579:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31400/0x9232577658cf0c30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9232577658cf0c37 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787893212.855588:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31400/0x9232577658cf0c30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9232577658cf0c37 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893212.855595:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787893212.855598:0:6494:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1787893212.855601:0:6494:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1787893212.855618:0:6494:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fc9c5f50000 00010000:00010000:1.0:1787893212.855621:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31400/0x9232577658cf0c30 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9232577658cf0c37 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893212.855628:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31400/0x9232577658cf0c30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9232577658cf0c37 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893212.855670:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893212.855674:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d400/0x9232577658cf0ec2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf0ec9 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893212.855680:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c147d400 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:1.0:1787893212.855683:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d400/0x9232577658cf0ec2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf0ec9 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893212.855690:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d400/0x9232577658cf0ec2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9232577658cf0ec9 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787893212.855697:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d400/0x9232577658cf0ec2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9232577658cf0ec9 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893212.855702:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787893212.855704:0:6494:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787893212.855707:0:6494:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787893212.855711:0:6494:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fc9c5f50000 00010000:00010000:1.0:1787893212.855714:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d400/0x9232577658cf0ec2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9232577658cf0ec9 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893212.855719:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d400/0x9232577658cf0ec2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9232577658cf0ec9 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893212.855732:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893212.855733:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893212.855735:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893212.858547:0:8435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787893212.875484:0:15797:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fc8c71842a0 - data ffff9fc8c58206c0/ffff9fc8c769fc00 00000020:01000000:2.0:1787893212.876012:0:15797:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fc8c5d16300 - data ffff9fc9f431b5e8/ffff9fc9fe554c00 00100000:10000000:2.0:1787893212.896581:0:15797:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787893212.915959:0:15797:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf0ac4 00000020:00000080:3.0:1787893212.915972:0:15797:0:(genops.c:885:class_export_put()) final put ffff9fc8c64bd800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1787893212.915989:0:15797:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc9e70bc000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1787893212.915993:0:15797:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc9e70bc000 2 00000020:01000004:3.0:1787893212.915997:0:15797:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fc9e70bc000 from lustre-OST0001 00000020:00000080:0.0:1787893212.916006:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c64bd800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1787893212.916026:0:15797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787893212.916036:0:15797:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1787893212.916040:0:15797:0:(genops.c:885:class_export_put()) final put ffff9fc9ffa83800/lustre-OST0001_UUID 00000020:00000080:3.0:1787893212.916043:0:15797:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9ffa83800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1787893212.916050:0:15797:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1787893212.916237:0:15797:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 19ad7764-cf95-4087-88aa-57e4229a8397->MGS 00010000:00010000:3.0:1787893212.916265:0:15797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729000/0x9232577658cf081d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9232577658cf0824 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787893212.916278:0:15797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729000/0x9232577658cf081d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9232577658cf0824 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787893212.916284:0:15797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1787893212.916298:0:15797:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1787893212.916301:0:15797:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1787893212.916317:0:15797:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fc9c5f50000 00010000:00010000:3.0:1787893212.916325:0:15797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729000/0x9232577658cf081d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9232577658cf0824 expref: -99 pid: 7434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893212.916341:0:15797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c000/0x9232577658cf0c92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9232577658cf0c99 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787893212.916347:0:15797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c000/0x9232577658cf0c92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9232577658cf0c99 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787893212.916352:0:15797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787893212.916354:0:15797:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1787893212.916356:0:15797:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1787893212.916363:0:15797:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fc9c5f50000 00010000:00010000:3.0:1787893212.916366:0:15797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c000/0x9232577658cf0c92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9232577658cf0c99 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787893212.916381:0:15797:0:(import.c:65:import_set_state_nolock()) ffff9fc9c5f50000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1787893212.916384:0:15797:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787893212.916387:0:15797:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787893212.916388:0:15797:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787893212.916392:0:15797:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787893212.916402:0:15797:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc8c8507480 x1874741493410816/t0(0) o250->MGC192.168.202.135@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787893227 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787893212.916421:0:15797:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787893212.916424:0:15797:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1787893212.916574:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:19ad7764-cf95-4087-88aa-57e4229a8397:3629:1874741493410816:0@lo:250:kworker.0 10000000:01000000:0.0:1787893212.916746:0:15797:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787893212.916754:0:15797:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf071a 00000020:00000080:0.0:1787893212.916758:0:15797:0:(genops.c:885:class_export_put()) final put ffff9fc9c5f51800/19ad7764-cf95-4087-88aa-57e4229a8397 00000020:01000000:0.0:1787893212.916766:0:15797:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.135@tcp (flags='') 00000020:00000080:0.0:1787893212.916771:0:15797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787893212.916776:0:15797:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.135@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787893212.916780:0:15797:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9fc9e2e3b370) has no exports 00000020:00000080:1.0:1787893212.916824:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9c5f51800/19ad7764-cf95-4087-88aa-57e4229a8397 for MGC192.168.202.135@tcp 10000000:01000000:3.0:1787893212.917757:0:6502:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1787893212.917793:0:15797:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.135@tcp: client import never connected 00000100:00080000:1.0:1787893212.917796:0:15797:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1787893212.917799:0:15797:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787893212.917801:0:15797:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1787893212.917803:0:15797:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787893212.917828:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc9c5f50000 for MGC192.168.202.135@tcp 00000020:00000080:1.0:1787893212.917859:0:15797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787893212.917865:0:15797:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.135@tcp (uuid 19ad7764-cf95-4087-88aa-57e4229a8397) 00000020:00000080:1.0:1787893212.917869:0:15797:0:(genops.c:885:class_export_put()) final put ffff9fc9c5f51000/19ad7764-cf95-4087-88aa-57e4229a8397 00000020:00000080:1.0:1787893212.917872:0:15797:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9c5f51000/19ad7764-cf95-4087-88aa-57e4229a8397 for MGC192.168.202.135@tcp 00000020:01000000:1.0:1787893212.917876:0:15797:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.135@tcp (19ad7764-cf95-4087-88aa-57e4229a8397) 00000020:01000000:1.0:1787893212.918147:0:15797:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1787893212.918152:0:15797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787893212.918158:0:15797:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787893212.918163:0:15797:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9fc9fe304000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787893212.918168:0:15797:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff9fc9fe144d28) has exports, disconnecting them 00000020:00080000:1.0:1787893212.918173:0:15797:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9fc9fe304000), last request at 1787892961 00000020:00000080:1.0:1787893212.918177:0:15797:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf0aee 00000020:00080000:1.0:1787893212.918189:0:15797:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc9fe304000): rc 0 00000020:00000080:1.0:1787893212.918193:0:15797:0:(genops.c:885:class_export_put()) final put ffff9fc9fe304000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1787893212.918402:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9fe304000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1787893212.919269:0:15797:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787893212.919275:0:15797:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787893212.919279:0:15797:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787893212.919283:0:15797:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787893212.919428:0:15797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787893212.919435:0:15797:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1787893212.919441:0:15797:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1787893212.919445:0:15797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787893212.919448:0:15797:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787893212.919453:0:15797:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9fc8c5f11800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787893212.919459:0:15797:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff9fc9fe1419b8) has exports, disconnecting them 00000020:00080000:0.0:1787893212.919463:0:15797:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9fc8c5f11800), last request at 1787892961 00000020:00000080:0.0:1787893212.919466:0:15797:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf0b03 00000020:00080000:0.0:1787893212.919477:0:15797:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc8c5f11800): rc 0 00000020:00000080:0.0:1787893212.919481:0:15797:0:(genops.c:885:class_export_put()) final put ffff9fc8c5f11800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1787893212.919747:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc9e70be000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1787893212.919754:0:38:0:(genops.c:885:class_export_put()) final put ffff9fc9ffb14000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1787893212.919766:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9ffb14000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1787893212.919771:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1787893212.919824:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c5f11800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1787893212.996870:0:15797:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787893212.996880:0:15797:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787893212.996885:0:15797:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787893212.996893:0:15797:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787893212.996954:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc9e5eac000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1787893212.996959:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1787893212.997165:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1787893212.997241:0:8435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1787893212.997400:0:6489:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9fc9c877e800:6489] 1 exiting: rc = 0 00000100:00100000:2.0:1787893212.997423:0:6488:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9fc9c877f800:6488] 0 exiting: rc = 1 00000100:00100000:0.0:1787893212.997539:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.997909:0:10383:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9fc8c7752400:10383] 3 exiting: rc = 0 00000100:00100000:2.0:1787893212.997984:0:6490:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9fc9d265a800:6490] 0 exiting: rc = 1 00000100:00100000:1.0:1787893212.998074:0:6491:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9fc9d265a200:6491] 1 exiting: rc = 0 00000100:00100000:3.0:1787893212.998166:0:6492:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9fc9c877ea00:6492] 2 exiting: rc = 0 00000100:00100000:0.0:1787893212.998454:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998462:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998468:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998474:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998480:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998485:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998636:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998645:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998652:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998658:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998664:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998669:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998690:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998697:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998721:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998728:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998735:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998740:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998746:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998752:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998758:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998763:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998769:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998774:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998779:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998789:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998794:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998799:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998803:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998808:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998814:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998818:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998823:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998828:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998843:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998848:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998853:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998858:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998863:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998869:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998873:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998878:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998883:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998890:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998896:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998900:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998905:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998910:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998916:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998922:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998927:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998933:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998938:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998943:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998948:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998953:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998958:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998963:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998968:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998972:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998978:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998984:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998989:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893212.998994:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787893213.000142:0:15797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787893213.000153:0:15797:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1787893213.000159:0:15797:0:(genops.c:885:class_export_put()) final put ffff9fc9fe304800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1787893213.000163:0:15797:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9fe304800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1787893213.000169:0:15797:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1787893213.000221:0:15797:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc9e70bc000 1 00000020:00000080:0.0:1787893213.000228:0:15797:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf0a93 00000020:00000080:0.0:1787893213.000233:0:15797:0:(genops.c:885:class_export_put()) final put ffff9fc9ffb12000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1787893213.000261:0:15797:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1787893213.000265:0:15797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787893213.000270:0:15797:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787893213.000274:0:15797:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff9fc9e735cd28) has no exports 00000020:00000080:2.0:1787893213.001629:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9ffb12000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1787893213.032641:0:15797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787893213.032827:0:15797:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1787893213.032833:0:15797:0:(genops.c:885:class_export_put()) final put ffff9fc9e70bd000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1787893213.032838:0:15797:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9e70bd000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1787893213.032845:0:15797:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1787893213.033212:0:15797:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9fc9e70bc800 00000020:01000000:2.0:1787893213.033237:0:15797:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1787893213.033242:0:15797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787893213.033322:0:15797:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787893213.033327:0:15797:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9fc9d9118000) has no exports 00000020:00000080:2.0:1787893213.033350:0:15797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787893213.033355:0:15797:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1787893213.033358:0:15797:0:(genops.c:885:class_export_put()) final put ffff9fc9e5ea8000/OSS_uuid 00000020:00000080:2.0:1787893213.033360:0:15797:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9e5ea8000/OSS_uuid for OSS 00000020:01000000:2.0:1787893213.033363:0:15797:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1787893213.033624:0:8420:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9fc9fe0aa200:8420] 1 exiting: rc = 0 00000100:00100000:2.0:1787893213.035192:0:8421:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9fc9fd005400:8421] 2 exiting: rc = 0 00000100:00100000:2.0:1787893213.035552:0:8419:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9fc9fe0aa000:8419] 0 exiting: rc = 1 00000100:00100000:2.0:1787893213.035902:0:8535:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9fc8c5f97800:8535] 3 exiting: rc = 0 00000100:00100000:3.0:1787893213.036077:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036097:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036107:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036117:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036126:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036134:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036142:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036151:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036160:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036170:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036179:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036186:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036196:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036205:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036216:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036224:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036232:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036242:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036261:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036271:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036282:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036292:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036300:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036311:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036320:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036348:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036360:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036370:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036393:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036400:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036404:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036409:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036413:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036418:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036423:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036428:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036432:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036436:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036442:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036447:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036451:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036457:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036463:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036467:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036472:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036476:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036481:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036485:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036510:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036515:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036520:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036525:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036530:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036534:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036538:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036543:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036548:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036554:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036560:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036567:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036574:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036581:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00080000:1.0:1787893213.036583:0:6501:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1787893213.036588:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.036605:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.037355:0:8422:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9fc9fd23ec00:8422] 0 exiting: rc = 1 00000100:00100000:3.0:1787893213.037417:0:8423:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9fc9d16dc000:8423] 1 exiting: rc = 0 00000100:00100000:1.0:1787893213.039632:0:9932:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9fc8c7410c00:9932] 2 exiting: rc = 0 00000100:00100000:3.0:1787893213.040110:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040120:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040126:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040131:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040135:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040140:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040145:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040159:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040166:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040173:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040179:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040184:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040189:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040194:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040199:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040205:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040210:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040216:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040220:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040225:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040230:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040235:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040240:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040245:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040261:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040266:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040271:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040276:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040281:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040287:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040291:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040296:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040317:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040323:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040328:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040333:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040337:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040342:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040347:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040352:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040357:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040363:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040368:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040372:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040377:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040383:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040387:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040392:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040397:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040402:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040407:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040412:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040417:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040422:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040427:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040431:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040436:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040441:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040445:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040451:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040456:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040461:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040466:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.040477:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.043117:0:8424:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9fc9d29f6e00:8424] 0 exiting: rc = 1 00000100:00100000:1.0:1787893213.043546:0:8426:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9fc9fd007000:8426] 2 exiting: rc = 0 00000100:00100000:2.0:1787893213.043976:0:8425:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9fc9d29f7800:8425] 1 exiting: rc = 0 00000100:00100000:3.0:1787893213.044482:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044501:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044508:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044521:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044525:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044530:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044536:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044541:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044546:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044551:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044557:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044562:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044570:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044576:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044582:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044588:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044593:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044599:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044606:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044613:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044618:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044624:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044630:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044635:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044640:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044645:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044664:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044671:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044676:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044681:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044685:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044691:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044696:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044701:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044706:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044712:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044717:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044722:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044733:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044739:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044744:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044749:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044755:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044760:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044765:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044770:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044775:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044781:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044786:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044792:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044809:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044817:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044823:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044828:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044835:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044840:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044845:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044850:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044856:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044869:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044875:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044881:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044886:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.044896:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893213.057072:0:8428:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9fc9e737ac00:8428] 1 exiting: rc = 0 00000100:00100000:3.0:1787893213.057297:0:8427:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9fc9e737ae00:8427] 0 exiting: rc = 1 00000100:00100000:2.0:1787893213.057398:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057406:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057412:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057418:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057423:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057429:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057434:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057440:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057445:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057449:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057462:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057470:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057475:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057480:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057485:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057519:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057526:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057531:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057536:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057541:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057546:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057550:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057554:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057559:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057564:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057568:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057573:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057578:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057583:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057587:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057592:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057597:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057602:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057607:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057612:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057632:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057637:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057641:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057647:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057652:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057657:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057661:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057667:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057699:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057707:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057713:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057718:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057723:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057728:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057733:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057738:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057743:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057748:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057754:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057759:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057765:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057769:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057774:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057780:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057785:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057791:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057798:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057803:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893213.057809:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893213.058568:0:8429:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9fc9e737b600:8429] 0 exiting: rc = 1 00000100:00100000:3.0:1787893213.059867:0:8430:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9fc9fd2be200:8430] 1 exiting: rc = 0 00000100:00100000:3.0:1787893213.060610:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060630:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060656:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060663:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060669:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060674:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060680:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060697:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060703:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060709:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060715:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060720:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060727:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060733:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060754:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060760:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060766:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060773:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060779:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060786:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060794:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060800:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060806:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060812:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060819:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060825:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060846:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060854:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060860:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060865:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060871:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060876:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060882:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060887:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060893:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060899:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060904:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060910:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060931:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060939:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060945:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060951:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060965:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060973:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060982:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.060993:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.061001:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.061027:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.061039:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.061049:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.061080:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.061090:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.061096:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.061108:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.061115:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.061122:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.061127:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.061133:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.061141:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.061147:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.061153:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.061158:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.061164:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893213.061179:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1787893213.074968:0:15797:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1787893234.132339:0:16563:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg235-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1787893244.219010:0:17162:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787893244.219016:0:17162:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1787893244.219018:0:17162:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1787893244.219140:0:17162:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fc9d0f72800 00000020:01000004:1.0:1787893244.219159:0:17162:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1787893244.219167:0:17162:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787893244.219180:0:17162:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9fc9e7358000) 00000020:00000080:1.0:1787893244.219195:0:17162:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787893244.333307:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787893244.333631:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1787893244.335273:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1787893244.336131:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1787893244.336367:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1787893244.342390:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1787893244.343176:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1787893244.343450:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1787893244.344560:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1787893244.344788:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1787893244.344998:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1787893244.345339:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1787893244.346011:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1787893244.346336:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1787893244.346748:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1787893244.347397:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1787893244.348527:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1787893244.348804:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1787893244.349202:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1787893244.350322:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1787893244.350682:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1787893244.350866:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1787893244.351164:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1787893244.351480:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1787893244.352470:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1787893244.352734:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1787893244.353327:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1787893244.353773:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1787893244.353978:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1787893244.354325:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1787893244.354624:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1787893244.354826:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1787893244.355706:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1787893244.355936:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1787893244.359195:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1787893244.360977:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787893244.362682:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1787893244.362882:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1787893244.364239:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787893244.364704:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1787893244.364915:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787893244.365529:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1787893244.366311:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1787893244.367011:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1787893244.370007:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1787893244.374389:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1787893244.374980:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1787893244.375998:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1787893244.376652:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1787893244.376885:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1787893244.377548:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1787893244.377752:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1787893244.377945:0:17162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:3.0:1787893244.382873:0:17162:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787893244.384381:0:17162:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787893244.384405:0:17162:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787893244.384611:0:17162:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9232577658cf1cd7 00000020:01000004:3.0:1787893244.384620:0:17162:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1787893244.384625:0:17162:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787893244.384631:0:17162:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fc9d0f72800 from MGS 00000020:01000004:3.0:1787893244.384634:0:17162:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787893244.384648:0:17162:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9fc9fe144d28) 00000020:00000080:3.0:1787893244.384660:0:17162:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787893244.384720:0:17162:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc9d0f72800 from MGS, refs=2 00080000:01000000:3.0:1787893244.384725:0:17162:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787893244.384731:0:17162:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9232577658cf1ce5 00000100:00100000:3.0:1787893244.384836:0:17162:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787893244.384992:0:17162:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787893244.384998:0:17162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787893244.386248:0:17162:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787893244.386258:0:17162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787893244.392300:0:17162:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787893244.392487:0:17162:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787893244.394946:0:17162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787893244.395822:0:17162:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787893244.395831:0:17162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787893244.400978:0:17162:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787893244.400995:0:17162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1787893244.401974:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893244.401978:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893244.401980:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893244.402987:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893244.402991:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893244.402993:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893244.403641:0:17162:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787893244.404722:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1787893244.416239:0:17162:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1787893244.419811:0:17174:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787893244.419884:0:17162:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787893244.419941:0:17162:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787893244.420783:0:17162:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787893244.421698:0:17162:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787893244.421869:0:17162:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787893244.421875:0:17162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787893244.426262:0:17162:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787893244.426277:0:17162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787893244.432517:0:17162:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787893244.432533:0:17162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787893244.433440:0:17162:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787893244.433463:0:17162:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.135@tcp' 00000020:01000004:2.0:1787893244.433465:0:17162:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787893244.433526:0:17162:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.135@tcp (typ=mgc) 00000020:00000080:2.0:1787893244.433538:0:17162:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.135@tcp (ffff9fc8c7730000) 00000020:00000080:2.0:1787893244.433553:0:17162:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787893244.433626:0:17162:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc8c8416000@MGC192.168.202.135@tcp: add connection 192.168.202.135@tcp at head 00010000:00010000:2.0:1787893244.433779:0:17162:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.135@tcp-0 is initialized 00000040:01000000:2.0:1787893244.433785:0:17162:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.135@tcp ctxt 1 is initialized 10000000:01000000:2.0:1787893244.433985:0:17180:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787893244.434011:0:17162:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.135@tcp (uuid 13b37fca-0eda-4b14-a6ef-4a378c945d17) 00000020:00000080:2.0:1787893244.434222:0:17162:0:(genops.c:1385:class_connect()) connect: client 13b37fca-0eda-4b14-a6ef-4a378c945d17, cookie 0x9232577658cf1cf3 00000100:00080000:2.0:1787893244.434232:0:17162:0:(import.c:510:import_select_connection()) MGC192.168.202.135@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787893244.434237:0:17162:0:(import.c:624:import_select_connection()) MGC192.168.202.135@tcp: import ffff9fc8c8416000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:2.0:1787893244.434265:0:17162:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9fe349500 x1874741493410944/t0(0) o250->MGC192.168.202.135@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787893244.434284:0:17162:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 13b37fca-0eda-4b14-a6ef-4a378c945d17->MGS 00000020:01000004:2.0:1787893244.434299:0:17162:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787893244.434303:0:17162:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787893244.434313:0:17162:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9fc8c7734d28) 00000020:00000080:2.0:1787893244.434322:0:17162:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1787893244.434525:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe349500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:13b37fca-0eda-4b14-a6ef-4a378c945d17:3629:1874741493410944:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787893244.434588:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787893244.434671:0:17179:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:1.0:1787893244.436269:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493410944 00000100:00100000:1.0:1787893244.436281:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493410944 00000100:00100000:1.0:1787893244.436320:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787893244.436328:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3629:x1874741493410944:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1787893244.436356:0:17175:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 13b37fca-0eda-4b14-a6ef-4a378c945d17@0@lo t0 exp 0000000000000000 cur 488 last 0 00000020:00000080:1.0:1787893244.436386:0:17175:0:(genops.c:1385:class_connect()) connect: client 13b37fca-0eda-4b14-a6ef-4a378c945d17, cookie 0x9232577658cf1d01 00000100:00080000:1.0:1787893244.436518:0:17175:0:(import.c:65:import_set_state_nolock()) ffff9fc9e70ba800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787893244.436589:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+5:3629:x1874741493410944:12345-0@lo:250:mount.lustre.0 Request processed in 261us (2000us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893244.436597:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787893244.436631:0:3629:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.135@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1787893244.436639:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.135@tcp: connect to target with instance 0 00000100:00080000:1.0:1787893244.436646:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.135@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1787893244.436651:0:3629:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1787893244.436654:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc8c8416000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1787893244.436656:0:3629:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1787893244.436665:0:3629:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1787893244.436670:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe349500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:13b37fca-0eda-4b14-a6ef-4a378c945d17:3629:1874741493410944:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787893244.459563:0:17162:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787893244.460610:0:17162:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787893244.460617:0:17162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787893244.473113:0:17162:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787893244.473134:0:17162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787893244.473720:0:17162:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787893244.473734:0:17162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787893244.475749:0:17162:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787893244.476359:0:17162:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787893244.476369:0:17162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787893244.477155:0:17162:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787893244.477170:0:17162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787893244.599597:0:17162:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787893244.604454:0:17162:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787893244.604468:0:17162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787893244.607751:0:17162:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787893244.607768:0:17162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1787893244.609951:0:17162:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787893244.610140:0:17162:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787893244.610302:0:17162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787893244.611516:0:17162:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787893244.611526:0:17162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1787893244.612345:0:17162:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787893244.612554:0:17162:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787893244.612560:0:17162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787893244.614740:0:17162:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787893244.614755:0:17162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787893244.620274:0:17162:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787893244.620464:0:17162:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787893244.620470:0:17162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787893244.621990:0:17162:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787893244.622000:0:17162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787893244.652109:0:17162:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787893244.652812:0:17162:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787893244.652818:0:17162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787893244.654316:0:17162:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787893244.654330:0:17162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787893244.656927:0:17162:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787893244.656945:0:17162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787893244.658254:0:17162:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787893244.658284:0:17162:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1787893244.658290:0:17162:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.135@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787893244.658393:0:17162:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.135@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787893244.658439:0:17162:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.135@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1787893244.658444:0:17162:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787893244.658445:0:17162:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787893244.658447:0:17162:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787893244.658448:0:17162:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787893244.658450:0:17162:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787893244.658451:0:17162:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787893244.658453:0:17162:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787893244.658454:0:17162:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787893244.658456:0:17162:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787893244.658457:0:17162:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787893244.658460:0:17162:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1787893244.658462:0:17162:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787893244.658463:0:17162:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787893244.658464:0:17162:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787893244.658465:0:17162:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787893244.658466:0:17162:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787893244.658467:0:17162:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787893244.658469:0:17162:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787893244.658470:0:17162:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787893244.658471:0:17162:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787893244.658472:0:17162:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787893244.658535:0:17162:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787893244.658557:0:17162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe34b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17162:1874741493411072:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787893244.658645:0:17162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893244.658712:0:17162:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d29e3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787893244.658890:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493411072 00000100:00100000:1.0:1787893244.658898:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493411072 00000100:00100000:1.0:1787893244.658940:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787893244.658949:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+5:17162:x1874741493411072:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787893244.659011:0:17178:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787893244.659015:0:17178:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787893244.659018:0:17178:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1787893244.659424:0:17199:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787893244.660003:0:17178:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:1.0:1787893244.665091:0:17200:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1787893244.665103:0:17200:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1787893244.665119:0:17200:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1787893244.665122:0:17200:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1787893244.666789:0:17200:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1787893244.667031:0:17178:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787893244.667045:0:17178:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787893244.672534:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+5:17162:x1874741493411072:12345-0@lo:253:mount.lustre.0 Request processed in 13576us (13880us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893244.672557:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787893244.672701:0:17162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe34b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17162:1874741493411072:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787893244.672719:0:17162:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787893244.672722:0:17162:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787893244.672724:0:17162:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787893244.672725:0:17162:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787893244.672727:0:17162:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787893244.672728:0:17162:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787893244.672730:0:17162:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787893244.672731:0:17162:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787893244.672733:0:17162:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787893244.672735:0:17162:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787893244.672749:0:17162:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787893244.672767:0:17162:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fc9d0f72800 from lustre-MDT0000 10000000:01000000:2.0:1787893244.672799:0:17162:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787893244.672802:0:17162:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787893244.672807:0:17162:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9fc8c7730000 10000000:01000000:2.0:1787893244.672811:0:17162:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787893244.672820:0:17162:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fc8c7730000 from 1 10000000:01000000:2.0:1787893244.672822:0:17162:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787893244.672862:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c800/0x9232577658cf1d08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893244.672873:0:17162:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c800/0x9232577658cf1d08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893244.672884:0:17162:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c800/0x9232577658cf1d08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893244.672904:0:17162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe34b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17162:1874741493411200:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787893244.672942:0:17162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893244.672995:0:17162:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d29e3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787893244.676741:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493411200 00000100:00100000:3.0:1787893244.676757:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493411200 00000100:00100000:3.0:1787893244.676836:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787893244.676847:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+5:17162:x1874741493411200:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787893244.676865:0:17177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893244.676885:0:17177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c84f7000/0x9232577658cf1d0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf1d08 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893244.676923:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c84f7000/0x9232577658cf1d0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf1d08 expref: 6 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893244.676933:0:17177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c84f7000/0x9232577658cf1d0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf1d08 expref: 6 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893244.676942:0:17177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c84f7000, rc 0) 00000100:00100000:3.0:1787893244.677027:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+6:17162:x1874741493411200:12345-0@lo:101:mount.lustre.0 Request processed in 181us (4085us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893244.677033:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787893244.677178:0:17162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe34b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17162:1874741493411200:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787893244.677195:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c800/0x9232577658cf1d08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1d0f expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893244.677215:0:17162:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c800/0x9232577658cf1d08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf1d0f expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893244.677287:0:17162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe34b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17162:1874741493411328:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787893244.677317:0:17162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893244.677385:0:17162:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d29e3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787893244.678155:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493411328 00000100:00100000:0.0:1787893244.678169:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493411328 00000100:00100000:0.0:1787893244.678222:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787893244.678230:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+6:17162:x1874741493411328:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787893244.678320:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+6:17162:x1874741493411328:12345-0@lo:501:mount.lustre.0 Request processed in 91us (1002us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787893244.678327:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787893244.678489:0:17162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe34b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17162:1874741493411328:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787893244.678539:0:17162:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787893244.678559:0:17162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c800/0x9232577658cf1d08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1d0f expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893244.678569:0:17162:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c800/0x9232577658cf1d08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1d0f expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893244.678578:0:17162:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fc9d0f72800 10000000:01000000:2.0:1787893244.678584:0:17162:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787893244.678589:0:17162:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9fc9d0f72800 10000000:01000000:2.0:1787893244.678592:0:17162:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787893244.678597:0:17162:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9fc9d0f72800 from 1 10000000:01000000:2.0:1787893244.678600:0:17162:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787893244.678623:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf1d16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893244.678630:0:17162:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf1d16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893244.678639:0:17162:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf1d16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893244.678653:0:17162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe34b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17162:1874741493411456:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787893244.678677:0:17162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893244.678708:0:17162:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d29e3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787893244.678762:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493411456 00000100:00100000:3.0:1787893244.678766:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493411456 00000100:00100000:3.0:1787893244.678796:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787893244.678802:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+6:17162:x1874741493411456:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787893244.678810:0:17177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893244.678821:0:17177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c84f6200/0x9232577658cf1d1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf1d16 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893244.678838:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c84f6200/0x9232577658cf1d1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf1d16 expref: 7 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893244.678847:0:17177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c84f6200/0x9232577658cf1d1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf1d16 expref: 7 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893244.678855:0:17177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c84f6200, rc 0) 00000100:00100000:3.0:1787893244.678880:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+7:17162:x1874741493411456:12345-0@lo:101:mount.lustre.0 Request processed in 78us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893244.678885:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787893244.678954:0:17162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe34b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17162:1874741493411456:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787893244.678978:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf1d16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1d1d expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893244.678997:0:17162:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf1d16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf1d1d expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893244.679009:0:17162:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787893244.679012:0:17162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf1d16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1d1d expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893244.679018:0:17162:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf1d16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1d1d expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893244.679025:0:17162:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787893244.679029:0:17162:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787893244.679033:0:17162:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9fc9d0f72800 10000000:01000000:2.0:1787893244.679035:0:17162:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787893244.679038:0:17162:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787893244.679040:0:17162:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787893244.679052:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf1d24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893244.679059:0:17162:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf1d24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893244.679066:0:17162:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf1d24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893244.679077:0:17162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe34b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17162:1874741493411584:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787893244.679101:0:17162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893244.679122:0:17162:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d29e3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787893244.679970:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493411584 00000100:00100000:3.0:1787893244.679977:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493411584 00000100:00100000:3.0:1787893244.680016:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787893244.680023:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+7:17162:x1874741493411584:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787893244.680032:0:17177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893244.680044:0:17177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c84f6800/0x9232577658cf1d2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf1d24 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893244.680061:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c84f6800/0x9232577658cf1d2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf1d24 expref: 8 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893244.680069:0:17177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c84f6800/0x9232577658cf1d2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf1d24 expref: 8 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893244.680076:0:17177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c84f6800, rc 0) 00000100:00100000:3.0:1787893244.680112:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+8:17162:x1874741493411584:12345-0@lo:101:mount.lustre.0 Request processed in 89us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893244.680118:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787893244.680200:0:17162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe34b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17162:1874741493411584:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787893244.680226:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf1d24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1d2b expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893244.680234:0:17162:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf1d24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf1d2b expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893244.680287:0:17162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe34b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17162:1874741493411712:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787893244.680315:0:17162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893244.680345:0:17162:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d29e3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787893244.680410:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493411712 00000100:00100000:1.0:1787893244.680434:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493411712 00000100:00100000:1.0:1787893244.680536:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787893244.680548:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+8:17162:x1874741493411712:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787893244.680795:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+9:17162:x1874741493411712:12345-0@lo:501:mount.lustre.0 Request processed in 249us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893244.680818:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787893244.680834:0:17162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe34b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17162:1874741493411712:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787893244.680875:0:17162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17162:1874741493411840:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787893244.680927:0:17162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893244.680967:0:17162:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fd02a300 going to sleep for 11 seconds 00000100:00100000:2.0:1787893244.681039:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493411840 00000100:00100000:2.0:1787893244.681045:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493411840 00000100:00100000:2.0:1787893244.681091:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787893244.681102:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+9:17162:x1874741493411840:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787893244.682047:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+9:17162:x1874741493411840:12345-0@lo:503:mount.lustre.0 Request processed in 946us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893244.682058:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787893244.682156:0:17162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17162:1874741493411840:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787893244.682726:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13b37fca-0eda-4b14-a6ef-4a378c945d17:17201:1874741493411968:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787893244.682771:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893244.682806:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fd02a840 going to sleep for 11 seconds 00000100:00100000:1.0:1787893244.683160:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493411968 00000100:00100000:1.0:1787893244.683177:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493411968 00000100:00100000:1.0:1787893244.683251:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787893244.683262:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+9:17201:x1874741493411968:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787893244.684676:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+9:17201:x1874741493411968:12345-0@lo:502:llog_process_th.0 Request processed in 1408us (1897us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893244.684689:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787893244.685003:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13b37fca-0eda-4b14-a6ef-4a378c945d17:17201:1874741493411968:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787893244.685048:0:17201:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787893244.685061:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893244.685063:0:17201:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787893244.685069:0:17201:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787893244.685073:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787893244.685089:0:17201:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9fc8c71bb370) 00000020:00000080:0.0:1787893244.685106:0:17201:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787893244.685111:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787893244.685226:0:17201:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787893244.685237:0:17201:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9232577658cf1d39 00000020:00000080:0.0:1787893244.685457:0:17201:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787893244.685468:0:17201:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787893244.685472:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893244.685474:0:17201:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787893244.685476:0:17201:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787893244.685480:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893244.685481:0:17201:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787893244.685485:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787893244.685532:0:17201:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9fc8c71b8000) 00000020:00000080:0.0:1787893244.685542:0:17201:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787893244.685547:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787893244.685549:0:17201:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787893244.685551:0:17201:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787893244.685556:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787893244.685598:0:17201:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc9d0f72800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787893244.685611:0:17201:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9fc8c71bcd28) 00000020:00000080:0.0:1787893244.685618:0:17201:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787893244.685659:0:17201:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787893244.685664:0:17201:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9232577658cf1d4e 00000020:00000080:0.0:1787893244.685754:0:17201:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787893244.685760:0:17201:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787893244.685765:0:17201:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9232577658cf1d55 00080000:01000000:0.0:1787893244.685769:0:17201:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787893244.685772:0:17201:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9232577658cf1d5c 00010000:00010000:3.0:1787893244.768891:0:17201:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1787893244.769688:0:17201:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967529 00000001:00080000:3.0:1787893244.770379:0:17201:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787893244.771048:0:17201:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9fc9fe1419b8) 00000020:00000080:3.0:1787893244.771069:0:17201:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787893244.771154:0:17201:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787893244.771162:0:17201:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9232577658cf1d6a 00000020:00000080:1.0:1787893244.780223:0:17201:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787893244.786279:0:17201:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9232577658cf1d71 00000020:00000080:1.0:1787893244.789028:0:17201:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787893244.789044:0:17201:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787893244.789051:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893244.789053:0:17201:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787893244.789056:0:17201:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787893244.789059:0:17201:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1787893244.789060:0:17201:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787893244.789062:0:17201:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787893244.789063:0:17201:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787893244.789065:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893244.789066:0:17201:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787893244.789068:0:17201:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787893244.789074:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893244.789075:0:17201:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787893244.789080:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787893244.789127:0:17201:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787893244.789143:0:17201:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787893244.789146:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893244.789148:0:17201:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1787893244.789150:0:17201:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787893244.789162:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893244.789164:0:17201:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1787893244.789167:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787893244.789173:0:17201:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.135@tcp to nid 0x20000c0a8ca87 (192.168.202.135@tcp) 00000020:00000080:1.0:1787893244.789200:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787893244.789216:0:17201:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9fc9e73599b8) 00000020:00000080:1.0:1787893244.789233:0:17201:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1787893244.789239:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787893244.789297:0:17201:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1787893244.789303:0:17201:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787893244.789310:0:17201:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9232577658cf1d7f 00010000:00080000:1.0:1787893244.789354:0:17201:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc9e5eaf000@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.135@tcp at head 00010000:00010000:1.0:1787893244.791998:0:17201:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1787893244.793543:0:17201:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787893244.793557:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1787893244.793607:0:17201:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787893244.793629:0:17201:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9232577658cf1d86 00000100:00080000:2.0:1787893244.793640:0:17201:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787893244.793646:0:17201:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9fc9e5eaf000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:2.0:1787893244.793682:0:17201:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9fe34bb80 x1874741493412096/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787893244.793707:0:17201:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1787893244.793762:0:17201:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787893244.793778:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893244.793780:0:17201:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1787893244.793784:0:17201:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787893244.793787:0:17201:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1787893244.793788:0:17201:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787893244.793790:0:17201:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787893244.793791:0:17201:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787893244.793794:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893244.793795:0:17201:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787893244.793798:0:17201:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787893244.793802:0:17201:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787893244.793806:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893244.793807:0:17201:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787893244.793810:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787893244.793814:0:17201:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.135@tcp to nid 0x20000c0a8ca87 (192.168.202.135@tcp) 00000020:01000000:2.0:1787893244.793840:0:17201:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787893244.793843:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787893244.793856:0:17201:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9fc8c77319b8) 00000020:00000080:2.0:1787893244.793868:0:17201:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1787893244.793873:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787893244.793930:0:17201:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787893244.793936:0:17201:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787893244.793943:0:17201:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9232577658cf1d94 00010000:00080000:2.0:1787893244.793984:0:17201:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc9d24d5000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.135@tcp at head 00010000:00010000:2.0:1787893244.794184:0:17201:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:1.0:1787893244.794852:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe34bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493412096:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787893244.794925:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893244.795386:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493412096 00000100:00100000:2.0:1787893244.795399:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493412096 00000100:00100000:2.0:1787893244.795454:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787893244.795462:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3629:x1874741493412096:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1787893244.795482:0:17188:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:1.0:1787893244.800241:0:17201:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787893244.800656:0:17201:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787893244.804025:0:17201:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787893244.804380:0:17201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1787893244.811249:0:17201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1787893244.817385:0:17207:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787893244.817396:0:17207:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787893244.818129:0:17201:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787893244.818141:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787893244.818178:0:17201:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787893244.818198:0:17201:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9232577658cf1d9b 00000100:00080000:3.0:1787893244.818209:0:17201:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787893244.818223:0:17201:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fc9d24d5000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:3.0:1787893244.818260:0:17201:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c8506680 x1874741493412224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787893244.818288:0:17201:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787893244.818337:0:17201:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787893244.818342:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893244.818344:0:17201:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787893244.818347:0:17201:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787893244.818350:0:17201:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1787893244.818352:0:17201:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787893244.818353:0:17201:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787893244.818354:0:17201:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787893244.818357:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893244.818358:0:17201:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787893244.818360:0:17201:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787893244.818365:0:17201:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787893244.818368:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893244.818369:0:17201:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787893244.818372:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787893244.818375:0:17201:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.135@tcp to nid 0x20000c0a8ca87 (192.168.202.135@tcp) 00000020:01000000:3.0:1787893244.818398:0:17201:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787893244.818401:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787893244.818412:0:17201:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9fc9fe140000) 00000020:00000080:3.0:1787893244.818425:0:17201:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1787893244.818430:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787893244.818530:0:17201:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787893244.818537:0:17201:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:3.0:1787893244.818542:0:17201:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9232577658cf1da9 00010000:00080000:3.0:1787893244.818572:0:17201:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc9e5eaa000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.135@tcp at head 00010000:00010000:3.0:1787893244.818778:0:17201:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1787893244.818853:0:17201:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787893244.818875:0:17201:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1787893244.819105:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493412224:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787893244.819168:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874741493412224 offset 0 length 520: 4 00000040:00080000:3.0:1787893244.821106:0:17201:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787893244.821552:0:17201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1787893244.821718:0:17201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:2.0:1787893244.823400:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3629:x1874741493412096:12345-0@lo:38:llog_process_th.0 Request processed in 27929us (28467us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787893244.823426:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787893244.823637:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9e5eaf000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787893244.823644:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787893244.823648:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe34bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493412096:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1787893244.823807:0:17209:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787893244.823812:0:17209:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787893244.824533:0:17201:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787893244.824545:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787893244.824583:0:17201:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787893244.824603:0:17201:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9232577658cf1db0 00000100:00080000:1.0:1787893244.824618:0:17201:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787893244.824624:0:17201:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fc9e5eaa000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:1.0:1787893244.824656:0:17201:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c64b4700 x1874741493412352/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787893244.824680:0:17201:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787893244.824730:0:17201:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787893244.824734:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893244.824736:0:17201:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787893244.824738:0:17201:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787893244.824742:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893244.824744:0:17201:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787893244.824746:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787893244.824748:0:17201:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787893244.824751:0:17201:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787893244.824753:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893244.824754:0:17201:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787893244.824757:0:17201:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787893244.824759:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893244.824760:0:17201:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787893244.824764:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787893244.824850:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493412352:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787893244.824929:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874741493412352 offset 0 length 520: 4 00000100:00100000:1.0:1787893244.825094:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13b37fca-0eda-4b14-a6ef-4a378c945d17:17201:1874741493412480:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787893244.825147:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893244.825177:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e72b36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787893244.825226:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493412480 00000100:00100000:3.0:1787893244.825233:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493412480 00000100:00100000:3.0:1787893244.825283:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787893244.825292:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+9:17201:x1874741493412480:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787893244.825406:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+9:17201:x1874741493412480:12345-0@lo:502:llog_process_th.0 Request processed in 115us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893244.825428:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787893244.825482:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13b37fca-0eda-4b14-a6ef-4a378c945d17:17201:1874741493412480:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787893244.825529:0:17201:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787893244.825535:0:17201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893244.825537:0:17201:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787893244.825541:0:17201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1787893244.826225:0:17162:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1787893244.826255:0:17162:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787893244.826355:0:17162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf1d24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1d2b expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893244.826368:0:17162:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf1d24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1d2b expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893244.826377:0:17162:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc9d0f72800 from 1 10000000:01000000:2.0:1787893244.826380:0:17162:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787893244.826420:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c000/0x9232577658cf1db7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893244.826429:0:17162:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c000/0x9232577658cf1db7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893244.826438:0:17162:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c000/0x9232577658cf1db7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893244.826454:0:17162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe348000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17162:1874741493412608:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787893244.826574:0:17162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893244.826602:0:17162:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d29e3540 going to sleep for 11 seconds 00000100:00100000:1.0:1787893244.826801:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493412608 00000100:00100000:1.0:1787893244.826807:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493412608 00000100:00100000:1.0:1787893244.826851:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787893244.826861:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+9:17162:x1874741493412608:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787893244.826873:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893244.826889:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9fe540200/0x9232577658cf1dbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf1db7 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893244.826925:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9fe540200/0x9232577658cf1dbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf1db7 expref: 10 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893244.826935:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9fe540200/0x9232577658cf1dbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf1db7 expref: 10 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893244.826943:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe540200, rc 0) 00000100:00100000:1.0:1787893244.826992:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+10:17162:x1874741493412608:12345-0@lo:101:mount.lustre.0 Request processed in 133us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893244.826999:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787893244.827169:0:17162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe348000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17162:1874741493412608:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787893244.827183:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c000/0x9232577658cf1db7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1dbe expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893244.827192:0:17162:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c000/0x9232577658cf1db7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf1dbe expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893244.827798:0:17162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe348000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17162:1874741493412736:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787893244.827841:0:17162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893244.827861:0:17162:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d29e3540 going to sleep for 11 seconds 00000100:00100000:1.0:1787893244.828159:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493412736 00000100:00100000:1.0:1787893244.828165:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493412736 00000100:00100000:1.0:1787893244.828209:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787893244.828219:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+10:17162:x1874741493412736:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787893244.828236:0:17177:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787893244.828242:0:17177:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787893244.828321:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+10:17162:x1874741493412736:12345-0@lo:256:mount.lustre.0 Request processed in 103us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893244.828329:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787893244.828532:0:17162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe348000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17162:1874741493412736:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787893244.829157:0:17162:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787893244.829734:0:17162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c000/0x9232577658cf1db7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1dbe expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893244.829747:0:17162:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c000/0x9232577658cf1db7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1dbe expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893244.829757:0:17162:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc9d0f72800 from 1 10000000:01000000:2.0:1787893244.829759:0:17162:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787893244.829804:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d400/0x9232577658cf1dc5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893244.829813:0:17162:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d400/0x9232577658cf1dc5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893244.829824:0:17162:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d400/0x9232577658cf1dc5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893244.829847:0:17162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe348000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17162:1874741493412864:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787893244.829891:0:17162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893244.829928:0:17162:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d29e3540 going to sleep for 11 seconds 00000100:00100000:0.0:1787893244.830030:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493412864 00000100:00100000:0.0:1787893244.830038:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493412864 00000100:00100000:0.0:1787893244.830086:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787893244.830095:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+10:17162:x1874741493412864:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787893244.830107:0:17178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893244.830123:0:17178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9dd69ca00/0x9232577658cf1dcc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf1dc5 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893244.830146:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9dd69ca00/0x9232577658cf1dcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf1dc5 expref: 11 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893244.830167:0:17178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9dd69ca00/0x9232577658cf1dcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf1dc5 expref: 11 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893244.830176:0:17178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9dd69ca00, rc 0) 00000100:00100000:0.0:1787893244.830220:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+11:17162:x1874741493412864:12345-0@lo:101:mount.lustre.0 Request processed in 126us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893244.830227:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787893244.830338:0:17162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe348000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17162:1874741493412864:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787893244.830359:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d400/0x9232577658cf1dc5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1dcc expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893244.830369:0:17162:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d400/0x9232577658cf1dc5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf1dcc expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893244.830438:0:17162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe348000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17162:1874741493412992:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787893244.830464:0:17162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893244.830486:0:17162:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d29e3540 going to sleep for 11 seconds 00000100:00100000:0.0:1787893244.830645:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493412992 00000100:00100000:0.0:1787893244.830650:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493412992 00000100:00100000:0.0:1787893244.830686:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787893244.830693:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+11:17162:x1874741493412992:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787893244.830834:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+11:17162:x1874741493412992:12345-0@lo:501:mount.lustre.0 Request processed in 140us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893244.830841:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787893244.830990:0:17162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe348000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17162:1874741493412992:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787893244.831017:0:17162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe348000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17162:1874741493413120:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787893244.831054:0:17162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893244.831082:0:17162:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d29e3540 going to sleep for 11 seconds 00000100:00100000:1.0:1787893244.831123:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493413120 00000100:00100000:1.0:1787893244.831128:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493413120 00000100:00100000:1.0:1787893244.831157:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787893244.831164:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+11:17162:x1874741493413120:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787893244.831253:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+11:17162:x1874741493413120:12345-0@lo:503:mount.lustre.0 Request processed in 90us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893244.831260:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787893244.831377:0:17162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe348000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17162:1874741493413120:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787893244.834088:0:17211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13b37fca-0eda-4b14-a6ef-4a378c945d17:17211:1874741493413248:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787893244.834169:0:17211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893244.834249:0:17211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d1010540 going to sleep for 11 seconds 00000100:00100000:1.0:1787893244.834295:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493413248 00000100:00100000:1.0:1787893244.834304:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493413248 00000100:00100000:1.0:1787893244.834390:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787893244.834400:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+11:17211:x1874741493413248:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787893244.835123:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+11:17211:x1874741493413248:12345-0@lo:502:llog_process_th.0 Request processed in 721us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893244.835133:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787893244.835258:0:17211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13b37fca-0eda-4b14-a6ef-4a378c945d17:17211:1874741493413248:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787893244.835291:0:17211:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787893244.835300:0:17211:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893244.835303:0:17211:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787893244.835310:0:17211:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc9d0f72800 00000020:00000080:0.0:1787893244.835313:0:17211:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787893244.835321:0:17211:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787893244.835323:0:17211:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893244.835324:0:17211:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787893244.835334:0:17211:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787893244.835336:0:17211:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893244.835338:0:17211:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787893244.835341:0:17211:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc9d0f72800 00000020:00000080:0.0:1787893244.835344:0:17211:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787893244.835467:0:17211:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787893244.835472:0:17211:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893244.835473:0:17211:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787893244.835476:0:17211:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787893244.835478:0:17211:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893244.835480:0:17211:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787893244.835484:0:17211:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc9d0f72800 00000020:00000080:0.0:1787893244.835486:0:17211:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787893244.836628:0:17211:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787893244.836637:0:17211:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893244.836639:0:17211:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787893244.836643:0:17211:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787893244.836647:0:17211:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893244.836648:0:17211:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787893244.836653:0:17211:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc9d0f72800 00000020:00000080:0.0:1787893244.836655:0:17211:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787893244.836719:0:17211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13b37fca-0eda-4b14-a6ef-4a378c945d17:17211:1874741493413376:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787893244.836780:0:17211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893244.836996:0:17211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c2f53000 going to sleep for 11 seconds 00000100:00100000:1.0:1787893244.837041:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493413376 00000100:00100000:1.0:1787893244.837049:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493413376 00000100:00100000:1.0:1787893244.837150:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787893244.837163:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5feec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+11:17211:x1874741493413376:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787893244.837293:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5feec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+11:17211:x1874741493413376:12345-0@lo:502:llog_process_th.0 Request processed in 133us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893244.837301:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787893244.837382:0:17211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13b37fca-0eda-4b14-a6ef-4a378c945d17:17211:1874741493413376:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787893244.837409:0:17211:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787893244.837427:0:17211:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893244.837430:0:17211:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787893244.837434:0:17211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1787893244.837738:0:17162:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1787893244.837761:0:17162:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787893244.837784:0:17162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d400/0x9232577658cf1dc5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1dcc expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893244.837797:0:17162:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d400/0x9232577658cf1dc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1dcc expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893244.837854:0:17162:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787893244.837857:0:17162:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fc9d0f72800 10000000:01000000:2.0:1787893244.837860:0:17162:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fc9d0f72800 10000000:01000000:2.0:1787893244.837864:0:17162:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787893244.837869:0:17162:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc9d0f72800 from 1 10000000:01000000:2.0:1787893244.837878:0:17162:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787893244.837906:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d600/0x9232577658cf1dd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893244.837914:0:17162:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d600/0x9232577658cf1dd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893244.837925:0:17162:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d600/0x9232577658cf1dd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893244.837941:0:17162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe348000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17162:1874741493413504:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787893244.837986:0:17162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893244.838213:0:17162:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d29e3540 going to sleep for 11 seconds 00000100:00100000:3.0:1787893244.838281:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493413504 00000100:00100000:3.0:1787893244.838288:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493413504 00000100:00100000:3.0:1787893244.838317:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787893244.838325:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+11:17162:x1874741493413504:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787893244.838335:0:17177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893244.838349:0:17177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c84f6400/0x9232577658cf1dda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf1dd3 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893244.838379:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c84f6400/0x9232577658cf1dda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf1dd3 expref: 12 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893244.838391:0:17177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c84f6400/0x9232577658cf1dda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf1dd3 expref: 12 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893244.838400:0:17177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c84f6400, rc 0) 00000100:00100000:3.0:1787893244.838456:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+12:17162:x1874741493413504:12345-0@lo:101:mount.lustre.0 Request processed in 130us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893244.838463:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787893244.842703:0:17162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe348000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17162:1874741493413504:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787893244.842732:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d600/0x9232577658cf1dd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1dda expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893244.842746:0:17162:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d600/0x9232577658cf1dd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf1dda expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893244.842843:0:17162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe348000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17162:1874741493413632:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787893244.842908:0:17162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893244.842938:0:17162:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d29e3540 going to sleep for 11 seconds 00000100:00100000:1.0:1787893244.848472:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493413632 00000100:00100000:1.0:1787893244.848510:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493413632 00000100:00100000:1.0:1787893244.848578:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787893244.848589:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+12:17162:x1874741493413632:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787893244.848792:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+12:17162:x1874741493413632:12345-0@lo:501:mount.lustre.0 Request processed in 204us (5884us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893244.848800:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787893244.848928:0:17162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe348000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17162:1874741493413632:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787893244.848990:0:17162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe348000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17162:1874741493413760:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787893244.849045:0:17162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893244.849080:0:17162:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d29e3540 going to sleep for 11 seconds 00000100:00100000:3.0:1787893244.849171:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493413760 00000100:00100000:3.0:1787893244.849176:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493413760 00000100:00100000:3.0:1787893244.849198:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787893244.849205:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+12:17162:x1874741493413760:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787893244.849298:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+12:17162:x1874741493413760:12345-0@lo:503:mount.lustre.0 Request processed in 93us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893244.849306:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787893244.849530:0:17162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe348000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17162:1874741493413760:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787893244.849769:0:17215:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe348000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13b37fca-0eda-4b14-a6ef-4a378c945d17:17215:1874741493413888:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787893244.849810:0:17215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893244.849833:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493413888 00000100:00100000:2.0:1787893244.849837:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493413888 00000100:00100000:2.0:1787893244.849854:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787893244.849860:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+12:17215:x1874741493413888:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787893244.849934:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+12:17215:x1874741493413888:12345-0@lo:502:llog_process_th.0 Request processed in 73us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893244.849941:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787893244.849979:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d29e3780 going to sleep for 11 seconds 00000100:00100000:2.0:1787893244.849989:0:17215:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe348000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13b37fca-0eda-4b14-a6ef-4a378c945d17:17215:1874741493413888:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1787893244.850038:0:17215:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787893244.850052:0:17215:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9fc8c7733370) 00000020:00000080:2.0:1787893244.850068:0:17215:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1787893244.850138:0:17215:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc9d0f72800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787893244.850142:0:17215:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc9d0f72800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787893244.850145:0:17215:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc9d0f72800 4 00010000:00080000:2.0:1787893244.850169:0:17215:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc8c7760000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.135@tcp at head 00010000:00010000:2.0:1787893244.858739:0:17215:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1787893244.858986:0:17215:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787893244.859029:0:17215:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787893244.859043:0:17215:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9232577658cf1de8 00000100:00080000:2.0:1787893244.859054:0:17215:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787893244.859060:0:17215:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9fc8c7760000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:2.0:1787893244.859094:0:17215:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9fe348000 x1874741493414016/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787893244.859157:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe348000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874741493414016:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787893244.859236:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787893244.859312:0:17215:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787893244.864169:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493414016 00000100:00100000:3.0:1787893244.864185:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493414016 00000100:00100000:3.0:1787893244.864238:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787893244.864247:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe348a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3629:x1874741493414016:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787893244.864344:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe348a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3629:x1874741493414016:12345-0@lo:38:llog_process_th.0 Request processed in 97us (5107us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787893244.864351:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787893244.866622:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787893244.866635:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7760000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787893244.866642:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787893244.866647:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe348000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874741493414016:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787893244.868987:0:17215:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe348000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13b37fca-0eda-4b14-a6ef-4a378c945d17:17215:1874741493414144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787893244.869072:0:17215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893244.869107:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493414144 00000100:00100000:2.0:1787893244.869114:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493414144 00000100:00100000:2.0:1787893244.869159:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787893244.869168:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+12:17215:x1874741493414144:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787893244.869276:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+12:17215:x1874741493414144:12345-0@lo:502:llog_process_th.0 Request processed in 107us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893244.869284:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787893244.869330:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d29e39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787893244.869348:0:17215:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe348000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13b37fca-0eda-4b14-a6ef-4a378c945d17:17215:1874741493414144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787893244.869383:0:17215:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe348000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13b37fca-0eda-4b14-a6ef-4a378c945d17:17215:1874741493414272:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787893244.869623:0:17215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893244.869646:0:17215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7135cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787893244.869752:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493414272 00000100:00100000:1.0:1787893244.869758:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493414272 00000100:00100000:1.0:1787893244.870546:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787893244.870556:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+12:17215:x1874741493414272:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787893244.870681:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+12:17215:x1874741493414272:12345-0@lo:502:llog_process_th.0 Request processed in 127us (1267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893244.870695:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787893244.872701:0:17215:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe348000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13b37fca-0eda-4b14-a6ef-4a378c945d17:17215:1874741493414272:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787893244.872747:0:17215:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1787893244.873641:0:17162:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787893244.873671:0:17162:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787893244.873697:0:17162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d600/0x9232577658cf1dd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1dda expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893244.873710:0:17162:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d600/0x9232577658cf1dd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1dda expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787893244.873760:0:17162:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787893244.873762:0:17162:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787893244.873763:0:17162:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787893244.873764:0:17162:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787893244.873765:0:17162:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787893244.873767:0:17162:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787893244.873768:0:17162:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787893244.873777:0:17162:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787893244.873778:0:17162:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787893244.873780:0:17162:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787893244.873785:0:17162:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1787893244.873788:0:17162:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787893244.873790:0:17162:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787893244.873791:0:17162:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787893244.873792:0:17162:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787893244.873793:0:17162:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787893244.873794:0:17162:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787893244.873796:0:17162:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787893244.873797:0:17162:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787893244.873797:0:17162:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787893244.873798:0:17162:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787893244.873826:0:17162:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787893244.873849:0:17162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe348000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17162:1874741493414400:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787893244.873921:0:17162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893244.873965:0:17162:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d29e3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787893244.877649:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493414400 00000100:00100000:1.0:1787893244.877667:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493414400 00000100:00100000:1.0:1787893244.877728:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787893244.877739:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+12:17162:x1874741493414400:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787893244.877782:0:17175:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787893244.877795:0:17175:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787893244.879755:0:17175:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787893244.881162:0:17175:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787893244.881557:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+12:17162:x1874741493414400:12345-0@lo:253:mount.lustre.0 Request processed in 3815us (7631us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893244.881569:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787893244.881786:0:17162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe348000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17162:1874741493414400:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787893244.881801:0:17162:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787893244.881811:0:17162:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787893244.881813:0:17162:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787893244.881814:0:17162:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787893244.881816:0:17162:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787893244.881817:0:17162:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787893244.881818:0:17162:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787893244.881820:0:17162:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787893244.881821:0:17162:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787893244.881823:0:17162:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787893244.881824:0:17162:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787893244.881839:0:17162:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1787893244.884917:0:17199:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787893244.884928:0:17199:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787893244.884969:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fc9c147cc00/0x9232577658cf1def lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893244.885000:0:17199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9fe540200/0x9232577658cf1dbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf1db7 expref: 11 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893244.885008:0:17199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fc9c147cc00/0x9232577658cf1def lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893244.885052:0:17199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9fe540200/0x9232577658cf1dbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf1db7 expref: 11 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893244.885095:0:17199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc9fe540200/0x9232577658cf1dbe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf1db7 expref: 11 pid: 17175 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893244.885111:0:17199:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe348380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17199:1874741493414528:0@lo:104: 00000100:00100000:2.0:1787893244.885175:0:17199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893244.885217:0:17199:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7135cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787893244.889353:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493414528 00000100:00100000:1.0:1787893244.889369:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493414528 00000100:00100000:1.0:1787893244.889438:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787893244.889449:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe349880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13b37fca-0eda-4b14-a6ef-4a378c945d17+3:17199:x1874741493414528:12345-0@lo:104: 00010000:00010000:1.0:1787893244.889467:0:17166:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c000/0x9232577658cf1db7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf1dbe expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893244.889599:0:17166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787893244.889606:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe349880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13b37fca-0eda-4b14-a6ef-4a378c945d17+3:17199:x1874741493414528:12345-0@lo:104: Request processed in 160us (4431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893244.889613:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787893244.889723:0:17199:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe348380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17199:1874741493414528:0@lo:104: 00010000:00010000:2.0:1787893244.889747:0:17199:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fc9c147cc00/0x9232577658cf1def lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893244.890230:0:17172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787893244.890238:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c000/0x9232577658cf1db7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf1dbe expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893244.890248:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c147c000 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:3.0:1787893244.890252:0:17172:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c000/0x9232577658cf1db7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf1dbe expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893244.890263:0:17172:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c000/0x9232577658cf1db7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf1dbe expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787893244.890272:0:17172:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c000/0x9232577658cf1db7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf1dbe expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787893244.890278:0:17172:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787893244.890335:0:17172:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c000/0x9232577658cf1db7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf1dbe expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893244.890342:0:17172:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787893244.890374:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c000/0x9232577658cf1db7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf1dbe expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893244.890381:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c000/0x9232577658cf1db7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf1dbe expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893244.890542:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787893244.890555:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13b37fca-0eda-4b14-a6ef-4a378c945d17:3633:1874741493414656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787893244.890601:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787893244.890928:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893244.890931:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893244.890933:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893244.891567:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493414656 00000100:00100000:0.0:1787893244.891575:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493414656 00010000:00010000:0.0:1787893244.891615:0:17168:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9fe540200/0x9232577658cf1dbe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf1db7 expref: 12 pid: 17175 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893244.891646:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787893244.891654:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13b37fca-0eda-4b14-a6ef-4a378c945d17+12:3633:x1874741493414656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787893244.891666:0:17168:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893244.891671:0:17168:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9fe540200/0x9232577658cf1dbe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf1db7 expref: 12 pid: 17175 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893244.891683:0:17168:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9fe540200/0x9232577658cf1dbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf1db7 expref: 12 pid: 17175 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893244.891698:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9fe540200/0x9232577658cf1dbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf1db7 expref: 12 pid: 17175 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893244.891716:0:17168:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fc9c147cc00/0x9232577658cf1def lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893244.891725:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9c147cc00/0x9232577658cf1def lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787893244.891747:0:17168:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006818748s 00010000:00010000:0.0:1787893244.891751:0:17168:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc9c147cc00/0x9232577658cf1def lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893244.891757:0:17168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc9c147cc00/0x9232577658cf1def lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893244.891765:0:17168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fc9c147cc00/0x9232577658cf1def lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893244.891779:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fc9c147cc00/0x9232577658cf1def lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893244.891791:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c147cc00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893244.891795:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fc9c147cc00/0x9232577658cf1def lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893244.891803:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fc9c147cc00/0x9232577658cf1def lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893244.891816:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fc9c147cc00/0x9232577658cf1def lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893244.891828:0:17168:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893244.891885:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13b37fca-0eda-4b14-a6ef-4a378c945d17+11:3633:x1874741493414656:12345-0@lo:103:ldlm_bl.0 Request processed in 231us (1283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893244.891894:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787893244.891933:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13b37fca-0eda-4b14-a6ef-4a378c945d17:3633:1874741493414656:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787893244.893721:0:17199:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fc9c147cc00/0x9232577658cf1def lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893244.893737:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fc9c147cc00/0x9232577658cf1def lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893244.893744:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9c147cc00/0x9232577658cf1def lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787893244.902450:0:17162:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1787893244.902993:0:17162:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1787893244.903157:0:17222:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1787893244.903161:0:17222:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1787893244.904894:0:17223:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787893244.905264:0:17162:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1787893244.905596:0:17223:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787893244.909972:0:17223:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787893244.910055:0:17223:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00080000:1.0:1787893244.913609:0:17225:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9fc8c64b5180 x1874741493414784/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893244.913636:0:17225:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57000 going to sleep for 0 seconds 00000040:01000000:3.0:1787893244.916655:0:17162:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787893244.916708:0:17162:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787893244.917138:0:17162:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787893244.917147:0:17162:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787893244.917184:0:17162:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787893244.918162:0:17162:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787893244.918734:0:17162:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787893244.918767:0:17162:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1787893244.919880:0:17162:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:3.0:1787893244.920432:0:17162:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:3.0:1787893244.922062:0:17162:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1787893244.931383:0:17162:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787893244.931484:0:17162:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbaa0c16d7988 00100000:10000000:2.0:1787893244.931646:0:17162:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787893244.932561:0:17162:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787893244.932578:0:17162:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.135@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787893244.932600:0:17162:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:2.0:1787893244.932626:0:17162:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1787893244.937463:0:17162:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787893244.937791:0:17162:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787893245.427879:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787893245.681668:0:17180:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787893245.681676:0:17180:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc9d0f72800 from 7 10000000:01000000:1.0:1787893245.681681:0:17180:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787893245.681738:0:17180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540000/0x9232577658cf1df6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893245.681751:0:17180:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540000/0x9232577658cf1df6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893245.681763:0:17180:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540000/0x9232577658cf1df6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893245.681790:0:17180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493414912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787893245.681868:0:17180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893245.681929:0:17180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787893245.682186:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493414912 00000100:00100000:2.0:1787893245.682195:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493414912 00000100:00100000:2.0:1787893245.682265:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787893245.682275:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+11:17180:x1874741493414912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787893245.682288:0:17177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893245.682304:0:17177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9c147ca00/0x9232577658cf1dfd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf1df6 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893245.682331:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9c147ca00/0x9232577658cf1dfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf1df6 expref: 12 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893245.682341:0:17177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9c147ca00/0x9232577658cf1dfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf1df6 expref: 12 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893245.682351:0:17177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9c147ca00, rc 0) 00000100:00100000:2.0:1787893245.682398:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+12:17180:x1874741493414912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893245.682417:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787893245.682701:0:17180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493414912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787893245.682718:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540000/0x9232577658cf1df6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1dfd expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893245.682727:0:17180:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540000/0x9232577658cf1df6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf1dfd expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893245.682784:0:17180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493415040:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787893245.682831:0:17180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893245.682850:0:17180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c3aa9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787893245.682909:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493415040 00000100:00100000:1.0:1787893245.682914:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493415040 00000100:00100000:1.0:1787893245.682961:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787893245.682969:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+12:17180:x1874741493415040:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787893245.682983:0:17175:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787893245.682999:0:17175:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787893245.683002:0:17175:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1787893245.683074:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+12:17180:x1874741493415040:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 106us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893245.683082:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787893245.684547:0:17180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493415040:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787893245.684616:0:17180:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787893245.684628:0:17180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540000/0x9232577658cf1df6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1dfd expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893245.684639:0:17180:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540000/0x9232577658cf1df6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1dfd expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893245.937720:0:17225:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57000 going to sleep for 0 seconds 00000040:00080000:2.0:1787893245.938963:0:17220:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787893245.938969:0:17220:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787893245.941162:0:17220:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1787893245.941177:0:17220:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787893246.449628:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787893246.961683:0:17220:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787893246.961692:0:17220:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787893246.961816:0:17220:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1787893246.961853:0:17220:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787893246.962021:0:17220:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00000100:00100000:0.0:1787893246.962120:0:17225:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57000 going to sleep for 0 seconds 00010000:00010000:0.0:1787893247.474312:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893247.987882:0:17225:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57000 going to sleep for 0 seconds 00010000:00010000:3.0:1787893248.497613:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893249.009591:0:17225:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57000 going to sleep for 0 seconds 00000001:02000400:1.0:1787893249.494176:0:17468:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg235-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787893249.526042:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893250.049648:0:17225:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57000 going to sleep for 0 seconds 00000100:00080000:1.0:1787893250.236787:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787893250.236795:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787893250.236798:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fc9e5eaf000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787893250.236807:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 488 00000100:00080000:1.0:1787893250.236812:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787893250.236819:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9fc9e5eaf000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:1.0:1787893250.236840:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c64b7100 x1874741493415296/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787893250.236856:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787893250.236859:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787893250.236862:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787893250.236865:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787893250.236868:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787893250.236870:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787893250.236872:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7760000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787893250.236877:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9fc8c7760000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:1.0:1787893250.236887:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c64b5500 x1874741493415424/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787893250.236931:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13b37fca-0eda-4b14-a6ef-4a378c945d17:3633:1874741493415168:0@lo:400:kworker.0 00000100:00100000:1.0:1787893250.236995:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893250.237053:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493415296:0@lo:38:kworker.0 00000100:00100000:1.0:1787893250.237131:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893250.237149:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874741493415424:0@lo:38:kworker.0 00000100:00100000:1.0:1787893250.237184:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893250.237218:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493415168 00000100:00100000:1.0:1787893250.237224:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493415168 00000100:00100000:1.0:1787893250.237262:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787893250.237270:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+12:3633:x1874741493415168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893250.237310:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+12:3633:x1874741493415168:12345-0@lo:400:kworker.0 Request processed in 41us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893250.237316:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787893250.237350:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493415296 00000100:00100000:1.0:1787893250.237354:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493415296 00000100:00100000:1.0:1787893250.237380:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787893250.237385:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3629:x1874741493415296:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787893250.237399:0:17189:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787893250.239583:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13b37fca-0eda-4b14-a6ef-4a378c945d17:3633:1874741493415168:0@lo:400:kworker.0 00000100:00100000:0.0:1787893250.240230:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493415424 00000100:00100000:0.0:1787893250.240239:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493415424 00000100:00100000:0.0:1787893250.240275:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787893250.240283:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3629:x1874741493415424:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787893250.240309:0:17185:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 494 last 0 00000020:00000080:0.0:1787893250.240345:0:17185:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9232577658cf1e04 00000004:00100000:0.0:1787893250.240361:0:17185:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787893250.240507:0:17185:0:(import.c:65:import_set_state_nolock()) ffff9fc9f6d34000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787893250.240595:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1874741493415424:12345-0@lo:38:kworker.0 Request processed in 311us (3409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893250.240603:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787893250.243024:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fc8c64b5500 x1874741493415424/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787893260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787893250.243057:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787893250.243065:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787893250.243069:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787893250.243072:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7760000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787893250.243079:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874741493415424:0@lo:38:kworker.0 00000100:00100000:1.0:1787893250.251263:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3629:x1874741493415296:12345-0@lo:38:kworker.0 Request processed in 13868us (14122us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787893250.251278:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787893250.256246:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9e5eaf000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787893250.256259:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787893250.256264:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493415296:0@lo:38:kworker.0 00000020:00000004:1.0:1787893250.324850:0:17520:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787893250.325048:0:17520:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787893250.549895:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893251.060092:0:17225:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57000 going to sleep for 0 seconds 00000020:00000004:0.0:1787893251.261988:0:17570:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787893251.262255:0:17570:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787893251.569772:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893252.081646:0:17225:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57000 going to sleep for 0 seconds 00010000:00010000:3.0:1787893252.594783:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893253.107516:0:17225:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57000 going to sleep for 0 seconds 00010000:00010000:1.0:1787893253.621975:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893254.129720:0:17225:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57000 going to sleep for 0 seconds 00000100:00100000:2.0:1787893254.324213:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787893244/real 1787893244] req@ffff9fc8c64b4700 x1874741493412352/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893254 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893254.324255:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc8c64b4700 x1874741493412352/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893254 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893254.324267:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787893244/real 1787893244] req@ffff9fc8c8506680 x1874741493412224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893254 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893254.324280:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc8c8506680 x1874741493412224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893254 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787893254.324298:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9e5eaa000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787893254.324310:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787893254.324315:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493412352:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787893254.324320:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9d24d5000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787893254.324325:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787893254.324340:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493412224:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787893254.324401:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787893254.324405:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787893254.324408:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fc9e5eaf000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787893254.324413:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 494 00000100:00080000:2.0:1787893254.324418:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787893254.324424:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9fc9e5eaf000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:2.0:1787893254.324441:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9fe34b100 x1874741493415680/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787893254.324451:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787893254.324454:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787893254.324456:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fc9d24d5000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787893254.324458:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 488 00000100:00080000:2.0:1787893254.324461:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787893254.324464:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fc9d24d5000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:2.0:1787893254.324474:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9fe34b800 x1874741493415808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787893254.324483:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787893254.324486:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787893254.324488:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fc9e5eaa000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787893254.324506:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 488 00000100:00080000:2.0:1787893254.324508:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787893254.324511:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fc9e5eaa000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:2.0:1787893254.324521:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9fe34ad80 x1874741493415936/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787893254.324576:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe348700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1874741493416064:0@lo:400:kworker.0 00000100:00100000:2.0:1787893254.324632:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893254.324675:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787893254.324680:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe348380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13b37fca-0eda-4b14-a6ef-4a378c945d17:3631:1874741493415552:0@lo:400:kworker.0 00000100:00100000:2.0:1787893254.324705:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893254.324732:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe34b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493415680:0@lo:38:kworker.0 00000100:00100000:2.0:1787893254.324757:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893254.324772:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe34b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493415808:0@lo:8:kworker.0 00000400:00000100:2.0:1787893254.324790:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874741493415808 offset 0 length 520: 4 00000100:00100000:2.0:1787893254.324799:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe34ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493415936:0@lo:8:kworker.0 00000400:00000100:2.0:1787893254.324815:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874741493415936 offset 0 length 520: 4 00000100:00100000:2.0:1787893254.324845:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493416064 00000100:00100000:2.0:1787893254.324851:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493416064 00000100:00100000:2.0:1787893254.324905:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787893254.324914:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe348000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1874741493416064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893254.324960:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe348000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1874741493416064:12345-0@lo:400:kworker.0 Request processed in 48us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893254.326069:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787893254.326100:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493415552 00000100:00100000:2.0:1787893254.326105:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493415552 00000100:00100000:2.0:1787893254.326136:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787893254.326143:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+12:3631:x1874741493415552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893254.326191:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+12:3631:x1874741493415552:12345-0@lo:400:kworker.0 Request processed in 48us (1485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893254.326206:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787893254.326235:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493415680 00000100:00100000:2.0:1787893254.326239:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493415680 00000100:00100000:2.0:1787893254.326258:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787893254.326263:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe34bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3629:x1874741493415680:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787893254.326279:0:17188:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787893254.330753:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe348380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13b37fca-0eda-4b14-a6ef-4a378c945d17:3631:1874741493415552:0@lo:400:kworker.0 00010000:00080000:3.0:1787893254.330782:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fc9fe348700 x1874741493416064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893254.330795:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe348700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1874741493416064:0@lo:400:kworker.0 00000100:00100000:3.0:1787893254.352392:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe34bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3629:x1874741493415680:12345-0@lo:38:kworker.0 Request processed in 26118us (27625us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787893254.352412:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787893254.353106:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9e5eaf000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787893254.353114:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787893254.353119:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe34b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493415680:0@lo:38:kworker.0 00010000:00010000:0.0:1787893254.643533:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893255.154025:0:17225:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57000 going to sleep for 0 seconds 00010000:00010000:3.0:1787893255.673757:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893256.177623:0:17225:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57000 going to sleep for 0 seconds 00000040:00080000:2.0:1787893256.180130:0:17220:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787893256.692015:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893257.212660:0:17225:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57000 going to sleep for 0 seconds 00010000:00010000:3.0:1787893257.717790:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893258.225620:0:17225:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57000 going to sleep for 0 seconds 00010000:00010000:0.0:1787893258.740769:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787893259.064706:0:17915:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787893259.064711:0:17915:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1787893259.064712:0:17915:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1787893259.064835:0:17915:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fc9ffb45000 00000020:01000004:1.0:1787893259.064851:0:17915:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1787893259.064868:0:17915:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787893259.064881:0:17915:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9fc9e735b370) 00000020:00000080:1.0:1787893259.064897:0:17915:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787893259.133193:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787893259.134117:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1787893259.135698:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1787893259.135895:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1787893259.136541:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1787893259.136732:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1787893259.136967:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1787893259.137195:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1787893259.137611:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1787893259.137878:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1787893259.138072:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1787893259.138357:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1787893259.139043:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1787893259.139412:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1787893259.139699:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1787893259.139958:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1787893259.140408:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1787893259.140630:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1787893259.140841:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1787893259.141046:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1787893259.141312:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1787893259.141570:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1787893259.142115:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1787893259.142622:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1787893259.142927:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1787893259.143173:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1787893259.143523:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1787893259.143813:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1787893259.144043:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1787893259.144356:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1787893259.144585:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1787893259.144873:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1787893259.145076:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1787893259.145667:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1787893259.146411:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1787893259.146684:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1787893259.146982:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1787893259.147228:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1787893259.147552:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1787893259.147799:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1787893259.148354:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787893259.148736:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1787893259.148958:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787893259.149143:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787893259.149732:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787893259.150025:0:17915:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00080000:01000000:2.0:1787893259.152041:0:17915:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787893259.154461:0:17915:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1787893259.154479:0:17915:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787893259.154520:0:17915:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9232577658cf1e12 00000020:01000004:2.0:1787893259.154529:0:17915:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1787893259.154554:0:17915:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.135@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787893259.154558:0:17915:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.135@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787893259.154564:0:17915:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1787893259.154595:0:17915:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1787893259.154599:0:17915:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.135@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1787893259.173556:0:17915:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.135@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787893259.173598:0:17915:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.135@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1787893259.173603:0:17915:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787893259.173604:0:17915:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787893259.173606:0:17915:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787893259.173607:0:17915:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787893259.173608:0:17915:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787893259.173609:0:17915:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787893259.173611:0:17915:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787893259.173613:0:17915:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787893259.173614:0:17915:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787893259.173619:0:17915:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1787893259.173621:0:17915:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787893259.173622:0:17915:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787893259.173624:0:17915:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787893259.173630:0:17915:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787893259.173631:0:17915:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787893259.173632:0:17915:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787893259.173633:0:17915:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787893259.173634:0:17915:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787893259.173635:0:17915:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787893259.173662:0:17915:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1787893259.173684:0:17915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493416192:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787893259.173759:0:17915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893259.173807:0:17915:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c70b8840 going to sleep for 11 seconds 00000100:00100000:2.0:1787893259.174401:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493416192 00000100:00100000:2.0:1787893259.174412:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493416192 00000100:00100000:2.0:1787893259.174474:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787893259.174484:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+12:17915:x1874741493416192:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787893259.174538:0:17175:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787893259.174541:0:17175:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1787893259.174548:0:17175:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1787893259.174867:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+12:17915:x1874741493416192:12345-0@lo:253:mount.lustre.0 Request processed in 384us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893259.174876:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787893259.174974:0:17915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493416192:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787893259.174987:0:17915:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1787893259.174989:0:17915:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787893259.174991:0:17915:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787893259.174992:0:17915:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787893259.174993:0:17915:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787893259.174995:0:17915:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787893259.174996:0:17915:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787893259.174997:0:17915:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787893259.174999:0:17915:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787893259.175000:0:17915:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787893259.175020:0:17915:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fc9ffb45000 from lustre-MDT0001 10000000:01000000:1.0:1787893259.175073:0:17915:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1787893259.175076:0:17915:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1787893259.175084:0:17915:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fc8c7730000 local copy 00010000:00010000:1.0:1787893259.175096:0:17915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c800/0x9232577658cf1d08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1d0f expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893259.175189:0:17915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493416320:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787893259.175224:0:17915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893259.175269:0:17915:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9f3e756c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787893259.175488:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493416320 00000100:00100000:2.0:1787893259.175523:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493416320 00000100:00100000:2.0:1787893259.175552:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787893259.175560:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+12:17915:x1874741493416320:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787893259.175637:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+12:17915:x1874741493416320:12345-0@lo:501:mount.lustre.0 Request processed in 78us (413us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787893259.175644:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787893259.175768:0:17915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493416320:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787893259.175784:0:17915:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.135@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787893259.175805:0:17915:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.135@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787893259.175812:0:17915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c800/0x9232577658cf1d08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1d0f expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.175821:0:17915:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c800/0x9232577658cf1d08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1d0f expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787893259.175857:0:17915:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fc9ffb45000 10000000:01000000:3.0:1787893259.175868:0:17915:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787893259.175873:0:17915:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9fc8c7730000 10000000:01000000:3.0:1787893259.175875:0:17915:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787893259.175879:0:17915:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9fc8c7730000 from 1 10000000:01000000:3.0:1787893259.175882:0:17915:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787893259.175907:0:17915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f7800/0x9232577658cf1e19 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.175916:0:17915:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f7800/0x9232577658cf1e19 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.175925:0:17915:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f7800/0x9232577658cf1e19 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893259.175939:0:17915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8505c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493416448:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787893259.175967:0:17915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893259.175996:0:17915:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c6696900 going to sleep for 11 seconds 00000100:00100000:2.0:1787893259.176049:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493416448 00000100:00100000:2.0:1787893259.176053:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493416448 00000100:00100000:2.0:1787893259.176126:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787893259.176134:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+12:17915:x1874741493416448:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787893259.176144:0:17178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893259.176158:0:17178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9c147c000/0x9232577658cf1e20 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf1e19 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893259.176180:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9c147c000/0x9232577658cf1e20 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf1e19 expref: 13 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893259.176204:0:17178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9c147c000/0x9232577658cf1e20 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf1e19 expref: 13 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893259.176214:0:17178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9c147c000, rc 0) 00000100:00100000:2.0:1787893259.176252:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+13:17915:x1874741493416448:12345-0@lo:101:mount.lustre.0 Request processed in 119us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893259.176259:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787893259.176331:0:17915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8505c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493416448:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787893259.176345:0:17915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f7800/0x9232577658cf1e19 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1e20 expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.176354:0:17915:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f7800/0x9232577658cf1e19 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf1e20 expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787893259.176368:0:17915:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787893259.176381:0:17915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f7800/0x9232577658cf1e19 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1e20 expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.176388:0:17915:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f7800/0x9232577658cf1e19 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1e20 expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787893259.176406:0:17915:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9fc9ffb45000 10000000:01000000:3.0:1787893259.176417:0:17915:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787893259.176421:0:17915:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9fc9ffb45000 from 1 10000000:01000000:3.0:1787893259.176423:0:17915:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787893259.176437:0:17915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6600/0x9232577658cf1e27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.176444:0:17915:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6600/0x9232577658cf1e27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.176451:0:17915:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6600/0x9232577658cf1e27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893259.176463:0:17915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8505c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493416576:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787893259.176518:0:17915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893259.194968:0:17915:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c6696900 going to sleep for 11 seconds 00000100:00100000:1.0:1787893259.196379:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493416576 00000100:00100000:1.0:1787893259.196395:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493416576 00000100:00100000:1.0:1787893259.196460:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787893259.196470:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+13:17915:x1874741493416576:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787893259.196488:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893259.196531:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9fe541a00/0x9232577658cf1e2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf1e27 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893259.196582:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9fe541a00/0x9232577658cf1e2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf1e27 expref: 14 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893259.196594:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9fe541a00/0x9232577658cf1e2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf1e27 expref: 14 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893259.196602:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe541a00, rc 0) 00000100:00100000:1.0:1787893259.196670:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+14:17915:x1874741493416576:12345-0@lo:101:mount.lustre.0 Request processed in 201us (20180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893259.196677:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787893259.197063:0:17915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8505c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493416576:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787893259.197088:0:17915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6600/0x9232577658cf1e27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1e2e expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.197098:0:17915:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6600/0x9232577658cf1e27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf1e2e expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787893259.197115:0:17915:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787893259.197137:0:17915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6600/0x9232577658cf1e27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1e2e expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.197144:0:17915:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6600/0x9232577658cf1e27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1e2e expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787893259.197160:0:17915:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1787893259.197165:0:17915:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787893259.197171:0:17915:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9fc9ffb45000 10000000:01000000:3.0:1787893259.197174:0:17915:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787893259.197177:0:17915:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1787893259.197180:0:17915:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1787893259.197205:0:17915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f7a00/0x9232577658cf1e35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.197212:0:17915:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f7a00/0x9232577658cf1e35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.197220:0:17915:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f7a00/0x9232577658cf1e35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893259.197238:0:17915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8505c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493416704:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787893259.197276:0:17915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893259.197301:0:17915:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c6696900 going to sleep for 11 seconds 00000100:00100000:2.0:1787893259.197559:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493416704 00000100:00100000:2.0:1787893259.197565:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493416704 00000100:00100000:2.0:1787893259.197600:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787893259.197609:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+14:17915:x1874741493416704:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787893259.197618:0:17178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893259.197628:0:17178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9c147d200/0x9232577658cf1e3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf1e35 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893259.197644:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9c147d200/0x9232577658cf1e3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf1e35 expref: 15 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893259.197654:0:17178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9c147d200/0x9232577658cf1e3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf1e35 expref: 15 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893259.197661:0:17178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9c147d200, rc 0) 00000100:00100000:2.0:1787893259.197693:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+15:17915:x1874741493416704:12345-0@lo:101:mount.lustre.0 Request processed in 85us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893259.197699:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787893259.198066:0:17915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8505c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493416704:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787893259.198079:0:17915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f7a00/0x9232577658cf1e35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1e3c expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.198087:0:17915:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f7a00/0x9232577658cf1e35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf1e3c expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787893259.203400:0:17915:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:3.0:1787893259.204229:0:17915:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787893259.210426:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787893259.210548:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1787893259.210568:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1787893259.210582:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1787893259.210596:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:3.0:1787893259.210610:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:3.0:1787893259.210625:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:3.0:1787893259.210640:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1787893259.210656:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1787893259.210670:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:3.0:1787893259.210683:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:3.0:1787893259.210695:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:3.0:1787893259.210709:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:3.0:1787893259.210722:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1787893259.210738:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1787893259.210750:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:3.0:1787893259.210763:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1787893259.210777:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1787893259.210791:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:3.0:1787893259.210805:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1787893259.210850:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1787893259.210870:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1787893259.210885:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1787893259.210915:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:3.0:1787893259.210922:0:17915:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1787893259.211032:0:17915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8505c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493416832:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787893259.211107:0:17915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893259.211696:0:17915:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c66966c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787893259.215444:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493416832 00000100:00100000:2.0:1787893259.215459:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493416832 00000100:00100000:2.0:1787893259.215549:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787893259.215560:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+15:17915:x1874741493416832:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787893259.215777:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+15:17915:x1874741493416832:12345-0@lo:501:mount.lustre.0 Request processed in 218us (4670us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893259.215786:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787893259.215992:0:17915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8505c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493416832:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787893259.216041:0:17915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8505c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493416960:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787893259.216090:0:17915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893259.216140:0:17915:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c66966c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787893259.216596:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493416960 00000100:00100000:1.0:1787893259.216603:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493416960 00000100:00100000:1.0:1787893259.216647:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787893259.216656:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+15:17915:x1874741493416960:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787893259.217684:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+15:17915:x1874741493416960:12345-0@lo:503:mount.lustre.0 Request processed in 1025us (1590us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893259.217695:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787893259.217818:0:17915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8505c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493416960:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787893259.218402:0:17915:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787893259.218479:0:17915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8505c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493417088:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787893259.218578:0:17915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893259.218669:0:17915:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c6696900 going to sleep for 11 seconds 00000100:00100000:0.0:1787893259.223465:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493417088 00000100:00100000:0.0:1787893259.223480:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493417088 00000100:00100000:0.0:1787893259.223571:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787893259.223583:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+15:17915:x1874741493417088:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787893259.224365:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+15:17915:x1874741493417088:12345-0@lo:502:mount.lustre.0 Request processed in 781us (5783us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893259.224374:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787893259.224620:0:17915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8505c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493417088:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787893259.224856:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787893259.224893:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:3.0:1787893259.224908:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:3.0:1787893259.224921:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:3.0:1787893259.224933:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:3.0:1787893259.224945:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:3.0:1787893259.224960:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:3.0:1787893259.224974:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:3.0:1787893259.224989:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:3.0:1787893259.225001:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:3.0:1787893259.225031:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:3.0:1787893259.225048:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:3.0:1787893259.225062:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:3.0:1787893259.225075:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:3.0:1787893259.225088:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:3.0:1787893259.225100:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:3.0:1787893259.225111:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:3.0:1787893259.225124:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:3.0:1787893259.225136:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:3.0:1787893259.225150:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:3.0:1787893259.225164:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:3.0:1787893259.225176:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:3.0:1787893259.225187:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:3.0:1787893259.225210:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:3.0:1787893259.225223:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:3.0:1787893259.225237:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:3.0:1787893259.225263:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:3.0:1787893259.225348:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:3.0:1787893259.225369:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:3.0:1787893259.225383:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:3.0:1787893259.225395:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:3.0:1787893259.225409:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:3.0:1787893259.225423:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:3.0:1787893259.225436:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:3.0:1787893259.225449:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:3.0:1787893259.225463:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:3.0:1787893259.225478:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:3.0:1787893259.225534:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:3.0:1787893259.225552:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:3.0:1787893259.225567:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:3.0:1787893259.225584:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:3.0:1787893259.225598:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:3.0:1787893259.225624:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:3.0:1787893259.225640:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:3.0:1787893259.225682:0:17915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8505c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493417216:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787893259.225738:0:17915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893259.225771:0:17915:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c6696900 going to sleep for 11 seconds 00000100:00100000:1.0:1787893259.225900:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493417216 00000100:00100000:1.0:1787893259.225907:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493417216 00000100:00100000:1.0:1787893259.225960:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787893259.225971:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+15:17915:x1874741493417216:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787893259.226083:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+15:17915:x1874741493417216:12345-0@lo:502:mount.lustre.0 Request processed in 114us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893259.226090:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787893259.226385:0:17915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8505c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493417216:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787893259.226432:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:3.0:1787893259.226442:0:17915:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1787893259.232373:0:17919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787893259.232390:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893259.232392:0:17919:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1787893259.232399:0:17919:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1787893259.232402:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787893259.232418:0:17919:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9fc9fd33b370) 00000020:00000080:2.0:1787893259.232439:0:17919:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1787893259.232446:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787893259.232571:0:17919:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787893259.232580:0:17919:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9232577658cf1e4a 00000020:00000080:2.0:1787893259.232793:0:17919:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1787893259.232797:0:17919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787893259.232801:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893259.232802:0:17919:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1787893259.232805:0:17919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787893259.232809:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893259.232810:0:17919:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1787893259.232813:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787893259.232820:0:17919:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9fc9fd338000) 00000020:00000080:2.0:1787893259.232841:0:17919:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1787893259.232845:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787893259.232847:0:17919:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1787893259.232850:0:17919:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1787893259.232855:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787893259.232914:0:17919:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc9ffb45000 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1787893259.232925:0:17919:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9fc9fd3399b8) 00000020:00000080:2.0:1787893259.232938:0:17919:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1787893259.232981:0:17919:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787893259.232985:0:17919:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9232577658cf1e5f 00000020:00000080:2.0:1787893259.233067:0:17919:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1787893259.233073:0:17919:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787893259.233076:0:17919:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x9232577658cf1e66 00080000:01000000:2.0:1787893259.233081:0:17919:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787893259.233084:0:17919:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9232577658cf1e6d 00000100:00100000:1.0:1787893259.249810:0:17225:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57000 going to sleep for 0 seconds 00010000:00010000:2.0:1787893259.369652:0:17919:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1787893259.371655:0:17919:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1787893259.372451:0:17919:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787893259.382217:0:17919:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1787893259.382232:0:17919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787893259.382241:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893259.382243:0:17919:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1787893259.382255:0:17919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787893259.382263:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893259.382265:0:17919:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1787893259.382269:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787893259.382275:0:17919:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.135@tcp to nid 0x20000c0a8ca87 (192.168.202.135@tcp) 00000020:00000080:3.0:1787893259.382321:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787893259.382339:0:17919:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9fc9fe143370) 00000020:00000080:3.0:1787893259.382362:0:17919:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1787893259.382368:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787893259.382457:0:17919:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1787893259.382465:0:17919:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787893259.382472:0:17919:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9232577658cf1e7b 00010000:00080000:3.0:1787893259.382530:0:17919:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc8c7741000@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.135@tcp at head 00010000:00010000:3.0:1787893259.384217:0:17919:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1787893259.389916:0:17919:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787893259.389935:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1787893259.389976:0:17919:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787893259.390001:0:17919:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9232577658cf1e82 00000100:00080000:2.0:1787893259.390012:0:17919:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787893259.390018:0:17919:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9fc8c7741000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:2.0:1787893259.390062:0:17919:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9fe34b100 x1874741493417344/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787893259.390095:0:17919:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1787893259.390156:0:17919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787893259.390161:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893259.390163:0:17919:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1787893259.390166:0:17919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787893259.390180:0:17919:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1787893259.390182:0:17919:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787893259.390184:0:17919:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787893259.390185:0:17919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787893259.390189:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893259.390190:0:17919:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787893259.390193:0:17919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787893259.390204:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893259.390206:0:17919:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1787893259.390210:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787893259.390247:0:17919:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787893259.390262:0:17919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787893259.390265:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893259.390266:0:17919:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1787893259.390269:0:17919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787893259.390271:0:17919:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:2.0:1787893259.390272:0:17919:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787893259.390274:0:17919:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787893259.390276:0:17919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787893259.390278:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893259.390279:0:17919:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787893259.390282:0:17919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787893259.390285:0:17919:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1787893259.390289:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893259.390290:0:17919:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787893259.390293:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787893259.390296:0:17919:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.135@tcp to nid 0x20000c0a8ca87 (192.168.202.135@tcp) 00000020:01000000:2.0:1787893259.390324:0:17919:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1787893259.390326:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787893259.390338:0:17919:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9fc9fd33cd28) 00000020:00000080:2.0:1787893259.390349:0:17919:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1787893259.390354:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787893259.390412:0:17919:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1787893259.390419:0:17919:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787893259.390425:0:17919:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9232577658cf1e90 00010000:00080000:2.0:1787893259.390458:0:17919:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc9c3ea8000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.135@tcp at head 00010000:00010000:2.0:1787893259.390729:0:17919:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:0.0:1787893259.391395:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787893259.391401:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787893259.391405:0:37:0:(import.c:65:import_set_state_nolock()) ffff9fc9e5eaf000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787893259.391410:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 498 00000100:00080000:0.0:1787893259.391415:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787893259.391420:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9fc9e5eaf000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:0.0:1787893259.391444:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c7ce0380 x1874741493417472/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787893259.391458:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787893259.391461:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787893259.391464:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787893259.391473:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787893259.391557:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787893259.391572:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874741493417600:0@lo:400:kworker.0 00000100:00100000:0.0:1787893259.391638:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893259.391709:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493417600 00000100:00100000:0.0:1787893259.391716:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493417600 00000100:00100000:0.0:1787893259.391763:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787893259.391772:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1874741493417600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893259.391833:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1874741493417600:12345-0@lo:400:kworker.0 Request processed in 51us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893259.391841:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787893259.391876:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fc8c7ce0000 x1874741493417600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893259.391889:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874741493417600:0@lo:400:kworker.0 00000100:00100000:3.0:1787893259.391990:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe34b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493417344:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787893259.392028:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893259.392063:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493417472:0@lo:38:kworker.0 00000100:00100000:3.0:1787893259.392085:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893259.392116:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493417344 00000100:00100000:3.0:1787893259.392120:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493417344 00000100:00100000:3.0:1787893259.392134:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493417472 00000100:00100000:3.0:1787893259.392137:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493417472 00000100:00100000:3.0:1787893259.392165:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787893259.392186:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8505c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3629:x1874741493417344:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787893259.392207:0:17188:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 503 last 0 00000020:00000080:3.0:1787893259.392237:0:17188:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9232577658cf1e97 00000004:00100000:3.0:1787893259.392253:0:17188:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1787893259.392258:0:17188:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000040:01000000:3.0:1787893259.393784:0:17919:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787893259.394109:0:17919:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:3.0:1787893259.403004:0:17188:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7d07800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787893259.403110:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8505c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3629:x1874741493417344:12345-0@lo:38:llog_process_th.0 Request processed in 10920us (11077us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893259.403121:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787893259.403149:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787893259.403156:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3629:x1874741493417472:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1787893259.403199:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3629:x1874741493417472:12345-0@lo:38:kworker.0 Request processed in 42us (11112us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787893259.403205:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787893259.403301:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787893259.403311:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1787893259.403326:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1787893259.403331:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787893259.403334:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7741000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787893259.403354:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe34b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493417344:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787893259.403370:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787893259.403374:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9e5eaf000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787893259.403378:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787893259.403381:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493417472:0@lo:38:kworker.0 00000100:00100000:2.0:1787893259.404261:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787893259.404288:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493417728:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787893259.404339:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893259.404468:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493417728 00000100:00100000:3.0:1787893259.404475:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493417728 00000100:00100000:3.0:1787893259.404552:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787893259.404562:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe34b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3632:x1874741493417728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787893259.404593:0:17189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787893259.404636:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe34b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3632:x1874741493417728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893259.404644:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787893259.405241:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493417728:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1787893259.405939:0:17919:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787893259.406564:0:17919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1787893259.406705:0:17919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:3.0:1787893259.407640:0:17924:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787893259.407645:0:17924:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787893259.408397:0:17919:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787893259.408412:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787893259.408452:0:17919:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787893259.408475:0:17919:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9232577658cf1e9e 00000100:00080000:0.0:1787893259.408485:0:17919:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787893259.408516:0:17919:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9fc9c3ea8000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:0.0:1787893259.408569:0:17919:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c7ce0000 x1874741493417856/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787893259.408640:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493417856:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787893259.408709:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874741493417856 offset 0 length 520: 4 00000100:00080000:0.0:1787893259.408770:0:17919:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787893259.408846:0:17919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787893259.408851:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893259.408854:0:17919:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787893259.408865:0:17919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787893259.408869:0:17919:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1787893259.408870:0:17919:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787893259.408872:0:17919:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787893259.408874:0:17919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787893259.408877:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893259.408878:0:17919:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787893259.408881:0:17919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787893259.408885:0:17919:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1787893259.408888:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893259.408890:0:17919:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787893259.408893:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787893259.408896:0:17919:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.135@tcp to nid 0x20000c0a8ca87 (192.168.202.135@tcp) 00000020:01000000:0.0:1787893259.408921:0:17919:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1787893259.408924:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787893259.408937:0:17919:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9fc8c71b99b8) 00000020:00000080:0.0:1787893259.408952:0:17919:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1787893259.408958:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787893259.409020:0:17919:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1787893259.409028:0:17919:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787893259.409034:0:17919:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9232577658cf1eac 00010000:00080000:0.0:1787893259.409065:0:17919:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc9d29e9000@lustre-OST0001-osc-MDT0001: add connection 192.168.202.135@tcp at head 00010000:00010000:0.0:1787893259.409276:0:17919:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1787893259.409365:0:17919:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787893259.409380:0:17919:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:3.0:1787893259.410628:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787893259.410637:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787893259.410639:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787893259.410642:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1787893259.414428:0:17919:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787893259.416992:0:17919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1787893259.421288:0:17919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1787893259.422195:0:17926:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787893259.422205:0:17926:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787893259.423081:0:17919:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787893259.423094:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787893259.423135:0:17919:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787893259.423160:0:17919:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9232577658cf1eb3 00000100:00080000:2.0:1787893259.423184:0:17919:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787893259.423191:0:17919:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9fc9d29e9000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:2.0:1787893259.423229:0:17919:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9fe34b480 x1874741493417984/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787893259.423258:0:17919:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787893259.423327:0:17919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787893259.423332:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893259.423340:0:17919:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787893259.423345:0:17919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787893259.423349:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893259.423351:0:17919:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787893259.423353:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787893259.423355:0:17919:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787893259.423357:0:17919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787893259.423360:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893259.423361:0:17919:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787893259.423363:0:17919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787893259.423365:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893259.423366:0:17919:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787893259.423370:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787893259.423393:0:17919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787893259.423396:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893259.423397:0:17919:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787893259.423401:0:17919:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:2.0:1787893259.423462:0:17915:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1787893259.423520:0:17915:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787893259.423536:0:17915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f7a00/0x9232577658cf1e35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1e3c expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893259.423546:0:17915:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f7a00/0x9232577658cf1e35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1e3c expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893259.423555:0:17915:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc9ffb45000 from 1 10000000:01000000:2.0:1787893259.423558:0:17915:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787893259.423585:0:17915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147dc00/0x9232577658cf1eba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893259.423592:0:17915:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9c147dc00/0x9232577658cf1eba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893259.423614:0:17915:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9c147dc00/0x9232577658cf1eba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893259.423634:0:17915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe349500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493418112:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787893259.423699:0:17915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893259.423733:0:17915:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d29e3000 going to sleep for 11 seconds 00000100:00100000:2.0:1787893259.423759:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493418112 00000100:00100000:2.0:1787893259.423766:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493418112 00000100:00100000:2.0:1787893259.423806:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787893259.423816:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+15:17915:x1874741493418112:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787893259.423842:0:17178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893259.423869:0:17178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9c4152400/0x9232577658cf1ec1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf1eba expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893259.423894:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9c4152400/0x9232577658cf1ec1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf1eba expref: 16 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893259.423904:0:17178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9c4152400/0x9232577658cf1ec1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf1eba expref: 16 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893259.423914:0:17178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9c4152400, rc 0) 00000100:00100000:2.0:1787893259.423950:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+16:17915:x1874741493418112:12345-0@lo:101:mount.lustre.0 Request processed in 135us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893259.423957:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787893259.424005:0:17915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe349500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493418112:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787893259.424018:0:17915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9c147dc00/0x9232577658cf1eba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1ec1 expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893259.424033:0:17915:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9c147dc00/0x9232577658cf1eba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf1ec1 expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893259.424600:0:17915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe349500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493418240:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787893259.424636:0:17915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893259.424661:0:17915:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d29e3000 going to sleep for 11 seconds 00000100:00100000:2.0:1787893259.424680:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493418240 00000100:00100000:2.0:1787893259.424684:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493418240 00000100:00100000:2.0:1787893259.424711:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787893259.424719:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+16:17915:x1874741493418240:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787893259.424733:0:17177:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787893259.424806:0:17177:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787893259.424810:0:17177:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1787893259.424899:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+16:17915:x1874741493418240:12345-0@lo:256:mount.lustre.0 Request processed in 180us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893259.424907:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787893259.424942:0:17915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe349500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493418240:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787893259.425554:0:17915:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787893259.425570:0:17915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147dc00/0x9232577658cf1eba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1ec1 expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893259.425579:0:17915:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9c147dc00/0x9232577658cf1eba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1ec1 expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893259.425589:0:17915:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc9ffb45000 from 1 10000000:01000000:2.0:1787893259.425592:0:17915:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787893259.425622:0:17915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153e00/0x9232577658cf1ec8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893259.425630:0:17915:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153e00/0x9232577658cf1ec8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893259.425639:0:17915:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153e00/0x9232577658cf1ec8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893259.425653:0:17915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe349500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493418368:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787893259.425685:0:17915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893259.425707:0:17915:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c2f53600 going to sleep for 11 seconds 00000100:00100000:2.0:1787893259.425725:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493418368 00000100:00100000:2.0:1787893259.425729:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493418368 00000100:00100000:2.0:1787893259.425756:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787893259.425763:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+16:17915:x1874741493418368:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787893259.425771:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893259.425782:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9c4153c00/0x9232577658cf1ecf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf1ec8 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893259.425801:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9c4153c00/0x9232577658cf1ecf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf1ec8 expref: 17 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893259.425810:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9c4153c00/0x9232577658cf1ecf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf1ec8 expref: 17 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893259.425818:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9c4153c00, rc 0) 00000100:00080000:0.0:1787893259.428415:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787893259.428426:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787893259.428430:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787893259.428451:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787893259.428553:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe34b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493417984:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787893259.428619:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874741493417984 offset 0 length 520: 4 00000100:00100000:2.0:1787893259.429364:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+17:17915:x1874741493418368:12345-0@lo:101:mount.lustre.0 Request processed in 3597us (3674us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893259.429375:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787893259.429733:0:17915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe349500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493418368:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787893259.429759:0:17915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153e00/0x9232577658cf1ec8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1ecf expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893259.429771:0:17915:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153e00/0x9232577658cf1ec8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf1ecf expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787893259.429918:0:17915:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787893259.429963:0:17915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493418496:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787893259.430000:0:17915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893259.430035:0:17915:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d29e0840 going to sleep for 11 seconds 00000100:00100000:2.0:1787893259.430090:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493418496 00000100:00100000:2.0:1787893259.430097:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493418496 00000100:00100000:2.0:1787893259.430140:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787893259.430150:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd285c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+17:17915:x1874741493418496:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787893259.430408:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd285c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+17:17915:x1874741493418496:12345-0@lo:501:mount.lustre.0 Request processed in 259us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893259.430417:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787893259.434671:0:17915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493418496:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787893259.434741:0:17915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8505500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493418624:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787893259.434819:0:17915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893259.434869:0:17915:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d1c359c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787893259.435619:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493418624 00000100:00100000:0.0:1787893259.435628:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493418624 00000100:00100000:0.0:1787893259.435685:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787893259.435695:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd286450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+17:17915:x1874741493418624:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787893259.435837:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd286450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+17:17915:x1874741493418624:12345-0@lo:503:mount.lustre.0 Request processed in 143us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893259.435845:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787893259.435960:0:17915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8505500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493418624:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787893259.436352:0:17915:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787893259.436424:0:17915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493418752:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787893259.436466:0:17915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893259.436536:0:17915:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9f3e75300 going to sleep for 11 seconds 00000100:00100000:2.0:1787893259.436651:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493418752 00000100:00100000:2.0:1787893259.436657:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493418752 00000100:00100000:2.0:1787893259.436684:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787893259.436691:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd285450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+17:17915:x1874741493418752:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787893259.436781:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd285450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+17:17915:x1874741493418752:12345-0@lo:502:mount.lustre.0 Request processed in 90us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893259.436788:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787893259.437370:0:17915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493418752:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787893259.437630:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787893259.437674:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:1.0:1787893259.437691:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:1.0:1787893259.437703:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:1.0:1787893259.437716:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:1.0:1787893259.437728:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:1.0:1787893259.437739:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:1.0:1787893259.437750:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:1.0:1787893259.437763:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787893259.437775:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:1.0:1787893259.437787:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:1.0:1787893259.437812:0:17915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493418880:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787893259.437870:0:17915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893259.437901:0:17915:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d1c359c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787893259.437980:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493418880 00000100:00100000:2.0:1787893259.437985:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493418880 00000100:00100000:2.0:1787893259.438029:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787893259.438037:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd286850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+17:17915:x1874741493418880:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787893259.438129:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd286850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+17:17915:x1874741493418880:12345-0@lo:502:mount.lustre.0 Request processed in 91us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893259.438136:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787893259.443599:0:17915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493418880:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787893259.443729:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:1.0:1787893259.443744:0:17915:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1787893259.445594:0:17928:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787893259.445607:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893259.445609:0:17928:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787893259.445616:0:17928:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc9ffb45000 00000020:00000080:1.0:1787893259.445633:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787893259.445642:0:17928:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787893259.445645:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893259.445646:0:17928:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787893259.445649:0:17928:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787893259.445651:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893259.445653:0:17928:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787893259.445656:0:17928:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc9ffb45000 00000020:00000080:1.0:1787893259.445658:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787893259.445711:0:17928:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787893259.445715:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893259.445716:0:17928:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787893259.445718:0:17928:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787893259.445721:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893259.445722:0:17928:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787893259.445726:0:17928:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc9ffb45000 00000020:00000080:1.0:1787893259.445728:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787893259.445745:0:17928:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787893259.445748:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893259.445749:0:17928:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787893259.445752:0:17928:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787893259.445755:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893259.445756:0:17928:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787893259.445760:0:17928:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc9ffb45000 00000020:00000080:1.0:1787893259.445761:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787893259.445782:0:17928:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787893259.445785:0:17928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893259.445786:0:17928:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787893259.445789:0:17928:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:3.0:1787893259.445976:0:17915:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787893259.446013:0:17915:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787893259.446039:0:17915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153e00/0x9232577658cf1ec8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1ecf expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.446051:0:17915:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153e00/0x9232577658cf1ec8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1ecf expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787893259.446111:0:17915:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787893259.446115:0:17915:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fc9ffb45000 10000000:01000000:3.0:1787893259.446118:0:17915:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fc9ffb45000 10000000:01000000:3.0:1787893259.446122:0:17915:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787893259.446128:0:17915:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc9ffb45000 from 1 10000000:01000000:3.0:1787893259.446131:0:17915:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787893259.446178:0:17915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6e00/0x9232577658cf1ed6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.446188:0:17915:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6e00/0x9232577658cf1ed6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.446198:0:17915:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6e00/0x9232577658cf1ed6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893259.446236:0:17915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8507480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493419008:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787893259.446318:0:17915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893259.446357:0:17915:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fe47f600 going to sleep for 11 seconds 00000100:00100000:1.0:1787893259.448848:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493419008 00000100:00100000:1.0:1787893259.448862:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493419008 00000100:00100000:1.0:1787893259.448919:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787893259.448929:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd285050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+17:17915:x1874741493419008:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787893259.448956:0:17177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893259.448975:0:17177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9fe541200/0x9232577658cf1edd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf1ed6 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893259.449002:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9fe541200/0x9232577658cf1edd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf1ed6 expref: 18 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893259.449012:0:17177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9fe541200/0x9232577658cf1edd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf1ed6 expref: 18 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893259.449021:0:17177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe541200, rc 0) 00000100:00100000:1.0:1787893259.449095:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd285050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+18:17915:x1874741493419008:12345-0@lo:101:mount.lustre.0 Request processed in 167us (2777us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893259.449102:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787893259.451619:0:17915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8507480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493419008:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787893259.451648:0:17915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6e00/0x9232577658cf1ed6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1edd expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.451661:0:17915:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6e00/0x9232577658cf1ed6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf1edd expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787893259.459194:0:17915:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1787893259.459591:0:17915:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787893259.459839:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1787893259.459865:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:2.0:1787893259.459878:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:2.0:1787893259.459891:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:2.0:1787893259.459903:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:2.0:1787893259.459927:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:2.0:1787893259.459940:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:2.0:1787893259.459952:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:2.0:1787893259.459964:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:2.0:1787893259.459976:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:2.0:1787893259.459988:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:2.0:1787893259.460002:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:2.0:1787893259.460016:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:2.0:1787893259.460029:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:2.0:1787893259.460043:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:2.0:1787893259.460056:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:2.0:1787893259.460069:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:2.0:1787893259.460082:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:2.0:1787893259.460094:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:2.0:1787893259.460107:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:2.0:1787893259.460120:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:2.0:1787893259.460131:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:2.0:1787893259.460142:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:2.0:1787893259.460154:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:2.0:1787893259.460165:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:2.0:1787893259.460177:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:2.0:1787893259.460190:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:2.0:1787893259.460203:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:2.0:1787893259.460223:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:2.0:1787893259.460229:0:17915:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1787893259.460315:0:17915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe348e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493419136:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787893259.460381:0:17915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893259.460422:0:17915:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c2f53300 going to sleep for 11 seconds 00000100:00100000:3.0:1787893259.462422:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493419136 00000100:00100000:3.0:1787893259.462434:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493419136 00000100:00100000:3.0:1787893259.462505:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787893259.462515:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd287850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+18:17915:x1874741493419136:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787893259.462662:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd287850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+18:17915:x1874741493419136:12345-0@lo:501:mount.lustre.0 Request processed in 148us (2281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893259.462670:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787893259.462997:0:17915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe348e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493419136:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787893259.463040:0:17915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe348e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493419264:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787893259.463087:0:17915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893259.463110:0:17915:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c2f53300 going to sleep for 11 seconds 00000100:00100000:3.0:1787893259.465392:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493419264 00000100:00100000:3.0:1787893259.465405:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493419264 00000100:00100000:3.0:1787893259.465471:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787893259.465482:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd284850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+18:17915:x1874741493419264:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787893259.465671:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd284850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+18:17915:x1874741493419264:12345-0@lo:503:mount.lustre.0 Request processed in 190us (2581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893259.465678:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787893259.465900:0:17915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe348e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493419264:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787893259.468745:0:17915:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787893259.468862:0:17915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe348e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493419392:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787893259.468947:0:17915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893259.468994:0:17915:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c2f53300 going to sleep for 11 seconds 00000100:00100000:0.0:1787893259.469201:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493419392 00000100:00100000:0.0:1787893259.469209:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493419392 00000100:00100000:0.0:1787893259.469258:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787893259.469267:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd287050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+18:17915:x1874741493419392:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787893259.469590:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd287050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+18:17915:x1874741493419392:12345-0@lo:502:mount.lustre.0 Request processed in 323us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893259.469599:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787893259.477698:0:17915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe348e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493419392:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787893259.477985:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1787893259.478031:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:2.0:1787893259.478047:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:2.0:1787893259.478061:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:2.0:1787893259.478074:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:2.0:1787893259.478088:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:2.0:1787893259.478100:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:2.0:1787893259.478114:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:2.0:1787893259.478129:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:2.0:1787893259.478141:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:2.0:1787893259.478153:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:2.0:1787893259.478164:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:2.0:1787893259.478176:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:2.0:1787893259.478190:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:2.0:1787893259.478203:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:2.0:1787893259.478214:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:2.0:1787893259.478227:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:2.0:1787893259.478256:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:2.0:1787893259.478271:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:2.0:1787893259.478301:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:2.0:1787893259.478316:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:2.0:1787893259.478340:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:2.0:1787893259.478353:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:2.0:1787893259.478367:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:2.0:1787893259.478382:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:2.0:1787893259.478395:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:2.0:1787893259.478407:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:2.0:1787893259.478418:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:2.0:1787893259.478431:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:2.0:1787893259.478458:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:2.0:1787893259.478472:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:2.0:1787893259.478486:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:2.0:1787893259.478531:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:2.0:1787893259.478561:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:2.0:1787893259.478578:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:2.0:1787893259.478591:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:2.0:1787893259.478605:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:2.0:1787893259.478617:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:2.0:1787893259.478630:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:2.0:1787893259.478642:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:2.0:1787893259.478652:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:2.0:1787893259.478663:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:2.0:1787893259.478675:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:2.0:1787893259.478687:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:2.0:1787893259.478700:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:2.0:1787893259.478711:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:2.0:1787893259.478722:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:2.0:1787893259.478734:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:2.0:1787893259.478796:0:17915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe348e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493419520:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787893259.478892:0:17915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893259.478945:0:17915:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c2f53300 going to sleep for 11 seconds 00000100:00100000:1.0:1787893259.481718:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493419520 00000100:00100000:1.0:1787893259.481735:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493419520 00000100:00100000:1.0:1787893259.481797:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787893259.481808:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd286050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+18:17915:x1874741493419520:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787893259.481996:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd286050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+18:17915:x1874741493419520:12345-0@lo:502:mount.lustre.0 Request processed in 189us (3104us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893259.482004:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787893259.483985:0:17915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe348e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493419520:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787893259.488556:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:2.0:1787893259.488643:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:2.0:1787893259.488709:0:17915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe348e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493419648:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787893259.488802:0:17915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893259.488867:0:17915:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c2f53300 going to sleep for 11 seconds 00000100:00100000:1.0:1787893259.488972:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493419648 00000100:00100000:1.0:1787893259.488981:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493419648 00000100:00100000:1.0:1787893259.489040:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787893259.489051:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd286c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+18:17915:x1874741493419648:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787893259.489169:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd286c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+18:17915:x1874741493419648:12345-0@lo:502:mount.lustre.0 Request processed in 120us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893259.489185:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787893259.489275:0:17915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe348e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493419648:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787893259.493511:0:17915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:2.0:1787893259.493526:0:17915:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1787893259.494111:0:17933:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1787893259.494129:0:17933:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9fc9ed578000) 00000020:00000080:2.0:1787893259.494155:0:17933:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1787893259.494250:0:17933:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc9ffb45000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1787893259.494255:0:17933:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc9ffb45000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1787893259.494258:0:17933:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc9ffb45000 3 00010000:00080000:2.0:1787893259.496881:0:17933:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc8c75f9000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.135@tcp at head 00010000:00010000:2.0:1787893259.507418:0:17933:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1787893259.507835:0:17933:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1787893259.507884:0:17933:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787893259.507900:0:17933:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x9232577658cf1eeb 00000100:00080000:2.0:1787893259.507910:0:17933:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787893259.507917:0:17933:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9fc8c75f9000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:2.0:1787893259.507952:0:17933:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9fe348e00 x1874741493419776/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787893259.507992:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe348e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3629:1874741493419776:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787893259.508060:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893259.508124:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493419776 00000100:00100000:2.0:1787893259.508131:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493419776 00000100:00100000:2.0:1787893259.508194:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787893259.508202:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe34a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3629:x1874741493419776:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787893259.508225:0:17185:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 503 last 0 00000020:00000080:2.0:1787893259.508256:0:17185:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x9232577658cf1ef2 00000004:00100000:2.0:1787893259.508270:0:17185:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787893259.511800:0:17185:0:(import.c:65:import_set_state_nolock()) ffff9fc9c4b36000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787893259.511903:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe34a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1874741493419776:12345-0@lo:38:llog_process_th.0 Request processed in 3697us (3839us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893259.511915:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787893259.511972:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fc9fe348e00 x1874741493419776/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787893269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893259.511983:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787893259.511991:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1787893259.512000:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787893259.512005:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787893259.512007:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc8c75f9000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787893259.512014:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe348e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3629:1874741493419776:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1787893259.512039:0:17933:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787893259.513497:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787893259.513533:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787893259.513537:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787893259.513540:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1787893259.517743:0:17933:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:2.0:1787893259.517805:0:17915:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787893259.517858:0:17915:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787893259.517878:0:17915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6e00/0x9232577658cf1ed6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1edd expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893259.517891:0:17915:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6e00/0x9232577658cf1ed6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1edd expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787893259.517954:0:17915:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787893259.517957:0:17915:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787893259.517958:0:17915:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787893259.517960:0:17915:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787893259.517961:0:17915:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787893259.517963:0:17915:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787893259.517964:0:17915:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787893259.517966:0:17915:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787893259.517967:0:17915:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787893259.517971:0:17915:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1787893259.517974:0:17915:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787893259.517975:0:17915:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787893259.517976:0:17915:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787893259.517977:0:17915:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787893259.517978:0:17915:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787893259.517979:0:17915:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787893259.517980:0:17915:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787893259.517981:0:17915:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787893259.517982:0:17915:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787893259.518009:0:17915:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1787893259.518029:0:17915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe348e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493419904:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787893259.518099:0:17915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893259.518147:0:17915:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c2f533c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787893259.543080:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493419904 00000100:00100000:0.0:1787893259.543097:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493419904 00000100:00100000:0.0:1787893259.543159:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787893259.543185:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd284c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+18:17915:x1874741493419904:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787893259.543222:0:17177:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787893259.543238:0:17177:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1787893259.550436:0:17163:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1787893259.550474:0:17177:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787893259.550651:0:17177:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1787893259.550969:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd284c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+18:17915:x1874741493419904:12345-0@lo:253:mount.lustre.0 Request processed in 7796us (32864us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893259.550982:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787893259.556924:0:17915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe348e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:17915:1874741493419904:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787893259.556943:0:17915:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1787893259.556946:0:17915:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787893259.556948:0:17915:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787893259.556949:0:17915:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787893259.556951:0:17915:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787893259.556952:0:17915:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787893259.556954:0:17915:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787893259.556955:0:17915:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787893259.556957:0:17915:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787893259.556958:0:17915:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787893259.556974:0:17915:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1787893259.565735:0:17199:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787893259.565756:0:17199:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787893259.575115:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fc8c84f7c00/0x9232577658cf1ef9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.575140:0:17199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9c147ca00/0x9232577658cf1dfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf1df6 expref: 17 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.575148:0:17199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9c4152400/0x9232577658cf1ec1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf1eba expref: 17 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.575156:0:17199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fc8c84f7c00/0x9232577658cf1ef9 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.575197:0:17199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9c4152400/0x9232577658cf1ec1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf1eba expref: 17 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.575213:0:17199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc9c4152400/0x9232577658cf1ec1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf1eba expref: 17 pid: 17178 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893259.575227:0:17199:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8507480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17199:1874741493420032:0@lo:104: 00000100:00100000:3.0:1787893259.575291:0:17199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787893259.575354:0:17199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9c147ca00/0x9232577658cf1dfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf1df6 expref: 17 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.575362:0:17199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc9c147ca00/0x9232577658cf1dfd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf1df6 expref: 17 pid: 17177 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893259.575370:0:17199:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8504000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17199:1874741493420160:0@lo:104: 00000100:00100000:3.0:1787893259.575389:0:17199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893259.575421:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493420032 00000100:00100000:3.0:1787893259.575427:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493420032 00000100:00100000:3.0:1787893259.575466:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493420160 00000100:00100000:3.0:1787893259.575469:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493420160 00000100:00100000:3.0:1787893259.575481:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787893259.575487:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8504700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13b37fca-0eda-4b14-a6ef-4a378c945d17+4:17199:x1874741493420032:12345-0@lo:104: 00010000:00010000:3.0:1787893259.575516:0:17166:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9c147dc00/0x9232577658cf1eba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf1ec1 expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.575559:0:17166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787893259.575565:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8504700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13b37fca-0eda-4b14-a6ef-4a378c945d17+4:17199:x1874741493420032:12345-0@lo:104: Request processed in 78us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893259.575572:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787893259.575586:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787893259.575592:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8504a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13b37fca-0eda-4b14-a6ef-4a378c945d17+3:17199:x1874741493420160:12345-0@lo:104: 00010000:00010000:3.0:1787893259.575599:0:17166:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540000/0x9232577658cf1df6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf1dfd expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.575631:0:17166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787893259.575636:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8504a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13b37fca-0eda-4b14-a6ef-4a378c945d17+3:17199:x1874741493420160:12345-0@lo:104: Request processed in 45us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893259.575642:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1787893259.575657:0:17171:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787893259.575663:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9c147dc00/0x9232577658cf1eba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf1ec1 expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.575670:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c147dc00 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:3.0:1787893259.575674:0:17171:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c147dc00/0x9232577658cf1eba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf1ec1 expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.575681:0:17171:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9c147dc00/0x9232577658cf1eba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf1ec1 expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787893259.575694:0:17171:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c147dc00/0x9232577658cf1eba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf1ec1 expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787893259.575700:0:17171:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787893259.575728:0:17171:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9c147dc00/0x9232577658cf1eba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf1ec1 expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.575734:0:17171:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787893259.575751:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9c147dc00/0x9232577658cf1eba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf1ec1 expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.575757:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9c147dc00/0x9232577658cf1eba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf1ec1 expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.575769:0:17171:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787893259.575772:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540000/0x9232577658cf1df6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf1dfd expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.575777:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540000 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:3.0:1787893259.575780:0:17171:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540000/0x9232577658cf1df6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf1dfd expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.575786:0:17171:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540000/0x9232577658cf1df6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf1dfd expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787893259.575791:0:17171:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540000/0x9232577658cf1df6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf1dfd expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787893259.575796:0:17171:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787893259.575812:0:17171:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540000/0x9232577658cf1df6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf1dfd expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.575818:0:17171:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787893259.590661:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893259.590710:0:17199:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c3692c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787893259.590759:0:17199:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8507480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17199:1874741493420032:0@lo:104: 00000100:00100000:1.0:1787893259.590770:0:17199:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8504000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17199:1874741493420160:0@lo:104: 00010000:00010000:1.0:1787893259.590797:0:17199:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fc8c84f7c00/0x9232577658cf1ef9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893259.591382:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787893259.591401:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13b37fca-0eda-4b14-a6ef-4a378c945d17:3631:1874741493420288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787893259.591469:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893259.591813:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493420288 00000100:00100000:1.0:1787893259.591832:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493420288 00010000:00010000:1.0:1787893259.591869:0:17168:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9c4152400/0x9232577658cf1ec1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf1eba expref: 18 pid: 17178 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893259.591910:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787893259.591919:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13b37fca-0eda-4b14-a6ef-4a378c945d17+18:3631:x1874741493420288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787893259.591934:0:17168:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893259.591941:0:17168:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9c4152400/0x9232577658cf1ec1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf1eba expref: 18 pid: 17178 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893259.591969:0:17168:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9c4152400/0x9232577658cf1ec1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf1eba expref: 18 pid: 17178 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893259.591988:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9c4152400/0x9232577658cf1ec1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf1eba expref: 18 pid: 17178 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893259.592003:0:17168:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893259.592044:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13b37fca-0eda-4b14-a6ef-4a378c945d17+17:3631:x1874741493420288:12345-0@lo:103:ldlm_bl.0 Request processed in 126us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893259.592051:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1787893259.592235:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540000/0x9232577658cf1df6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf1dfd expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.592244:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540000/0x9232577658cf1df6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf1dfd expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.592293:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893259.592296:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893259.592299:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893259.592665:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787893259.592680:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13b37fca-0eda-4b14-a6ef-4a378c945d17:3630:1874741493420416:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787893259.592719:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893259.594032:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493420416 00000100:00100000:3.0:1787893259.594043:0:17170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493420416 00010000:00010000:3.0:1787893259.594073:0:17170:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9c147ca00/0x9232577658cf1dfd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf1df6 expref: 17 pid: 17177 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893259.594109:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787893259.594117:0:17170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13b37fca-0eda-4b14-a6ef-4a378c945d17+17:3630:x1874741493420416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787893259.594130:0:17170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893259.594136:0:17170:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9c147ca00/0x9232577658cf1dfd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf1df6 expref: 17 pid: 17177 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.594147:0:17170:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9c147ca00/0x9232577658cf1dfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf1df6 expref: 17 pid: 17177 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.594163:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9c147ca00/0x9232577658cf1dfd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf1df6 expref: 17 pid: 17177 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.594178:0:17170:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fc8c84f7c00/0x9232577658cf1ef9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.594194:0:17170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c84f7c00/0x9232577658cf1ef9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787893259.594219:0:17170:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.028463491s 00010000:00010000:3.0:1787893259.594224:0:17170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc8c84f7c00/0x9232577658cf1ef9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.594231:0:17170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc8c84f7c00/0x9232577658cf1ef9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.594238:0:17170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fc8c84f7c00/0x9232577658cf1ef9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.594245:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fc8c84f7c00/0x9232577658cf1ef9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.594250:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c84f7c00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:3.0:1787893259.594255:0:17170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fc8c84f7c00/0x9232577658cf1ef9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.594263:0:17170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fc8c84f7c00/0x9232577658cf1ef9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.594284:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fc8c84f7c00/0x9232577658cf1ef9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.594295:0:17170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893259.594347:0:17170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13b37fca-0eda-4b14-a6ef-4a378c945d17+16:3630:x1874741493420416:12345-0@lo:103:ldlm_bl.0 Request processed in 230us (1627us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893259.594354:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787893259.594407:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13b37fca-0eda-4b14-a6ef-4a378c945d17:3630:1874741493420416:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787893259.594432:0:17199:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fc8c84f7c00/0x9232577658cf1ef9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.594440:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fc8c84f7c00/0x9232577658cf1ef9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893259.594447:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c84f7c00/0x9232577658cf1ef9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893259.594690:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13b37fca-0eda-4b14-a6ef-4a378c945d17:3631:1874741493420288:0@lo:103:ldlm_bl.0 00000040:01000000:2.0:1787893259.594850:0:17915:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1787893259.594931:0:17940:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1787893259.594935:0:17940:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1787893259.595459:0:17941:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787893259.596405:0:17915:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:2.0:1787893259.596786:0:17941:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787893259.597998:0:17942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b6d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17942:1874741493420544:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787893259.598083:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893259.598125:0:17942:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9f6d11b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787893259.598186:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493420544 00000100:00100000:0.0:1787893259.598194:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493420544 00000100:00100000:0.0:1787893259.598263:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787893259.598273:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17942:x1874741493420544:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787893259.598368:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17942:x1874741493420544:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 96us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893259.598387:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787893259.598436:0:17942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b6d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17942:1874741493420544:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1787893259.598468:0:17942:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1787893259.598522:0:17942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce0a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17942:1874741493420672:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787893259.598563:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893259.598582:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493420672 00000100:00100000:0.0:1787893259.598586:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493420672 00000100:00100000:0.0:1787893259.598603:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787893259.598608:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17942:x1874741493420672:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787893259.598702:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17942:x1874741493420672:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 93us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893259.598708:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787893259.598723:0:17942:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7699780 going to sleep for 11 seconds 00000100:00100000:0.0:1787893259.598735:0:17942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce0a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17942:1874741493420672:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787893259.598789:0:17942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce0a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17942:1874741493420800:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1787893259.598816:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893259.598861:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493420800 00000100:00100000:0.0:1787893259.598866:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493420800 00000100:00100000:0.0:1787893259.598891:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787893259.598897:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17942:x1874741493420800:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1787893259.598930:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17942:x1874741493420800:12345-0@lo:900:lod0001_rec0000.0 Request processed in 33us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893259.598937:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787893259.598952:0:17942:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7699780 going to sleep for 11 seconds 00010000:00080000:0.0:1787893259.598972:0:17942:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fc8c7ce0a80 x1874741493420800/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787893275 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893259.598983:0:17942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce0a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17942:1874741493420800:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1787893259.599016:0:17942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce0a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17942:1874741493420928:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787893259.599041:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893259.599058:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493420928 00000100:00100000:0.0:1787893259.599062:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493420928 00000100:00100000:0.0:1787893259.599079:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787893259.599086:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17942:x1874741493420928:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787893259.599140:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17942:x1874741493420928:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 53us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893259.599146:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787893259.599160:0:17942:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7699840 going to sleep for 11 seconds 00000100:00100000:0.0:1787893259.599170:0:17942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce0a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17942:1874741493420928:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1787893259.599205:0:17942:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787893259.601225:0:17942:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787893259.601321:0:17942:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000040:01000000:3.0:1787893259.602747:0:17915:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1787893259.602792:0:17915:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787893259.603181:0:17915:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787893259.603189:0:17915:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1787893259.603245:0:17915:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787893259.607028:0:17915:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787893259.607725:0:17941:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787893259.607797:0:17941:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787893259.607803:0:17941:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000040:00080000:3.0:1787893259.608562:0:17915:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787893259.608614:0:17915:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1787893259.608771:0:17915:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1787893259.609782:0:17915:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:3.0:1787893259.612868:0:17915:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1787893259.634066:0:17915:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787893259.634116:0:17915:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbaa0c1a53988 00100000:10000000:3.0:1787893259.634125:0:17915:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1787893259.638775:0:17915:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787893259.638816:0:17915:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.135@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787893259.638845:0:17915:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787893259.638873:0:17915:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1787893259.639694:0:17915:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787893259.639919:0:17915:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787893259.777830:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893260.273922:0:17225:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57000 going to sleep for 0 seconds 00000040:00080000:3.0:1787893260.595458:0:17937:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1787893260.786820:0:17180:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787893260.786828:0:17180:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc9ffb45000 from 8 10000000:01000000:2.0:1787893260.786833:0:17180:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787893260.786885:0:17180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153200/0x9232577658cf1f00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893260.786920:0:17180:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153200/0x9232577658cf1f00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893260.786933:0:17180:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153200/0x9232577658cf1f00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893260.786968:0:17180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe34aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493421056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787893260.787044:0:17180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893260.787104:0:17180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c2f53240 going to sleep for 11 seconds 00000100:00100000:0.0:1787893260.787564:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493421056 00000100:00100000:0.0:1787893260.787582:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493421056 00000100:00100000:0.0:1787893260.787664:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787893260.787677:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd285850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+16:17180:x1874741493421056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787893260.787697:0:17178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893260.787722:0:17178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9dd69c800/0x9232577658cf1f07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf1f00 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893260.787760:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9dd69c800/0x9232577658cf1f07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf1f00 expref: 17 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893260.787789:0:17178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9dd69c800/0x9232577658cf1f07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf1f00 expref: 17 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893260.787801:0:17178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9dd69c800, rc 0) 00000100:00100000:0.0:1787893260.787900:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd285850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+17:17180:x1874741493421056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 225us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893260.787908:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787893260.787974:0:17180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe34aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493421056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787893260.787994:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153200/0x9232577658cf1f00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1f07 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893260.788005:0:17180:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153200/0x9232577658cf1f00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf1f07 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893260.788090:0:17180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493421184:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787893260.788131:0:17180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893260.788163:0:17180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c76996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787893260.788179:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493421184 00000100:00100000:0.0:1787893260.788183:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493421184 00000100:00100000:0.0:1787893260.788210:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787893260.788217:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd287450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+17:17180:x1874741493421184:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787893260.788231:0:17177:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787893260.788250:0:17177:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787893260.788253:0:17177:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1787893260.788334:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd287450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+17:17180:x1874741493421184:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 117us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893260.788351:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787893260.788383:0:17180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493421184:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787893260.788429:0:17180:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787893260.788436:0:17180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153200/0x9232577658cf1f00 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1f07 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893260.788446:0:17180:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153200/0x9232577658cf1f00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1f07 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787893260.788457:0:17180:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787893260.788460:0:17180:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc9d0f72800 from 8 10000000:01000000:0.0:1787893260.788463:0:17180:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787893260.788485:0:17180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69dc00/0x9232577658cf1f0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893260.788527:0:17180:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69dc00/0x9232577658cf1f0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893260.788537:0:17180:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69dc00/0x9232577658cf1f0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893260.788550:0:17180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493421312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787893260.788575:0:17180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893260.788592:0:17180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c76996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787893260.788603:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493421312 00000100:00100000:0.0:1787893260.788607:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493421312 00000100:00100000:0.0:1787893260.788630:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787893260.788637:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd287c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+17:17180:x1874741493421312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787893260.788651:0:17177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893260.788662:0:17177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9dd69de00/0x9232577658cf1f15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf1f0e expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893260.788679:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9dd69de00/0x9232577658cf1f15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf1f0e expref: 18 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893260.788689:0:17177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9dd69de00/0x9232577658cf1f15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf1f0e expref: 18 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893260.788697:0:17177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9dd69de00, rc 0) 00000100:00100000:0.0:1787893260.788726:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd287c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+18:17180:x1874741493421312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893260.788732:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787893260.788760:0:17180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493421312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787893260.788771:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69dc00/0x9232577658cf1f0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1f15 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893260.788779:0:17180:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69dc00/0x9232577658cf1f0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf1f15 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893260.788830:0:17180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493421440:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787893260.788856:0:17180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893260.788869:0:17180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c76996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787893260.788879:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493421440 00000100:00100000:0.0:1787893260.788883:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493421440 00000100:00100000:0.0:1787893260.788901:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787893260.788907:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd284450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+18:17180:x1874741493421440:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787893260.788925:0:17177:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787893260.788935:0:17177:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787893260.788938:0:17177:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1787893260.789007:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd284450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+18:17180:x1874741493421440:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 94us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893260.789015:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787893260.789053:0:17180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493421440:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787893260.789088:0:17180:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787893260.789094:0:17180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69dc00/0x9232577658cf1f0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1f15 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893260.789102:0:17180:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69dc00/0x9232577658cf1f0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1f15 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893260.791187:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893261.307533:0:17225:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57000 going to sleep for 0 seconds 00000040:00080000:0.0:1787893261.622589:0:17937:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787893261.810438:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893262.321579:0:17225:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57000 going to sleep for 0 seconds 00010000:00010000:0.0:1787893262.837336:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893263.345648:0:17225:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57000 going to sleep for 0 seconds 00010000:00010000:2.0:1787893263.862315:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893264.374071:0:17225:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57000 going to sleep for 0 seconds 00000001:02000400:2.0:1787893264.502758:0:18198:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg235-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:0.0:1787893264.564410:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787893264.564417:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787893264.564420:0:37:0:(import.c:65:import_set_state_nolock()) ffff9fc9e5eaf000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787893264.564431:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9fc9e5eaf000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:0.0:1787893264.564455:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c7ce1180 x1874741493421696/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787893264.564475:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787893264.564485:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787893264.564487:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787893264.564514:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787893264.564540:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787893264.564543:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787893264.564546:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787893264.564548:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787893264.564577:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493421696:0@lo:38:kworker.0 00000100:00100000:0.0:1787893264.564641:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893264.564701:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1874741493422080:0@lo:400:kworker.0 00000100:00100000:0.0:1787893264.564727:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893264.564745:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787893264.564751:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493421952:0@lo:400:kworker.0 00000100:00100000:0.0:1787893264.564770:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893264.564810:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493421696 00000100:00100000:0.0:1787893264.564817:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493421696 00000100:00100000:0.0:1787893264.564839:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493421952 00000100:00100000:0.0:1787893264.564842:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493421952 00000100:00100000:0.0:1787893264.564862:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787893264.564869:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3629:x1874741493421696:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787893264.564905:0:17189:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 508 last 0 00000020:00000080:0.0:1787893264.564940:0:17189:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9232577658cf1f1c 00000004:00100000:0.0:1787893264.564954:0:17189:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1787893264.564960:0:17189:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1787893264.565034:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493422080 00000100:00100000:0.0:1787893264.565038:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493422080 00000100:00100000:0.0:1787893264.565067:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787893264.565073:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1874741493422080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893264.565119:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1874741493422080:12345-0@lo:400:kworker.0 Request processed in 46us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893264.565126:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787893264.565164:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc8c7ce2a00 x1874741493422080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893264.565176:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1874741493422080:0@lo:400:kworker.0 00000100:00100000:1.0:1787893264.565257:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13b37fca-0eda-4b14-a6ef-4a378c945d17:3632:1874741493421568:0@lo:400:kworker.0 00000100:00100000:1.0:1787893264.565290:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893264.565330:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787893264.565338:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493421824:0@lo:400:kworker.0 00000100:00100000:1.0:1787893264.565360:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893264.565967:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493421568 00000100:00100000:0.0:1787893264.565973:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493421568 00000100:00100000:0.0:1787893264.566010:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787893264.566017:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd284050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+18:3632:x1874741493421568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893264.566063:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd284050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+18:3632:x1874741493421568:12345-0@lo:400:kworker.0 Request processed in 46us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893264.566069:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787893264.566095:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493421824 00000100:00100000:0.0:1787893264.566098:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493421824 00000100:00100000:0.0:1787893264.566120:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787893264.566126:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493421824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893264.566153:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493421824:12345-0@lo:400:kworker.0 Request processed in 27us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893264.566160:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787893264.566251:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc8c7ce2d80 x1874741493421824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893264.566263:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493421824:0@lo:400:kworker.0 00000100:00100000:3.0:1787893264.566283:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13b37fca-0eda-4b14-a6ef-4a378c945d17:3632:1874741493421568:0@lo:400:kworker.0 00000100:00100000:3.0:1787893264.567903:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787893264.567920:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493422208:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787893264.567973:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893264.568124:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1787893264.568134:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1787893264.572212:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493422208 00000100:00100000:3.0:1787893264.572224:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493422208 00000100:00100000:1.0:1787893264.572433:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787893264.572444:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3631:x1874741493421952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893264.572579:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3631:x1874741493421952:12345-0@lo:400:kworker.0 Request processed in 137us (7806us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893264.572586:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787893264.572604:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787893264.572611:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493422208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787893264.572634:0:18203:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787893264.572674:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493422208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (4701us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893264.572681:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787893264.572786:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493421952:0@lo:400:kworker.0 00000100:00100000:3.0:1787893264.573059:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493422208:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1787893264.584308:0:17189:0:(import.c:65:import_set_state_nolock()) ffff9fc9d9099800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787893264.584404:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3629:x1874741493421696:12345-0@lo:38:kworker.0 Request processed in 19533us (19761us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893264.584414:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1787893264.584533:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787893264.584543:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1787893264.584557:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787893264.584560:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9e5eaf000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1787893264.584574:0:3629:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000001b401222): req@ffff9fc8c64b5180 x1874741493414784/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893264.584592:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493421696:0@lo:38:kworker.0 00000100:00100000:0.0:1787893264.584665:0:17225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893264.584696:0:17225:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57000 going to sleep for 11 seconds 00000100:00100000:3.0:1787893264.586515:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787893264.586532:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493422336:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787893264.586583:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893264.586631:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493414784 00000100:00100000:3.0:1787893264.586638:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493414784 00000100:00100000:3.0:1787893264.586675:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493422336 00000100:00100000:3.0:1787893264.586678:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493422336 00000100:00100000:3.0:1787893264.586694:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787893264.586703:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17225:x1874741493414784:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787893264.586797:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17225:x1874741493414784:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 94us (2130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893264.586803:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787893264.586818:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787893264.586824:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3632:x1874741493422336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787893264.586843:0:17188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787893264.586874:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3632:x1874741493422336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 50us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893264.586887:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787893264.586936:0:17225:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b5180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17225:1874741493414784:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1787893264.586968:0:17225:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1787893264.586998:0:17225:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8504e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17225:1874741493422464:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787893264.587026:0:17225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893264.587046:0:17225:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c70b8180 going to sleep for 11 seconds 00000100:00100000:3.0:1787893264.587069:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493422336:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787893264.587090:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493422464 00000100:00100000:3.0:1787893264.587094:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493422464 00000100:00100000:3.0:1787893264.587110:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787893264.587116:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17225:x1874741493422464:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787893264.587205:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17225:x1874741493422464:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 88us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893264.587212:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787893264.587246:0:17225:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8504e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17225:1874741493422464:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787893264.587318:0:17225:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8504e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17225:1874741493422592:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787893264.587341:0:17225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893264.587355:0:17225:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c70b8180 going to sleep for 11 seconds 00000100:00100000:3.0:1787893264.587367:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493422592 00000100:00100000:3.0:1787893264.587371:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493422592 00000100:00100000:3.0:1787893264.587387:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787893264.587392:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17225:x1874741493422592:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787893264.587435:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17225:x1874741493422592:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 43us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893264.587450:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787893264.587473:0:17225:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8504e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17225:1874741493422592:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1787893264.587529:0:17225:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787893264.595094:0:17225:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787893264.595176:0:17225:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:3.0:1787893264.595182:0:17225:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1787893264.883018:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787893265.576469:0:18251:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787893265.576694:0:18251:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787893265.913923:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787893266.412798:0:18301:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787893266.413305:0:18301:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:0.0:1787893266.423024:0:17220:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787893266.931445:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787893267.196947:0:18349:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff167c60e0 20000000:00000080:1.0:1787893267.196962:0:18349:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fc9c420f800 uarg=0000000000000000 20000000:01000000:1.0:1787893267.196993:0:18349:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787893267.196999:0:18349:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787893267.197003:0:18349:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787893267.197436:0:18350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1787893267.197716:0:18349:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787893267.203816:0:18349:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787893267.203917:0:18349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fc9fe541000/0x9232577658cf1f23 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893267.203933:0:18349:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9dd69ca00/0x9232577658cf1dcc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf1dc5 expref: 17 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893267.203954:0:18349:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9c4153c00/0x9232577658cf1ecf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf1ec8 expref: 17 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893267.203959:0:18349:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fc9fe541000/0x9232577658cf1f23 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893267.203992:0:18349:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9c4153c00/0x9232577658cf1ecf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf1ec8 expref: 17 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893267.204004:0:18349:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc9c4153c00/0x9232577658cf1ecf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf1ec8 expref: 17 pid: 17175 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893267.204015:0:18349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18349:1874741493422720:0@lo:104: 00000100:00100000:1.0:1787893267.204075:0:18349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787893267.204172:0:18349:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9dd69ca00/0x9232577658cf1dcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf1dc5 expref: 17 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893267.204178:0:18349:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc9dd69ca00/0x9232577658cf1dcc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf1dc5 expref: 17 pid: 17178 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893267.204184:0:18349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18349:1874741493422848:0@lo:104: 00000100:00100000:1.0:1787893267.204200:0:18349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893267.204364:0:18349:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9f6d11a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787893267.204433:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493422720 00000100:00100000:2.0:1787893267.204441:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493422720 00000100:00100000:2.0:1787893267.204466:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493422848 00000100:00100000:2.0:1787893267.204468:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493422848 00000100:00100000:2.0:1787893267.204476:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787893267.204482:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13b37fca-0eda-4b14-a6ef-4a378c945d17+4:18349:x1874741493422720:12345-0@lo:104: 00010000:00010000:2.0:1787893267.204513:0:17167:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153e00/0x9232577658cf1ec8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf1ecf expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893267.204557:0:17167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787893267.204566:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13b37fca-0eda-4b14-a6ef-4a378c945d17+4:18349:x1874741493422720:12345-0@lo:104: Request processed in 84us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893267.204571:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787893267.204584:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787893267.204588:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13b37fca-0eda-4b14-a6ef-4a378c945d17+3:18349:x1874741493422848:12345-0@lo:104: 00010000:00010000:2.0:1787893267.204593:0:17167:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d400/0x9232577658cf1dc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf1dcc expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893267.204615:0:17167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787893267.204618:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13b37fca-0eda-4b14-a6ef-4a378c945d17+3:18349:x1874741493422848:12345-0@lo:104: Request processed in 30us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893267.204621:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1787893267.204632:0:17171:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787893267.204636:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153e00/0x9232577658cf1ec8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf1ecf expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893267.204641:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c4153e00 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:2.0:1787893267.204644:0:17171:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153e00/0x9232577658cf1ec8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf1ecf expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893267.204649:0:17171:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153e00/0x9232577658cf1ec8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf1ecf expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787893267.204654:0:17171:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153e00/0x9232577658cf1ec8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf1ecf expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893267.204658:0:17171:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787893267.204677:0:17171:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153e00/0x9232577658cf1ec8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf1ecf expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893267.204688:0:17171:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787893267.204702:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153e00/0x9232577658cf1ec8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf1ecf expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893267.204706:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153e00/0x9232577658cf1ec8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf1ecf expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893267.204716:0:17171:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893267.204718:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d400/0x9232577658cf1dc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf1dcc expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893267.204724:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c147d400 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:2.0:1787893267.204726:0:17171:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d400/0x9232577658cf1dc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf1dcc expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893267.204732:0:17171:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d400/0x9232577658cf1dc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf1dcc expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787893267.204738:0:17171:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d400/0x9232577658cf1dc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf1dcc expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893267.204743:0:17171:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787893267.204765:0:17171:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d400/0x9232577658cf1dc5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf1dcc expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893267.204771:0:17171:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787893267.204777:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d400/0x9232577658cf1dc5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf1dcc expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893267.204783:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d400/0x9232577658cf1dc5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf1dcc expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893267.204801:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893267.204802:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893267.204804:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893267.204819:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe349180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13b37fca-0eda-4b14-a6ef-4a378c945d17:3631:1874741493423104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787893267.204840:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893267.204949:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787893267.204954:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe349f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13b37fca-0eda-4b14-a6ef-4a378c945d17:3631:1874741493422976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787893267.204968:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893267.204989:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493423104 00000100:00100000:2.0:1787893267.204992:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493423104 00010000:00010000:2.0:1787893267.205004:0:17168:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9dd69ca00/0x9232577658cf1dcc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf1dc5 expref: 18 pid: 17178 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893267.205016:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493422976 00000100:00100000:2.0:1787893267.205018:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493422976 00010000:00010000:2.0:1787893267.205025:0:17168:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9c4153c00/0x9232577658cf1ecf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf1ec8 expref: 19 pid: 17175 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893267.205037:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787893267.205042:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe34a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13b37fca-0eda-4b14-a6ef-4a378c945d17+19:3631:x1874741493423104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787893267.205051:0:17168:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893267.205056:0:17168:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9dd69ca00/0x9232577658cf1dcc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf1dc5 expref: 19 pid: 17178 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893267.205065:0:17168:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9dd69ca00/0x9232577658cf1dcc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf1dc5 expref: 19 pid: 17178 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893267.205079:0:17168:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893267.205105:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe34a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13b37fca-0eda-4b14-a6ef-4a378c945d17+19:3631:x1874741493423104:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893267.205109:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787893267.205118:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787893267.205122:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe349c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13b37fca-0eda-4b14-a6ef-4a378c945d17+18:3631:x1874741493422976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787893267.205127:0:17168:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893267.205130:0:17168:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9c4153c00/0x9232577658cf1ecf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf1ec8 expref: 18 pid: 17175 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893267.205135:0:17168:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9c4153c00/0x9232577658cf1ecf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf1ec8 expref: 18 pid: 17175 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893267.205143:0:17168:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fc9fe541000/0x9232577658cf1f23 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893267.205148:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9fe541000/0x9232577658cf1f23 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893267.205155:0:17168:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc9fe541000/0x9232577658cf1f23 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893267.205160:0:17168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc9fe541000/0x9232577658cf1f23 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893267.205164:0:17168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fc9fe541000/0x9232577658cf1f23 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893267.205168:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fc9fe541000/0x9232577658cf1f23 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893267.205171:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe541000 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787893267.205177:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fc9fe541000/0x9232577658cf1f23 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893267.205182:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fc9fe541000/0x9232577658cf1f23 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893267.205187:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fc9fe541000/0x9232577658cf1f23 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893267.205193:0:17168:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893267.205264:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe349c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13b37fca-0eda-4b14-a6ef-4a378c945d17+18:3631:x1874741493422976:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893267.205269:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787893267.205296:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe349f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13b37fca-0eda-4b14-a6ef-4a378c945d17:3631:1874741493422976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787893267.205301:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe349180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13b37fca-0eda-4b14-a6ef-4a378c945d17:3631:1874741493423104:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787893267.205360:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893267.205427:0:18349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9c4153c00/0x9232577658cf1ecf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf1ec8 expref: 17 pid: 17175 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893267.205433:0:18349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18349:1874741493422720:0@lo:104: 00010000:00010000:1.0:1787893267.205439:0:18349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9dd69ca00/0x9232577658cf1dcc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf1dc5 expref: 16 pid: 17178 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893267.205452:0:18349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18349:1874741493422848:0@lo:104: 00010000:00010000:1.0:1787893267.205463:0:18349:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fc9fe541000/0x9232577658cf1f23 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893267.205469:0:18349:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fc9fe541000/0x9232577658cf1f23 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893267.205473:0:18349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fc9fe541000/0x9232577658cf1f23 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893267.205476:0:18349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9fe541000/0x9232577658cf1f23 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893267.957818:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787893268.529591:0:17180:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787893268.529598:0:17180:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc9ffb45000 from 13 10000000:01000000:2.0:1787893268.529602:0:17180:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787893268.529820:0:17180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153a00/0x9232577658cf1f2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893268.529831:0:17180:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153a00/0x9232577658cf1f2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893268.529840:0:17180:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153a00/0x9232577658cf1f2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893268.529868:0:17180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe349180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493423232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787893268.529936:0:17180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893268.529998:0:17180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fe47fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1787893268.530131:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493423232 00000100:00100000:0.0:1787893268.530138:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493423232 00000100:00100000:0.0:1787893268.530205:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787893268.530213:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd2abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+16:17180:x1874741493423232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787893268.530224:0:17178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893268.530237:0:17178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9dd69d000/0x9232577658cf1f31 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf1f2a expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893268.530256:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9dd69d000/0x9232577658cf1f31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf1f2a expref: 17 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893268.530266:0:17178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9dd69d000/0x9232577658cf1f31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf1f2a expref: 17 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893268.530275:0:17178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9dd69d000, rc 0) 00000100:00100000:0.0:1787893268.530311:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd2abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+17:17180:x1874741493423232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893268.530318:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787893268.532785:0:17180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe349180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493423232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787893268.532815:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153a00/0x9232577658cf1f2a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1f31 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893268.532828:0:17180:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153a00/0x9232577658cf1f2a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf1f31 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893268.532927:0:17180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe349180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493423360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787893268.532981:0:17180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893268.533023:0:17180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fe47fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1787893268.533611:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493423360 00000100:00100000:0.0:1787893268.533629:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493423360 00000100:00100000:0.0:1787893268.533758:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787893268.533768:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd2a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+17:17180:x1874741493423360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787893268.533923:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd2a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+17:17180:x1874741493423360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 156us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893268.533931:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787893268.534396:0:17180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe349180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493423360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787893268.534448:0:17180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8504e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493423488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787893268.534513:0:17180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893268.534537:0:17180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c70b8840 going to sleep for 11 seconds 00000100:00100000:3.0:1787893268.534550:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493423488 00000100:00100000:3.0:1787893268.534554:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493423488 00000100:00100000:2.0:1787893268.537826:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787893268.537844:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd2a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+17:17180:x1874741493423488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787893268.538021:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd2a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+17:17180:x1874741493423488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 183us (3507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893268.538029:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787893268.538095:0:17180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8504e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493423488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787893268.538748:0:18412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787893268.538799:0:17180:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787893268.538817:0:17180:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787893268.538826:0:17180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153a00/0x9232577658cf1f2a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1f31 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893268.538836:0:17180:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153a00/0x9232577658cf1f2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1f31 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893268.538845:0:17180:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787893268.538856:0:17180:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc9d0f72800 from 13 10000000:01000000:2.0:1787893268.538859:0:17180:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787893268.538889:0:17180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153e00/0x9232577658cf1f38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893268.538896:0:17180:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153e00/0x9232577658cf1f38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893268.538907:0:17180:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153e00/0x9232577658cf1f38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893268.538926:0:17180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe349f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493423616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787893268.538965:0:17180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893268.538995:0:17180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fe47fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787893268.539009:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493423616 00000100:00100000:2.0:1787893268.539015:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493423616 00000100:00100000:2.0:1787893268.539043:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787893268.539051:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd2aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+17:17180:x1874741493423616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787893268.539060:0:17178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893268.539070:0:17178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9c4153c00/0x9232577658cf1f3f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf1f38 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893268.539090:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9c4153c00/0x9232577658cf1f3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf1f38 expref: 18 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893268.539100:0:17178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9c4153c00/0x9232577658cf1f3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf1f38 expref: 18 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893268.539108:0:17178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9c4153c00, rc 0) 00000100:00100000:2.0:1787893268.539137:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd2aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+18:17180:x1874741493423616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893268.539149:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787893268.539179:0:17180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe349f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493423616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787893268.539190:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153e00/0x9232577658cf1f38 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1f3f expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893268.539198:0:17180:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153e00/0x9232577658cf1f38 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf1f3f expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893268.539238:0:17180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe349f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493423744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787893268.539259:0:17180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893268.539271:0:17180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fe47fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787893268.539281:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493423744 00000100:00100000:2.0:1787893268.539284:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493423744 00000100:00100000:2.0:1787893268.539299:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787893268.539305:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd2a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+18:17180:x1874741493423744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787893268.539397:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd2a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+18:17180:x1874741493423744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 92us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893268.539404:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787893268.539428:0:17180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe349f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493423744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787893268.539449:0:17180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe349f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493423872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787893268.539480:0:17180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893268.539513:0:17180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fe47fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787893268.539524:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493423872 00000100:00100000:2.0:1787893268.539527:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493423872 00000100:00100000:2.0:1787893268.539541:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787893268.539552:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd2a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+18:17180:x1874741493423872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787893268.539609:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd2a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+18:17180:x1874741493423872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 57us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893268.539616:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787893268.539646:0:17180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe349f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493423872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787893268.540334:0:18413:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787893268.540380:0:17180:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787893268.540395:0:17180:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787893268.540402:0:17180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153e00/0x9232577658cf1f38 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1f3f expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893268.540411:0:17180:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153e00/0x9232577658cf1f38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1f3f expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893268.978830:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893269.683848:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8506300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493424000:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787893269.683924:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893269.683983:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493424000 00000100:00100000:3.0:1787893269.683990:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493424000 00000100:00100000:3.0:1787893269.684042:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787893269.684051:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493424000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787893269.684084:0:17188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787893269.684128:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493424000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893269.684136:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787893269.684179:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8506300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493424000:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1787893269.685044:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787893269.685048:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787893269.685051:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787893269.685055:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787893269.685067:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787893269.685070:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787893269.685072:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787893269.685076:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787893269.685098:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe34aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1874741493424384:0@lo:400:kworker.0 00000100:00100000:2.0:1787893269.685152:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893269.685176:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787893269.685182:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe349180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493424256:0@lo:400:kworker.0 00000100:00100000:2.0:1787893269.685220:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893269.685246:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493424256 00000100:00100000:2.0:1787893269.685251:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493424256 00000100:00100000:2.0:1787893269.685279:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787893269.685287:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe348700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3631:x1874741493424256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893269.685328:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe348700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3631:x1874741493424256:12345-0@lo:400:kworker.0 Request processed in 41us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893269.685336:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787893269.685364:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe349180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493424256:0@lo:400:kworker.0 00000100:00100000:0.0:1787893269.685467:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493424384 00000100:00100000:0.0:1787893269.685470:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493424384 00000100:00100000:0.0:1787893269.685526:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787893269.685534:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe349500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1874741493424384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893269.685571:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe349500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1874741493424384:12345-0@lo:400:kworker.0 Request processed in 38us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893269.685578:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787893269.685603:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc9fe34aa00 x1874741493424384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893269.685615:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe34aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1874741493424384:0@lo:400:kworker.0 00000100:00100000:3.0:1787893269.685996:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe349f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13b37fca-0eda-4b14-a6ef-4a378c945d17:3633:1874741493424128:0@lo:400:kworker.0 00000100:00100000:3.0:1787893269.686039:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893269.686077:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493424640:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787893269.686099:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893269.686117:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787893269.686123:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe348e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874741493424512:0@lo:400:kworker.0 00000100:00100000:3.0:1787893269.686149:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893269.686209:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493424640 00000100:00100000:3.0:1787893269.686213:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493424640 00000100:00100000:3.0:1787893269.686233:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787893269.686239:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3633:x1874741493424640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787893269.686262:0:17189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787893269.686297:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3633:x1874741493424640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893269.686304:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787893269.686332:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493424640:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787893269.686473:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493424512 00000100:00100000:2.0:1787893269.686478:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493424512 00000100:00100000:2.0:1787893269.686521:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787893269.686528:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1874741493424512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893269.686562:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1874741493424512:12345-0@lo:400:kworker.0 Request processed in 34us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893269.686568:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787893269.686766:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc9fe348e00 x1874741493424512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893269.686778:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe348e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874741493424512:0@lo:400:kworker.0 00000100:00100000:0.0:1787893269.686851:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493424128 00000100:00100000:0.0:1787893269.686855:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493424128 00000100:00100000:0.0:1787893269.686887:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787893269.686894:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd2a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+18:3633:x1874741493424128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893269.686928:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd2a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+18:3633:x1874741493424128:12345-0@lo:400:kworker.0 Request processed in 34us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893269.686943:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787893269.687033:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe349f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13b37fca-0eda-4b14-a6ef-4a378c945d17:3633:1874741493424128:0@lo:400:kworker.0 00000100:00100000:0.0:1787893269.688539:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787893259/real 1787893259] req@ffff9fc9fe34b480 x1874741493417984/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893269 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893269.688566:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc9fe34b480 x1874741493417984/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893269 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893269.688576:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787893259/real 1787893259] req@ffff9fc8c7ce0000 x1874741493417856/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893269 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893269.688588:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc8c7ce0000 x1874741493417856/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893269 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893269.688596:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787893254/real 1787893254] req@ffff9fc9fe34b800 x1874741493415808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893269 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893269.688607:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc9fe34b800 x1874741493415808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893269 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893269.688615:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787893254/real 1787893254] req@ffff9fc9fe34ad80 x1874741493415936/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893269 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893269.688625:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc9fe34ad80 x1874741493415936/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893269 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787893269.688648:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9d29e9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787893269.688664:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787893269.688668:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe34b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493417984:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787893269.688673:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9c3ea8000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787893269.688678:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787893269.688693:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493417856:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787893269.688697:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9d24d5000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787893269.688702:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787893269.688705:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe34b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493415808:0@lo:8:kworker.0 00000100:00080000:0.0:1787893269.688708:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9e5eaa000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787893269.688712:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787893269.688715:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe34ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493415936:0@lo:8:kworker.0 00000100:00080000:2.0:1787893269.688851:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787893269.688856:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787893269.688859:0:37:0:(import.c:65:import_set_state_nolock()) ffff9fc9d24d5000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787893269.688864:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 498 00000100:00080000:2.0:1787893269.688868:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787893269.688874:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fc9d24d5000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:2.0:1787893269.688903:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9fe349180 x1874741493424768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787893269.688936:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787893269.688939:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787893269.688941:0:37:0:(import.c:65:import_set_state_nolock()) ffff9fc9e5eaa000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787893269.688944:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 498 00000100:00080000:2.0:1787893269.688947:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787893269.688951:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fc9e5eaa000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:2.0:1787893269.688964:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9fe348380 x1874741493424896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787893269.688973:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787893269.688975:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787893269.688977:0:37:0:(import.c:65:import_set_state_nolock()) ffff9fc9c3ea8000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787893269.688980:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 503 00000100:00080000:2.0:1787893269.688983:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787893269.688986:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9fc9c3ea8000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:2.0:1787893269.688995:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9fe34ad80 x1874741493425024/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787893269.689003:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787893269.689006:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787893269.689008:0:37:0:(import.c:65:import_set_state_nolock()) ffff9fc9d29e9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787893269.689010:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 503 00000100:00080000:2.0:1787893269.689013:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787893269.689016:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9fc9d29e9000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:2.0:1787893269.689024:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9fe34b800 x1874741493425152/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787893269.690305:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe349180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493424768:0@lo:8:kworker.0 00000400:00000100:0.0:1787893269.690363:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874741493424768 offset 0 length 520: 4 00000100:00100000:0.0:1787893269.690401:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe348380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493424896:0@lo:8:kworker.0 00000400:00000100:0.0:1787893269.690421:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874741493424896 offset 0 length 520: 4 00000100:00100000:0.0:1787893269.690431:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe34ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493425024:0@lo:8:kworker.0 00000400:00000100:0.0:1787893269.690447:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874741493425024 offset 0 length 520: 4 00000100:00100000:0.0:1787893269.690456:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe34b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493425152:0@lo:8:kworker.0 00000400:00000100:0.0:1787893269.690473:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874741493425152 offset 0 length 520: 4 00010000:00010000:0.0:1787893270.002710:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787893270.201937:0:17916:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1787893271.025996:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787893271.863600:0:17937:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787893272.051591:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893273.075401:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893274.098319:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787893274.199931:0:18698:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787893274.199935:0:18698:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1787893274.199937:0:18698:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1787893274.200055:0:18698:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fc8c8410800 00000020:01000004:3.0:1787893274.200071:0:18698:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787893274.200084:0:18698:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787893274.200099:0:18698:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9fc9d9118000) 00000020:00000080:3.0:1787893274.200122:0:18698:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787893274.281223:0:18698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787893274.283606:0:18698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1787893274.284079:0:18698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787893274.284454:0:18698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787893274.284759:0:18698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1787893274.285373:0:18698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1787893274.286059:0:18698:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:2.0:1787893274.293076:0:18698:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787893274.293299:0:18698:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787893274.293313:0:18698:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787893274.293325:0:18698:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9232577658cf1f4d 00000020:01000004:2.0:1787893274.293332:0:18698:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787893274.293355:0:18698:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.135@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787893274.293358:0:18698:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.135@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787893274.293364:0:18698:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787893274.293369:0:18698:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787893274.293379:0:18698:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9fc9ed57cd28) 00000020:00000080:2.0:1787893274.293389:0:18698:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1787893274.295399:0:18698:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787893274.295609:0:18698:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787893274.295616:0:18698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787893274.302594:0:18698:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787893274.302606:0:18698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787893274.303157:0:18698:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787893274.303165:0:18698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787893274.305317:0:18698:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787893274.305509:0:18698:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787893274.305517:0:18698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787893274.307904:0:18698:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787893274.307917:0:18698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787893274.347262:0:18698:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787893274.348270:0:18698:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787893274.348278:0:18698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787893274.354357:0:18698:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787893274.354376:0:18698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787893274.355405:0:18698:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787893274.355415:0:18698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787893274.360713:0:18698:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787893274.360900:0:18698:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787893274.360907:0:18698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787893274.365597:0:18698:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787893274.365611:0:18698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787893274.420585:0:18698:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787893274.420789:0:18698:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787893274.420796:0:18698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787893274.428443:0:18698:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787893274.428463:0:18698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787893274.428951:0:18698:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787893274.428980:0:18698:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1787893274.428986:0:18698:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.135@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787893274.443524:0:18698:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.135@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787893274.443566:0:18698:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.135@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1787893274.443571:0:18698:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787893274.443573:0:18698:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787893274.443575:0:18698:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787893274.443576:0:18698:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787893274.443577:0:18698:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787893274.443578:0:18698:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787893274.443579:0:18698:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787893274.443581:0:18698:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787893274.443582:0:18698:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787893274.443586:0:18698:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1787893274.443588:0:18698:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787893274.443589:0:18698:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787893274.443590:0:18698:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787893274.443591:0:18698:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787893274.443593:0:18698:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787893274.443594:0:18698:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787893274.443595:0:18698:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787893274.443596:0:18698:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787893274.443597:0:18698:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787893274.443633:0:18698:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787893274.443726:0:18698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe34b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:18698:1874741493425280:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787893274.443982:0:18698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893274.444040:0:18698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c51839c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787893274.444530:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493425280 00000100:00100000:3.0:1787893274.444539:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493425280 00000100:00100000:3.0:1787893274.444597:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787893274.444606:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd2aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+18:18698:x1874741493425280:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787893274.444638:0:17175:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787893274.444641:0:17175:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1787893274.444644:0:17175:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787893274.445150:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd2aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+18:18698:x1874741493425280:12345-0@lo:253:mount.lustre.0 Request processed in 544us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893274.445159:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787893274.445230:0:18698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe34b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:18698:1874741493425280:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787893274.445243:0:18698:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787893274.445246:0:18698:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787893274.445247:0:18698:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787893274.445248:0:18698:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787893274.445259:0:18698:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787893274.445261:0:18698:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787893274.445263:0:18698:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787893274.445265:0:18698:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787893274.445266:0:18698:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787893274.445267:0:18698:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787893274.445288:0:18698:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fc8c8410800 from lustre-OST0000 10000000:01000000:2.0:1787893274.445646:0:18698:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787893274.445650:0:18698:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787893274.445900:0:18698:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fc8c7730000 local copy 00010000:00010000:2.0:1787893274.445912:0:18698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c800/0x9232577658cf1d08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1d0f expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893274.446038:0:18698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe34b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:18698:1874741493425408:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787893274.446082:0:18698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893274.446122:0:18698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c5183780 going to sleep for 11 seconds 00000100:00100000:0.0:1787893274.447020:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493425408 00000100:00100000:0.0:1787893274.447031:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493425408 00000100:00100000:0.0:1787893274.447087:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787893274.447097:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+18:18698:x1874741493425408:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787893274.447204:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+18:18698:x1874741493425408:12345-0@lo:501:mount.lustre.0 Request processed in 108us (1120us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787893274.447222:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787893274.447270:0:18698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe34b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:18698:1874741493425408:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787893274.447289:0:18698:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.135@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787893274.447321:0:18698:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.135@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787893274.447330:0:18698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c800/0x9232577658cf1d08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1d0f expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893274.447341:0:18698:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c800/0x9232577658cf1d08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1d0f expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893274.447370:0:18698:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fc8c8410800 10000000:01000000:2.0:1787893274.447375:0:18698:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787893274.447381:0:18698:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787893274.447384:0:18698:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787893274.447388:0:18698:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787893274.447392:0:18698:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787893274.447424:0:18698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153800/0x9232577658cf1f5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893274.447432:0:18698:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153800/0x9232577658cf1f5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893274.447441:0:18698:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153800/0x9232577658cf1f5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893274.447456:0:18698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe34b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:18698:1874741493425536:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787893274.447485:0:18698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893274.447551:0:18698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c5183780 going to sleep for 11 seconds 00000100:00100000:3.0:1787893274.447621:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493425536 00000100:00100000:3.0:1787893274.447626:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493425536 00000100:00100000:3.0:1787893274.447670:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787893274.447678:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+18:18698:x1874741493425536:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787893274.447695:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893274.447715:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c84f6c00/0x9232577658cf1f62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf1f5b expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893274.447738:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c84f6c00/0x9232577658cf1f62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf1f5b expref: 19 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893274.447748:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c84f6c00/0x9232577658cf1f62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf1f5b expref: 19 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893274.447757:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c84f6c00, rc 0) 00000100:00100000:3.0:1787893274.448044:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+19:18698:x1874741493425536:12345-0@lo:101:mount.lustre.0 Request processed in 120us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893274.448052:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787893274.448154:0:18698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe34b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:18698:1874741493425536:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787893274.448167:0:18698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153800/0x9232577658cf1f5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1f62 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893274.448177:0:18698:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153800/0x9232577658cf1f5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf1f62 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787893274.449771:0:18698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787893274.451969:0:18698:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787893274.457956:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787893274.458013:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787893274.458039:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787893274.458069:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787893274.458083:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787893274.458096:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787893274.458119:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787893274.458124:0:18698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787893274.460428:0:18698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:18698:1874741493425664:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787893274.462181:0:18698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893274.462231:0:18698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c8534b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787893274.462361:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493425664 00000100:00100000:0.0:1787893274.462371:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493425664 00000100:00100000:0.0:1787893274.462437:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787893274.462446:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+19:18698:x1874741493425664:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787893274.462648:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+19:18698:x1874741493425664:12345-0@lo:501:mount.lustre.0 Request processed in 202us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893274.462656:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787893274.463817:0:18698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:18698:1874741493425664:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787893274.463872:0:18698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:18698:1874741493425792:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787893274.463966:0:18698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893274.464003:0:18698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c8534b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787893274.464019:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493425792 00000100:00100000:2.0:1787893274.464024:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493425792 00000100:00100000:2.0:1787893274.464071:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787893274.464081:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+19:18698:x1874741493425792:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787893274.465048:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+19:18698:x1874741493425792:12345-0@lo:503:mount.lustre.0 Request processed in 964us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893274.465057:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787893274.465241:0:18698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:18698:1874741493425792:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787893274.465746:0:18698:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787893274.465847:0:18698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:18698:1874741493425920:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787893274.465892:0:18698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893274.465933:0:18698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d90b9600 going to sleep for 11 seconds 00000100:00100000:3.0:1787893274.466004:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493425920 00000100:00100000:3.0:1787893274.466010:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493425920 00000100:00100000:3.0:1787893274.466053:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787893274.466061:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+19:18698:x1874741493425920:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787893274.466548:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+19:18698:x1874741493425920:12345-0@lo:502:mount.lustre.0 Request processed in 486us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893274.466556:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787893274.466650:0:18698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:18698:1874741493425920:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787893274.466868:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1787893274.466896:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1787893274.466908:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1787893274.466918:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1787893274.466928:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1787893274.466940:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1787893274.466953:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1787893274.466964:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1787893274.466975:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1787893274.466985:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1787893274.466994:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1787893274.467016:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1787893274.467041:0:18698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:18698:1874741493426048:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787893274.467077:0:18698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893274.467111:0:18698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d90b9600 going to sleep for 11 seconds 00000100:00100000:2.0:1787893274.467180:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493426048 00000100:00100000:2.0:1787893274.467186:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493426048 00000100:00100000:2.0:1787893274.467227:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787893274.467235:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+19:18698:x1874741493426048:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787893274.467334:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+19:18698:x1874741493426048:12345-0@lo:502:mount.lustre.0 Request processed in 99us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893274.467341:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787893274.467378:0:18698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:18698:1874741493426048:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787893274.467415:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1787893274.467422:0:18698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1787893274.468235:0:18715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787893274.468245:0:18715:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1787893274.468252:0:18715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893274.468255:0:18715:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787893274.468260:0:18715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787893274.468286:0:18715:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9fc8c74c3370) 00000020:00000080:0.0:1787893274.468310:0:18715:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787893274.468317:0:18715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787893274.468398:0:18715:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc8c8410800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787893274.468406:0:18715:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787893274.468415:0:18715:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9232577658cf1f70 00010000:00010000:0.0:1787893274.474855:0:18715:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1787893274.478426:0:18715:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:0.0:1787893274.481215:0:18715:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1787893274.488067:0:18715:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787893274.488080:0:18715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787893274.488086:0:18715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893274.488089:0:18715:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787893274.488092:0:18715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787893274.488095:0:18715:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:0.0:1787893274.488097:0:18715:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787893274.488098:0:18715:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787893274.488100:0:18715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787893274.488102:0:18715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893274.488111:0:18715:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787893274.488115:0:18715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787893274.488118:0:18715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893274.488120:0:18715:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787893274.488122:0:18715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787893274.488124:0:18715:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787893274.488126:0:18715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787893274.488128:0:18715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893274.488130:0:18715:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787893274.488132:0:18715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787893274.488134:0:18715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893274.488136:0:18715:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787893274.488139:0:18715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787893274.488171:0:18715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787893274.488174:0:18715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893274.488176:0:18715:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787893274.488178:0:18715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1787893274.488351:0:18698:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1787893274.488381:0:18698:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787893274.488414:0:18698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153800/0x9232577658cf1f5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1f62 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893274.488426:0:18698:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153800/0x9232577658cf1f5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1f62 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893274.488435:0:18698:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc8c8410800 from 1 10000000:01000000:2.0:1787893274.488438:0:18698:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787893274.488473:0:18698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c4152800/0x9232577658cf1f77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893274.488481:0:18698:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9c4152800/0x9232577658cf1f77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893274.488523:0:18698:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9c4152800/0x9232577658cf1f77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893274.488550:0:18698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe349f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:18698:1874741493426176:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787893274.488625:0:18698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893274.488666:0:18698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d5df4240 going to sleep for 11 seconds 00000100:00100000:0.0:1787893274.488760:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493426176 00000100:00100000:0.0:1787893274.488768:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493426176 00000100:00100000:0.0:1787893274.488808:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787893274.488817:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+19:18698:x1874741493426176:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787893274.488831:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893274.488844:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9dd69da00/0x9232577658cf1f7e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf1f77 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893274.488866:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9dd69da00/0x9232577658cf1f7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf1f77 expref: 20 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893274.488877:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9dd69da00/0x9232577658cf1f7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf1f77 expref: 20 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893274.488885:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9dd69da00, rc 0) 00000100:00100000:0.0:1787893274.488934:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+20:18698:x1874741493426176:12345-0@lo:101:mount.lustre.0 Request processed in 118us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893274.488943:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787893274.489041:0:18698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe349f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:18698:1874741493426176:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787893274.489054:0:18698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9c4152800/0x9232577658cf1f77 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1f7e expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893274.489064:0:18698:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9c4152800/0x9232577658cf1f77 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf1f7e expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787893274.490279:0:18698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787893274.490575:0:18698:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787893274.491008:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787893274.491039:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787893274.491058:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787893274.491064:0:18698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787893274.491137:0:18698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe349f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:18698:1874741493426304:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787893274.491211:0:18698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893274.491245:0:18698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fe374480 going to sleep for 11 seconds 00000100:00100000:3.0:1787893274.491371:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493426304 00000100:00100000:3.0:1787893274.491378:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493426304 00000100:00100000:3.0:1787893274.491427:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787893274.491438:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+20:18698:x1874741493426304:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787893274.491576:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+20:18698:x1874741493426304:12345-0@lo:501:mount.lustre.0 Request processed in 139us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893274.491583:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787893274.491880:0:18698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe349f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:18698:1874741493426304:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787893274.491912:0:18698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe349f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:18698:1874741493426432:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787893274.491954:0:18698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893274.491973:0:18698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fe374480 going to sleep for 11 seconds 00000100:00100000:3.0:1787893274.493748:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493426432 00000100:00100000:3.0:1787893274.493769:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493426432 00000100:00100000:3.0:1787893274.493823:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787893274.493832:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+20:18698:x1874741493426432:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787893274.493974:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+20:18698:x1874741493426432:12345-0@lo:503:mount.lustre.0 Request processed in 142us (2019us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893274.493982:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787893274.494057:0:18698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe349f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:18698:1874741493426432:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787893274.494474:0:18698:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787893274.494596:0:18698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8507800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:18698:1874741493426560:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787893274.494640:0:18698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893274.494670:0:18698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c2f53240 going to sleep for 11 seconds 00000100:00100000:3.0:1787893274.494699:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493426560 00000100:00100000:3.0:1787893274.494704:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493426560 00000100:00100000:3.0:1787893274.494726:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787893274.494733:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+20:18698:x1874741493426560:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787893274.494820:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+20:18698:x1874741493426560:12345-0@lo:502:mount.lustre.0 Request processed in 87us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893274.494827:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787893274.494866:0:18698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8507800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:18698:1874741493426560:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787893274.495051:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787893274.495076:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787893274.495092:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787893274.495109:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787893274.495143:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787893274.495161:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787893274.495178:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787893274.495194:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1787893274.495221:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787893274.495238:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1787893274.495253:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1787893274.495275:0:18698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8507800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:18698:1874741493426688:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787893274.495311:0:18698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893274.495327:0:18698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c2f53240 going to sleep for 11 seconds 00000100:00100000:3.0:1787893274.495342:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493426688 00000100:00100000:3.0:1787893274.495346:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493426688 00000100:00100000:3.0:1787893274.495365:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787893274.495372:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+20:18698:x1874741493426688:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787893274.495438:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+20:18698:x1874741493426688:12345-0@lo:502:mount.lustre.0 Request processed in 66us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893274.495445:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787893274.495480:0:18698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8507800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:18698:1874741493426688:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787893274.495536:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1787893274.495544:0:18698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787893274.495948:0:18719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787893274.495956:0:18719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893274.495958:0:18719:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787893274.495964:0:18719:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc8c8410800 00000020:00000080:3.0:1787893274.495966:0:18719:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787893274.495973:0:18719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787893274.495975:0:18719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893274.495976:0:18719:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787893274.495978:0:18719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787893274.495980:0:18719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893274.495981:0:18719:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787893274.495984:0:18719:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc8c8410800 00000020:00000080:3.0:1787893274.495986:0:18719:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787893274.496044:0:18719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787893274.502752:0:18719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893274.502758:0:18719:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787893274.502769:0:18719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787893274.502776:0:18719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893274.502778:0:18719:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787893274.502785:0:18719:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc8c8410800 00000020:00000080:3.0:1787893274.502788:0:18719:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787893274.502855:0:18719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787893274.502859:0:18719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893274.502860:0:18719:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787893274.502863:0:18719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787893274.502865:0:18719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893274.502866:0:18719:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787893274.502869:0:18719:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc8c8410800 00000020:00000080:3.0:1787893274.502872:0:18719:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787893274.502910:0:18719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787893274.502914:0:18719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893274.502916:0:18719:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787893274.502919:0:18719:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1787893274.504731:0:18698:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1787893274.504773:0:18698:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787893274.504799:0:18698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c4152800/0x9232577658cf1f77 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1f7e expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893274.504813:0:18698:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9c4152800/0x9232577658cf1f77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1f7e expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893274.504875:0:18698:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787893274.504879:0:18698:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fc8c8410800 10000000:01000000:1.0:1787893274.504881:0:18698:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fc8c8410800 10000000:01000000:1.0:1787893274.504885:0:18698:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787893274.504891:0:18698:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc8c8410800 from 1 10000000:01000000:1.0:1787893274.504893:0:18698:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787893274.504928:0:18698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540800/0x9232577658cf1f85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893274.504936:0:18698:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540800/0x9232577658cf1f85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893274.504954:0:18698:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540800/0x9232577658cf1f85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893274.504977:0:18698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:18698:1874741493426816:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787893274.505042:0:18698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893274.505078:0:18698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c85343c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787893274.510666:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493426816 00000100:00100000:3.0:1787893274.510679:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493426816 00000100:00100000:3.0:1787893274.510752:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787893274.510763:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+20:18698:x1874741493426816:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787893274.510780:0:17177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893274.510799:0:17177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c84f7c00/0x9232577658cf1f8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf1f85 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893274.510830:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c84f7c00/0x9232577658cf1f8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf1f85 expref: 21 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893274.510841:0:17177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c84f7c00/0x9232577658cf1f8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf1f85 expref: 21 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893274.510856:0:17177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c84f7c00, rc 0) 00000100:00100000:3.0:1787893274.510948:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+21:18698:x1874741493426816:12345-0@lo:101:mount.lustre.0 Request processed in 186us (5905us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893274.510956:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787893274.519612:0:18698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:18698:1874741493426816:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787893274.519645:0:18698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540800/0x9232577658cf1f85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1f8c expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893274.519658:0:18698:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540800/0x9232577658cf1f85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf1f8c expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787893274.530653:0:18698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1787893274.530965:0:18698:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787893274.531137:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787893274.531162:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787893274.531178:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787893274.531192:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787893274.531206:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787893274.531219:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787893274.531233:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787893274.531247:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787893274.531260:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787893274.531272:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787893274.531286:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787893274.531300:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787893274.531331:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787893274.531347:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787893274.531359:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787893274.531373:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787893274.531387:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787893274.531398:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787893274.531409:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787893274.531419:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787893274.531431:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787893274.531444:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787893274.531469:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787893274.531482:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787893274.531522:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1787893274.531540:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1787893274.531553:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1787893274.531567:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1787893274.531595:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1787893274.531609:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1787893274.531621:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1787893274.531633:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1787893274.531646:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1787893274.531658:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1787893274.531671:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1787893274.531695:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1787893274.531711:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1787893274.531731:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1787893274.531737:0:18698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1787893274.531816:0:18698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:18698:1874741493426944:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787893274.531885:0:18698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893274.531920:0:18698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c8534b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787893274.532019:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493426944 00000100:00100000:0.0:1787893274.532027:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493426944 00000100:00100000:0.0:1787893274.532073:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787893274.532082:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+21:18698:x1874741493426944:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787893274.532207:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+21:18698:x1874741493426944:12345-0@lo:501:mount.lustre.0 Request processed in 124us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893274.532214:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787893274.532588:0:18698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:18698:1874741493426944:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787893274.532622:0:18698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:18698:1874741493427072:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787893274.532661:0:18698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893274.532766:0:18698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c8534b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787893274.533797:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493427072 00000100:00100000:0.0:1787893274.533807:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493427072 00000100:00100000:0.0:1787893274.533863:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787893274.533873:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+21:18698:x1874741493427072:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787893274.534018:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+21:18698:x1874741493427072:12345-0@lo:503:mount.lustre.0 Request processed in 145us (1355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893274.534025:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787893274.534163:0:18698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:18698:1874741493427072:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787893274.534597:0:18698:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787893274.534669:0:18698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:18698:1874741493427200:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787893274.534721:0:18698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893274.534755:0:18698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c8534b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787893274.538629:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493427200 00000100:00100000:0.0:1787893274.538645:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493427200 00000100:00100000:0.0:1787893274.538723:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787893274.538746:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+21:18698:x1874741493427200:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787893274.538923:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+21:18698:x1874741493427200:12345-0@lo:502:mount.lustre.0 Request processed in 179us (4201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893274.538930:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787893274.539070:0:18698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:18698:1874741493427200:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787893274.539454:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1787893274.539486:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1787893274.539533:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1787893274.539548:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1787893274.539561:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1787893274.539574:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1787893274.539587:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1787893274.539600:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1787893274.539615:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1787893274.539628:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1787893274.539642:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1787893274.539669:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1787893274.539696:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1787893274.539731:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1787893274.539747:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1787893274.539760:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1787893274.539773:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1787893274.539787:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1787893274.541291:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1787893274.541391:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1787893274.541411:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1787893274.541425:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1787893274.541438:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1787893274.541452:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1787893274.541467:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1787893274.541480:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1787893274.541523:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1787893274.541541:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1787893274.541555:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1787893274.541588:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1787893274.541604:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1787893274.541618:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1787893274.541630:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1787893274.541641:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1787893274.542767:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1787893274.543234:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1787893274.543254:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1787893274.543268:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1787893274.543281:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1787893274.543295:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1787893274.543308:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1787893274.543446:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1787893274.543461:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1787893274.543475:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1787893274.543488:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1787893274.543546:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1787893274.543562:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1787893274.543575:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1787893274.543629:0:18698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe348e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:18698:1874741493427328:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787893274.544272:0:18698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893274.544919:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493427328 00000100:00100000:1.0:1787893274.544929:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493427328 00000100:00100000:1.0:1787893274.544981:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787893274.544991:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+21:18698:x1874741493427328:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787893274.545130:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+21:18698:x1874741493427328:12345-0@lo:502:mount.lustre.0 Request processed in 140us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893274.545139:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787893274.545548:0:18698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9edf37240 going to sleep for 11 seconds 00000100:00100000:2.0:1787893274.545574:0:18698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe348e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:18698:1874741493427328:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787893274.546555:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1787893274.546594:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1787893274.546630:0:18698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe348e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:18698:1874741493427456:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787893274.547940:0:18698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893274.547990:0:18698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9edf37240 going to sleep for 11 seconds 00000100:00100000:1.0:1787893274.548086:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493427456 00000100:00100000:1.0:1787893274.548095:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493427456 00000100:00100000:1.0:1787893274.548218:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787893274.548228:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5feec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+21:18698:x1874741493427456:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787893274.548907:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5feec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+21:18698:x1874741493427456:12345-0@lo:502:mount.lustre.0 Request processed in 679us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893274.548916:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787893274.549210:0:18698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe348e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:18698:1874741493427456:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787893274.549288:0:18698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1787893274.549302:0:18698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1787893274.550254:0:18725:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787893274.550270:0:18725:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9fc8c74c0000) 00000020:00000080:0.0:1787893274.550295:0:18725:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1787893274.550391:0:18725:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc8c8410800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787893274.550396:0:18725:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc8c8410800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787893274.550399:0:18725:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc8c8410800 3 00010000:00080000:0.0:1787893274.550437:0:18725:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc8c7c6a000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.135@tcp at head 00010000:00010000:0.0:1787893274.552165:0:18725:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1787893274.552361:0:18725:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787893274.552403:0:18725:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787893274.552416:0:18725:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9232577658cf1f9a 00000100:00080000:0.0:1787893274.552426:0:18725:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787893274.552431:0:18725:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9fc8c7c6a000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:0.0:1787893274.552464:0:18725:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c7ce0000 x1874741493427584/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787893274.552546:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3629:1874741493427584:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787893274.552616:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787893274.568432:0:18725:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787893274.568543:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493427584 00000100:00100000:2.0:1787893274.568554:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493427584 00000100:00100000:2.0:1787893274.568607:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787893274.568615:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3629:x1874741493427584:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787893274.568645:0:17183:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 518 last 0 00000020:00000080:2.0:1787893274.568690:0:17183:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9232577658cf1fa1 00000004:00100000:2.0:1787893274.568706:0:17183:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787893274.568744:0:17183:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7f32800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787893274.568836:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1874741493427584:12345-0@lo:38:llog_process_th.0 Request processed in 221us (16219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893274.568844:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787893274.568888:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc8c7ce0000 x1874741493427584/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787893284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893274.568899:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787893274.568908:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1787893274.568915:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787893274.568920:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787893274.568922:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7c6a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787893274.568928:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3629:1874741493427584:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1787893274.570878:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787893274.570884:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787893274.570886:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787893274.570890:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787893274.570915:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787893274.570919:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787893274.570921:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787893274.570924:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787893274.571026:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8507800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493427712:0@lo:400:kworker.0 00000100:00100000:2.0:1787893274.571090:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893274.571121:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787893274.571127:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493427840:0@lo:400:kworker.0 00000100:00100000:2.0:1787893274.571164:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893274.571197:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493427840 00000100:00100000:2.0:1787893274.571204:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493427840 00000100:00100000:2.0:1787893274.571261:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787893274.571270:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe348e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493427840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893274.571314:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe348e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493427840:12345-0@lo:400:kworker.0 Request processed in 45us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893274.571321:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787893274.571356:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc8c8504e00 x1874741493427840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893274.571367:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493427840:0@lo:400:kworker.0 00000100:00100000:2.0:1787893274.571588:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874741493428096:0@lo:400:kworker.0 00000100:00100000:2.0:1787893274.571616:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893274.571647:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787893274.571653:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493427968:0@lo:400:kworker.0 00000100:00100000:2.0:1787893274.571677:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893274.571751:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493428096 00000100:00100000:0.0:1787893274.571775:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493428096 00000100:00100000:0.0:1787893274.571809:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787893274.571815:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe349f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1874741493428096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893274.571852:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe349f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1874741493428096:12345-0@lo:400:kworker.0 Request processed in 37us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893274.571859:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787893274.571916:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc8c8504000 x1874741493428096/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893274.571926:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874741493428096:0@lo:400:kworker.0 00000100:00100000:0.0:1787893274.572613:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493427712 00000100:00100000:0.0:1787893274.572618:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493427712 00000100:00100000:0.0:1787893274.572654:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493427968 00000100:00100000:0.0:1787893274.572658:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493427968 00000100:00100000:0.0:1787893274.572673:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787893274.572680:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe34aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493427712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893274.572737:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe34aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493427712:12345-0@lo:400:kworker.0 Request processed in 57us (1647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893274.572744:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787893274.572756:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787893274.572762:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe34b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493427968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893274.572794:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe34b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493427968:12345-0@lo:400:kworker.0 Request processed in 31us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893274.572799:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787893274.572865:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493427968:0@lo:400:kworker.0 00000100:00100000:2.0:1787893274.572900:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8507800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493427712:0@lo:400:kworker.0 00000020:01000004:0.0:1787893274.573514:0:18725:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787893274.573529:0:18725:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9fc8c74c4d28) 00000020:00000080:0.0:1787893274.573552:0:18725:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1787893274.573697:0:18725:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc8c8410800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787893274.573701:0:18725:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc8c8410800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787893274.573704:0:18725:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc8c8410800 3 00010000:00080000:1.0:1787893274.573731:0:18725:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc8c7418000@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.135@tcp at head 00010000:00010000:1.0:1787893274.578194:0:18725:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:1.0:1787893274.579157:0:18725:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1787893274.579204:0:18725:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787893274.579216:0:18725:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x9232577658cf1faf 00000100:00080000:1.0:1787893274.579227:0:18725:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787893274.579234:0:18725:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9fc8c7418000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:1.0:1787893274.579268:0:18725:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c64b7800 x1874741493428224/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787893274.579300:0:18725:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1787893274.579677:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3629:1874741493428224:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787893274.579761:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787893274.579932:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787893274.579937:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787893274.579940:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787893274.579943:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787893274.579953:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787893274.579956:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787893274.579959:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787893274.579962:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1787893274.580072:0:18725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1787893274.580130:0:18698:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787893274.580169:0:18698:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787893274.580187:0:18698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540800/0x9232577658cf1f85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1f8c expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893274.580198:0:18698:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540800/0x9232577658cf1f85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1f8c expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787893274.580241:0:18698:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787893274.580243:0:18698:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787893274.580244:0:18698:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787893274.580246:0:18698:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787893274.580247:0:18698:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787893274.580248:0:18698:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787893274.580250:0:18698:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787893274.580252:0:18698:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787893274.580253:0:18698:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787893274.580257:0:18698:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1787893274.580260:0:18698:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787893274.580261:0:18698:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787893274.580262:0:18698:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787893274.580264:0:18698:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787893274.580265:0:18698:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787893274.580266:0:18698:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787893274.580267:0:18698:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787893274.580268:0:18698:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787893274.580269:0:18698:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787893274.580287:0:18698:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787893274.580300:0:18698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:18698:1874741493428352:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787893274.580342:0:18698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893274.580367:0:18698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c68636c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787893274.580369:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493428352 00000100:00100000:1.0:1787893274.580376:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493428352 00000100:00100000:1.0:1787893274.580423:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787893274.580433:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+21:18698:x1874741493428352:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787893274.580459:0:17177:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787893274.580473:0:17177:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787893274.581427:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493428224 00000100:00100000:2.0:1787893274.581435:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493428224 00000100:00100000:2.0:1787893274.581463:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787893274.581469:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7788e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3629:x1874741493428224:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787893274.581508:0:17185:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 518 last 0 00000020:00000080:2.0:1787893274.581545:0:17185:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x9232577658cf1fb6 00000004:00100000:2.0:1787893274.581560:0:17185:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787893274.581592:0:17185:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7f30000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787893274.581650:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7788e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1874741493428224:12345-0@lo:38:llog_process_th.0 Request processed in 179us (1888us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893274.581669:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787893274.581717:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc8c64b7800 x1874741493428224/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787893284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893274.581727:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787893274.581735:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1787893274.581742:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787893274.581747:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787893274.581749:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7418000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787893274.581755:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3629:1874741493428224:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1787893274.583450:0:17177:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787893274.583471:0:17177:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787893274.583767:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+21:18698:x1874741493428352:12345-0@lo:253:mount.lustre.0 Request processed in 3331us (3421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893274.583793:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787893274.584062:0:18698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:18698:1874741493428352:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787893274.584076:0:18698:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787893274.584080:0:18698:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787893274.584081:0:18698:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787893274.584083:0:18698:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787893274.584084:0:18698:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787893274.584086:0:18698:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787893274.584087:0:18698:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787893274.584089:0:18698:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787893274.584091:0:18698:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787893274.584092:0:18698:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787893274.584106:0:18698:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1787893274.584651:0:17199:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787893274.584657:0:17199:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787893274.584677:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fc8c84f7e00/0x9232577658cf1fbd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893274.584702:0:17199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9dd69c800/0x9232577658cf1f07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf1f00 expref: 20 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893274.584711:0:17199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9dd69de00/0x9232577658cf1f15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf1f0e expref: 20 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893274.584720:0:17199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fc8c84f7e00/0x9232577658cf1fbd lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893274.584765:0:17199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9dd69de00/0x9232577658cf1f15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf1f0e expref: 20 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893274.584780:0:17199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc9dd69de00/0x9232577658cf1f15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf1f0e expref: 20 pid: 17177 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893274.584792:0:17199:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8507480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17199:1874741493428480:0@lo:104: 00000100:00100000:3.0:1787893274.584834:0:17199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787893274.584888:0:17199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9dd69c800/0x9232577658cf1f07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf1f00 expref: 20 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893274.584896:0:17199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc9dd69c800/0x9232577658cf1f07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf1f00 expref: 20 pid: 17178 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893274.584905:0:17199:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8506680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17199:1874741493428608:0@lo:104: 00000100:00100000:3.0:1787893274.584929:0:17199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893274.584946:0:17199:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d8c5c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787893274.584967:0:17167:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787893274.584979:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493428480 00000100:00100000:3.0:1787893274.584984:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493428480 00000100:00100000:3.0:1787893274.585011:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493428608 00000100:00100000:3.0:1787893274.585014:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493428608 00000100:00100000:3.0:1787893274.585026:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787893274.585033:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8505500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13b37fca-0eda-4b14-a6ef-4a378c945d17+4:17199:x1874741493428480:12345-0@lo:104: 00010000:00010000:3.0:1787893274.585045:0:17167:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69dc00/0x9232577658cf1f0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf1f15 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893274.585086:0:17167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787893274.585097:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8505500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13b37fca-0eda-4b14-a6ef-4a378c945d17+4:17199:x1874741493428480:12345-0@lo:104: Request processed in 64us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893274.585103:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787893274.585117:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787893274.585124:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5e37850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13b37fca-0eda-4b14-a6ef-4a378c945d17+3:17199:x1874741493428608:12345-0@lo:104: 00010000:00010000:3.0:1787893274.585132:0:17167:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153200/0x9232577658cf1f00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf1f07 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893274.585165:0:17167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787893274.585170:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5e37850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13b37fca-0eda-4b14-a6ef-4a378c945d17+3:17199:x1874741493428608:12345-0@lo:104: Request processed in 47us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893274.585175:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1787893274.585210:0:17172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787893274.585216:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69dc00/0x9232577658cf1f0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf1f15 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893274.585222:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd69dc00 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:3.0:1787893274.585227:0:17172:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69dc00/0x9232577658cf1f0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf1f15 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893274.585234:0:17172:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69dc00/0x9232577658cf1f0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf1f15 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787893274.585241:0:17172:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69dc00/0x9232577658cf1f0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf1f15 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787893274.585246:0:17172:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787893274.585273:0:17172:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69dc00/0x9232577658cf1f0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf1f15 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893274.585287:0:17172:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787893274.585307:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69dc00/0x9232577658cf1f0e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf1f15 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893274.585314:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9dd69dc00/0x9232577658cf1f0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf1f15 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893274.585327:0:17172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787893274.585330:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153200/0x9232577658cf1f00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf1f07 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893274.585335:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c4153200 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:3.0:1787893274.585338:0:17172:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153200/0x9232577658cf1f00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf1f07 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893274.585344:0:17172:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153200/0x9232577658cf1f00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf1f07 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787893274.585350:0:17172:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153200/0x9232577658cf1f00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf1f07 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787893274.585355:0:17172:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787893274.585369:0:17172:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153200/0x9232577658cf1f00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf1f07 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893274.585374:0:17172:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787893274.585381:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153200/0x9232577658cf1f00 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf1f07 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893274.585386:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153200/0x9232577658cf1f00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf1f07 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893274.585406:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893274.585407:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893274.585410:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893274.585416:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893274.585664:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13b37fca-0eda-4b14-a6ef-4a378c945d17:3630:1874741493428736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787893274.585708:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893274.585740:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787893274.585746:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13b37fca-0eda-4b14-a6ef-4a378c945d17:3630:1874741493428864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787893274.585769:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893274.585820:0:17169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493428736 00000100:00100000:3.0:1787893274.585825:0:17169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493428736 00010000:00010000:3.0:1787893274.585843:0:17169:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9dd69de00/0x9232577658cf1f15 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf1f0e expref: 21 pid: 17177 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893274.585865:0:17169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493428864 00000100:00100000:3.0:1787893274.585868:0:17169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493428864 00010000:00010000:3.0:1787893274.585878:0:17169:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9dd69c800/0x9232577658cf1f07 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf1f00 expref: 22 pid: 17178 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893274.585890:0:17169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787893274.585896:0:17169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8505500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:13b37fca-0eda-4b14-a6ef-4a378c945d17+22:3630:x1874741493428736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787893274.585907:0:17169:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893274.585913:0:17169:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9dd69de00/0x9232577658cf1f15 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf1f0e expref: 22 pid: 17177 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893274.585923:0:17169:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9dd69de00/0x9232577658cf1f15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf1f0e expref: 22 pid: 17177 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893274.585947:0:17169:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893274.585975:0:17169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8505500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:13b37fca-0eda-4b14-a6ef-4a378c945d17+22:3630:x1874741493428736:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893274.585982:0:17169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787893274.585995:0:17169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787893274.586001:0:17169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c702e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:13b37fca-0eda-4b14-a6ef-4a378c945d17+21:3630:x1874741493428864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787893274.586009:0:17169:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893274.586013:0:17169:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9dd69c800/0x9232577658cf1f07 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf1f00 expref: 21 pid: 17178 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893274.586021:0:17169:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9dd69c800/0x9232577658cf1f07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf1f00 expref: 21 pid: 17178 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893274.586033:0:17169:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fc8c84f7e00/0x9232577658cf1fbd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893274.586041:0:17169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c84f7e00/0x9232577658cf1fbd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787893274.586052:0:17169:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.028463491s 00010000:00010000:3.0:1787893274.586056:0:17169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc8c84f7e00/0x9232577658cf1fbd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893274.586063:0:17169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc8c84f7e00/0x9232577658cf1fbd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893274.586070:0:17169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fc8c84f7e00/0x9232577658cf1fbd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893274.586085:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fc8c84f7e00/0x9232577658cf1fbd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893274.586090:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c84f7e00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:3.0:1787893274.586094:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fc8c84f7e00/0x9232577658cf1fbd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893274.586101:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fc8c84f7e00/0x9232577658cf1fbd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893274.586108:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fc8c84f7e00/0x9232577658cf1fbd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893274.586116:0:17169:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893274.586136:0:17169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c702e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:13b37fca-0eda-4b14-a6ef-4a378c945d17+21:3630:x1874741493428864:12345-0@lo:103:ldlm_bl.0 Request processed in 135us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893274.586142:0:17169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787893274.586200:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13b37fca-0eda-4b14-a6ef-4a378c945d17:3630:1874741493428864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787893274.586208:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13b37fca-0eda-4b14-a6ef-4a378c945d17:3630:1874741493428736:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787893274.586231:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9dd69de00/0x9232577658cf1f15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf1f0e expref: 20 pid: 17177 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893274.586240:0:17199:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8507480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17199:1874741493428480:0@lo:104: 00010000:00010000:3.0:1787893274.586249:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9dd69c800/0x9232577658cf1f07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf1f00 expref: 19 pid: 17178 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893274.586256:0:17199:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8506680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17199:1874741493428608:0@lo:104: 00010000:00010000:3.0:1787893274.586273:0:17199:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fc8c84f7e00/0x9232577658cf1fbd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893274.586281:0:17199:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fc8c84f7e00/0x9232577658cf1fbd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893274.586288:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fc8c84f7e00/0x9232577658cf1fbd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893274.586294:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c84f7e00/0x9232577658cf1fbd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:2.0:1787893274.590695:0:18698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1787893274.595031:0:18698:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787893274.595039:0:18698:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787893274.595077:0:18698:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787893274.595120:0:18698:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.135@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787893274.595136:0:18698:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787893274.595158:0:18698:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1787893274.598203:0:18698:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787893274.600911:0:18698:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787893274.802165:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493428992:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787893274.802235:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893274.802272:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787893274.802278:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493429120:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787893274.802298:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893274.802413:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493428992 00000100:00100000:2.0:1787893274.802420:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493428992 00000100:00100000:2.0:1787893274.802456:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493429120 00000100:00100000:2.0:1787893274.802458:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493429120 00000100:00100000:2.0:1787893274.802476:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787893274.802484:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c778ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493428992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787893274.802591:0:17189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787893274.802635:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c778ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493428992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 150us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893274.802642:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787893274.802660:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787893274.802667:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7788700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493429120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787893274.802695:0:17189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787893274.802896:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7788700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493429120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 229us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893274.802903:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787893274.803021:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493429120:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787893274.803044:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493428992:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787893275.132754:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787893275.421626:0:18779:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787893275.421857:0:18779:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1787893276.094942:0:17180:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787893276.094951:0:17180:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc9ffb45000 from 9 10000000:01000000:2.0:1787893276.094956:0:17180:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787893276.095001:0:17180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c4152a00/0x9232577658cf1fc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893276.095013:0:17180:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9c4152a00/0x9232577658cf1fc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893276.095024:0:17180:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9c4152a00/0x9232577658cf1fc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893276.095049:0:17180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c778b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493429248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787893276.095114:0:17180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893276.095163:0:17180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d29e09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787893276.095314:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493429248 00000100:00100000:3.0:1787893276.095323:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493429248 00000100:00100000:3.0:1787893276.095378:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787893276.095388:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+19:17180:x1874741493429248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787893276.095400:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893276.095413:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c84f7e00/0x9232577658cf1fcb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf1fc4 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893276.095436:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c84f7e00/0x9232577658cf1fcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf1fc4 expref: 20 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893276.095446:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c84f7e00/0x9232577658cf1fcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf1fc4 expref: 20 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893276.095456:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c84f7e00, rc 0) 00000100:00100000:3.0:1787893276.095516:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+20:17180:x1874741493429248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893276.095527:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787893276.095570:0:17180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c778b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493429248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787893276.095584:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9c4152a00/0x9232577658cf1fc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1fcb expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893276.095593:0:17180:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9c4152a00/0x9232577658cf1fc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf1fcb expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893276.095635:0:17180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8504700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493429376:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787893276.095662:0:17180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893276.095690:0:17180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d8c5c540 going to sleep for 11 seconds 00000100:00100000:3.0:1787893276.095702:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493429376 00000100:00100000:3.0:1787893276.095705:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493429376 00000100:00100000:3.0:1787893276.095725:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787893276.095731:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+20:17180:x1874741493429376:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787893276.095744:0:17177:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787893276.095758:0:17177:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787893276.095761:0:17177:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1787893276.095961:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+20:17180:x1874741493429376:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 228us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893276.095967:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787893276.095993:0:17180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8504700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493429376:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787893276.096043:0:17180:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787893276.096049:0:17180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c4152a00/0x9232577658cf1fc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1fcb expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893276.096066:0:17180:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9c4152a00/0x9232577658cf1fc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1fcb expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787893276.096075:0:17180:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787893276.096077:0:17180:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc9d0f72800 from 9 10000000:01000000:3.0:1787893276.096080:0:17180:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787893276.096095:0:17180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6000/0x9232577658cf1fd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893276.096103:0:17180:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6000/0x9232577658cf1fd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893276.096110:0:17180:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6000/0x9232577658cf1fd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893276.096121:0:17180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8504700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493429504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787893276.096157:0:17180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893276.096169:0:17180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d8c5c540 going to sleep for 11 seconds 00000100:00100000:3.0:1787893276.096211:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493429504 00000100:00100000:3.0:1787893276.096214:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493429504 00000100:00100000:3.0:1787893276.096234:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787893276.096240:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+20:17180:x1874741493429504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787893276.096248:0:17177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893276.096256:0:17177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c84f7600/0x9232577658cf1fd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf1fd2 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893276.096271:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c84f7600/0x9232577658cf1fd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf1fd2 expref: 21 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893276.096290:0:17177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c84f7600/0x9232577658cf1fd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf1fd2 expref: 21 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893276.096412:0:17177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c84f7600, rc 0) 00000100:00100000:3.0:1787893276.096440:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+21:17180:x1874741493429504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893276.096446:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787893276.096553:0:17180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8504700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493429504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787893276.096563:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6000/0x9232577658cf1fd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1fd9 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893276.096572:0:17180:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6000/0x9232577658cf1fd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf1fd9 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893276.096606:0:17180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8504700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493429632:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787893276.096633:0:17180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893276.096645:0:17180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d8c5c540 going to sleep for 11 seconds 00000100:00100000:3.0:1787893276.096656:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493429632 00000100:00100000:3.0:1787893276.096659:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493429632 00000100:00100000:3.0:1787893276.096692:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787893276.096698:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+21:17180:x1874741493429632:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787893276.096708:0:17177:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787893276.096718:0:17177:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787893276.096721:0:17177:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1787893276.096775:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+21:17180:x1874741493429632:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 76us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893276.097213:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787893276.097250:0:17180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8504700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493429632:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787893276.097307:0:17180:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787893276.097315:0:17180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6000/0x9232577658cf1fd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1fd9 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893276.097322:0:17180:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6000/0x9232577658cf1fd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1fd9 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893276.146591:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787893276.659797:0:17220:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787893277.171997:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893278.193647:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893279.224879:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893279.923085:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7789880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493429760:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787893279.923163:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893279.923225:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493429760 00000100:00100000:2.0:1787893279.923232:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493429760 00000100:00100000:2.0:1787893279.923277:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787893279.923286:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7788000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493429760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787893279.923331:0:17189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787893279.924535:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7788000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493429760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1245us (1367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893279.924547:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787893279.924609:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7789880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493429760:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1787893279.924905:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787893279.924910:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787893279.924912:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787893279.924915:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787893279.924925:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787893279.924928:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787893279.924931:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787893279.924934:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787893279.924982:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874741493430272:0@lo:400:kworker.0 00000100:00100000:1.0:1787893279.925023:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893279.925047:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787893279.925052:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13b37fca-0eda-4b14-a6ef-4a378c945d17:3630:1874741493429888:0@lo:400:kworker.0 00000100:00100000:1.0:1787893279.925078:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893279.925101:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493430400:0@lo:400:kworker.0 00000100:00100000:1.0:1787893279.925122:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893279.925143:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493430016:0@lo:400:kworker.0 00000100:00100000:1.0:1787893279.925183:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893279.925199:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493430528:0@lo:400:kworker.0 00000100:00100000:1.0:1787893279.925221:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893279.925238:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787893279.925242:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493430144:0@lo:400:kworker.0 00000100:00100000:1.0:1787893279.925258:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893279.925284:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493430272 00000100:00100000:1.0:1787893279.925289:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493430272 00000100:00100000:1.0:1787893279.925316:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493430400 00000100:00100000:1.0:1787893279.925319:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493430400 00000100:00100000:1.0:1787893279.925336:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493430528 00000100:00100000:1.0:1787893279.925338:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493430528 00000100:00100000:1.0:1787893279.925430:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493430144 00000100:00100000:1.0:1787893279.925434:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493430144 00000100:00100000:1.0:1787893279.925450:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787893279.925457:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874741493430272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893279.925522:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874741493430272:12345-0@lo:400:kworker.0 Request processed in 65us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893279.925530:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787893279.925546:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787893279.925553:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493430400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893279.925579:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493430400:12345-0@lo:400:kworker.0 Request processed in 28us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893279.925586:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787893279.925597:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787893279.925603:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493430528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893279.925642:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493430528:12345-0@lo:400:kworker.0 Request processed in 31us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893279.925654:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787893279.925667:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787893279.925673:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493430144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893279.925701:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493430144:12345-0@lo:400:kworker.0 Request processed in 28us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893279.925706:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787893279.925725:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493429888 00000100:00100000:1.0:1787893279.925730:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493429888 00000100:00100000:1.0:1787893279.925756:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787893279.925761:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+21:3630:x1874741493429888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893279.925789:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+21:3630:x1874741493429888:12345-0@lo:400:kworker.0 Request processed in 27us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893279.925795:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787893279.926487:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493430016 00000100:00100000:1.0:1787893279.926518:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493430016 00000100:00100000:1.0:1787893279.926552:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787893279.926560:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493430016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893279.926602:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493430016:12345-0@lo:400:kworker.0 Request processed in 43us (1418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893279.926608:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1787893279.926645:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787893279.926650:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787893279.926685:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c64b6a00 x1874741493430144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893279.926699:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493430144:0@lo:400:kworker.0 00000100:00100000:1.0:1787893279.926725:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493430016:0@lo:400:kworker.0 00010000:00080000:1.0:1787893279.926736:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c64b5500 x1874741493430528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893279.926745:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493430528:0@lo:400:kworker.0 00000100:00100000:1.0:1787893279.926781:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13b37fca-0eda-4b14-a6ef-4a378c945d17:3630:1874741493429888:0@lo:400:kworker.0 00010000:00080000:1.0:1787893279.926793:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c64b7100 x1874741493430400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893279.926962:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493430656:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787893279.926999:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893279.927035:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493430656 00000100:00100000:0.0:1787893279.927040:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493430656 00000100:00100000:0.0:1787893279.927064:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787893279.927072:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493430656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787893279.927096:0:18203:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787893279.927135:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493430656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893279.927142:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787893279.927173:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493430656:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787893279.927436:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493430400:0@lo:400:kworker.0 00010000:00080000:1.0:1787893279.927454:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c64b4700 x1874741493430272/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893279.927463:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874741493430272:0@lo:400:kworker.0 00010000:00010000:0.0:1787893280.249031:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787893281.074244:0:17937:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:0.0:1787893281.261884:0:19069:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg235-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787893281.268199:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787893282.118227:0:19121:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787893282.118392:0:19121:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787893282.297807:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787893282.964386:0:19171:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787893282.964796:0:19171:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787893283.313788:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893284.339861:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893284.851347:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787893269/real 1787893269] req@ffff9fc9fe34ad80 x1874741493425024/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893284 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893284.851390:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc9fe34ad80 x1874741493425024/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893284 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893284.851404:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787893269/real 1787893269] req@ffff9fc9fe34b800 x1874741493425152/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893284 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893284.851416:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc9fe34b800 x1874741493425152/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893284 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787893284.851445:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9c3ea8000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787893284.851474:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787893284.851479:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe34ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493425024:0@lo:8:kworker.0 00000100:00080000:3.0:1787893284.851665:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9d29e9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787893284.851673:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787893284.851676:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe34b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493425152:0@lo:8:kworker.0 00000100:00100000:1.0:1787893284.851959:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13b37fca-0eda-4b14-a6ef-4a378c945d17:3630:1874741493430784:0@lo:400:kworker.0 00000100:00100000:1.0:1787893284.852117:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893284.852208:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493430784 00000100:00100000:1.0:1787893284.852219:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493430784 00000100:00100000:1.0:1787893284.852276:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787893284.852285:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+21:3630:x1874741493430784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893284.852345:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+21:3630:x1874741493430784:12345-0@lo:400:kworker.0 Request processed in 60us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893284.852352:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787893284.852404:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13b37fca-0eda-4b14-a6ef-4a378c945d17:3630:1874741493430784:0@lo:400:kworker.0 00000100:00080000:1.0:1787893284.852440:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787893284.852444:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787893284.852448:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787893284.852451:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787893284.852459:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493430912:0@lo:400:kworker.0 00000100:00100000:1.0:1787893284.852514:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893284.852547:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493430912 00000100:00100000:1.0:1787893284.852551:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493430912 00000100:00100000:1.0:1787893284.852580:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787893284.852587:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493430912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893284.852636:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493430912:12345-0@lo:400:kworker.0 Request processed in 50us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893284.852643:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787893284.852673:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493430912:0@lo:400:kworker.0 00000100:00080000:1.0:1787893284.852708:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787893284.852712:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787893284.852715:0:38:0:(import.c:65:import_set_state_nolock()) ffff9fc9c3ea8000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787893284.852719:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 513 00000100:00080000:1.0:1787893284.852725:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787893284.852730:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9fc9c3ea8000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:1.0:1787893284.852752:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c64b5500 x1874741493431296/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787893284.852767:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787893284.852777:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787893284.852779:0:38:0:(import.c:65:import_set_state_nolock()) ffff9fc9d29e9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787893284.852783:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 513 00000100:00080000:1.0:1787893284.852786:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787893284.852789:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9fc9d29e9000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:1.0:1787893284.852800:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493431296:0@lo:8:kworker.0 00000100:00100000:1.0:1787893284.852833:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893284.852875:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c64b6a00 x1874741493431424/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787893284.852894:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493431424:0@lo:8:kworker.0 00000100:00100000:1.0:1787893284.852921:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893284.852962:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874741493431552:0@lo:400:kworker.0 00000100:00100000:1.0:1787893284.852992:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893284.853021:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493431552 00000100:00100000:1.0:1787893284.853025:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493431552 00000100:00100000:2.0:1787893284.853166:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493431296 00000100:00100000:2.0:1787893284.853171:0:18702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493431296 00000100:00100000:2.0:1787893284.853192:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493431424 00000100:00100000:2.0:1787893284.853195:0:18702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493431424 00000100:00100000:2.0:1787893284.853206:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787893284.853211:0:18702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3629:x1874741493431296:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787893284.853243:0:18702:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 528 last 0 00000020:00000080:2.0:1787893284.853284:0:18702:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9232577658cf1fe0 00002000:00100000:2.0:1787893284.853302:0:18702:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9fc8c7f33000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1787893284.853307:0:18702:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1787893284.853311:0:18702:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787893284.853586:0:18702:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1787893284.853631:0:18702:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7f34000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787893284.853685:0:18702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3629:x1874741493431296:12345-0@lo:8:kworker.0 Request processed in 472us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893284.853693:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787893284.853711:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787893284.853715:0:18702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3629:x1874741493431424:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787893284.853730:0:18702:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787893284.855178:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787893284.855201:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874741493431552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893284.855292:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874741493431552:12345-0@lo:400:kworker.0 Request processed in 101us (2298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893284.855300:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1787893284.855375:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c64b4000 x1874741493431552/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893284.855391:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874741493431552:0@lo:400:kworker.0 00010000:00080000:1.0:1787893284.855426:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c64b5500 x1874741493431296/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787893304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893284.855456:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787893284.855466:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1787893284.855476:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787893284.855482:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787893284.855485:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9c3ea8000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787893284.855516:0:3629:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787893284.855523:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493431296:0@lo:8:kworker.0 00000100:00100000:1.0:1787893284.855581:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1874741493431680:0@lo:400:kworker.0 00000100:00100000:1.0:1787893284.855633:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893284.855671:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493431680 00000100:00100000:1.0:1787893284.855679:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493431680 00000100:00100000:1.0:1787893284.855726:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787893284.855733:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3631:x1874741493431680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893284.855769:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3631:x1874741493431680:12345-0@lo:400:kworker.0 Request processed in 36us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893284.855775:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1787893284.855791:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787893284.855808:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c76f7800 x1874741493431680/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893284.855818:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1874741493431680:0@lo:400:kworker.0 00000100:00100000:0.0:1787893284.857171:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493431040:0@lo:400:kworker.0 00000100:00100000:0.0:1787893284.857234:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893284.857275:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493431808:0@lo:400:kworker.0 00000100:00100000:0.0:1787893284.857305:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893284.857336:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787893284.857343:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493431168:0@lo:400:kworker.0 00000100:00100000:0.0:1787893284.857370:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893284.857410:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493431168 00000100:00100000:0.0:1787893284.857417:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493431168 00000100:00100000:0.0:1787893284.857463:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787893284.857473:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493431168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893284.857554:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493431168:12345-0@lo:400:kworker.0 Request processed in 82us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893284.857562:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787893284.857585:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493431040 00000100:00100000:0.0:1787893284.857602:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493431040 00000100:00100000:0.0:1787893284.857626:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493431808 00000100:00100000:0.0:1787893284.857629:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493431808 00000100:00100000:0.0:1787893284.857655:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787893284.857661:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493431040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893284.857696:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493431040:12345-0@lo:400:kworker.0 Request processed in 35us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893284.857703:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787893284.857715:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787893284.857722:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493431808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893284.857750:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493431808:12345-0@lo:400:kworker.0 Request processed in 29us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893284.857772:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1787893284.857789:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787893284.857821:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493431168:0@lo:400:kworker.0 00010000:00080000:0.0:1787893284.857835:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c64b4700 x1874741493431040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893284.857847:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493431040:0@lo:400:kworker.0 00010000:00080000:0.0:1787893284.857857:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c76f7800 x1874741493431808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893284.857866:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493431808:0@lo:400:kworker.0 00000004:00080000:3.0:1787893284.858326:0:17925:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1787893284.858357:0:17925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8504a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17925:1874741493432064:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1787893284.858402:0:17925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893284.858425:0:17925:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9edf37c00 going to sleep for 11 seconds 00000004:00080000:3.0:1787893284.858443:0:17924:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787893284.858618:0:17924:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 528680126178ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787893284.858627:0:17924:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1787893284.858851:0:18704:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787893284.858859:0:18704:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787893284.859008:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787893284.859022:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493431936:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787893284.859059:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893284.859100:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493431936 00000100:00100000:3.0:1787893284.859106:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493431936 00000100:00100000:3.0:1787893284.859161:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787893284.859171:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8506680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3632:x1874741493431936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787893284.859202:0:18705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787893284.859248:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8506680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3632:x1874741493431936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893284.859255:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787893284.859290:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c8504700 x1874741493431936/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893300 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893284.859307:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493431936:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787893284.859354:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493432064 00000100:00100000:3.0:1787893284.859358:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493432064 00000100:00100000:3.0:1787893284.859455:0:19239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787893284.859462:0:19239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17925:x1874741493432064:12345-0@lo:7:osp-pre-0-1.0 00000100:00080000:0.0:1787893284.860141:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1787893284.872211:0:19239:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1787893284.872222:0:19239:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1787893284.872341:0:19239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17925:x1874741493432064:12345-0@lo:7:osp-pre-0-1.0 Request processed in 12873us (13932us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893284.872356:0:19239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787893284.872816:0:17925:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c8504a80 x1874741493432064/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787893300 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893284.872836:0:17925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8504a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17925:1874741493432064:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1787893284.872851:0:17925:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:0.0:1787893284.872898:0:17925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17925:1874741493432192:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1787893284.872957:0:17925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893284.872995:0:17925:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c5e93300 going to sleep for 11 seconds 00000100:00100000:3.0:1787893284.873029:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493432192 00000100:00100000:3.0:1787893284.873042:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493432192 00000100:00100000:3.0:1787893284.873649:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787893284.873666:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17925:x1874741493432192:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1787893284.873706:0:18704:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1787893284.873777:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17925:x1874741493432192:12345-0@lo:5:osp-pre-0-1.0 Request processed in 117us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893284.873784:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000004:00080000:0.0:1787893284.873927:0:17916:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00010000:00080000:0.0:1787893284.873999:0:17925:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c7ce1c00 x1874741493432192/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787893300 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893284.874015:0:17925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17925:1874741493432192:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1787893284.874031:0:17925:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1787893284.874102:0:17925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17925:1874741493432320:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1787893284.874139:0:17925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893284.874241:0:18702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3629:x1874741493431424:12345-0@lo:8:kworker.0 Request processed in 20518us (21312us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787893284.874255:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787893284.875098:0:17925:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c5e93300 going to sleep for 11 seconds 00000100:00100000:2.0:1787893284.875460:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493432320 00000100:00100000:2.0:1787893284.875471:0:18702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493432320 00000100:00100000:2.0:1787893284.875528:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787893284.875537:0:18702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17925:x1874741493432320:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1787893284.875764:0:18702:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00080000:1.0:1787893284.881770:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9d29e9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787893284.881786:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787893284.881793:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493431424:0@lo:8:kworker.0 00000001:00080000:0.0:1787893284.905134:0:18699:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1787893284.905149:0:18699:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1787893284.905470:0:18702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17925:x1874741493432320:12345-0@lo:5:osp-pre-0-1.0 Request processed in 29920us (31316us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787893284.905539:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787893284.905712:0:17925:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c7ce1c00 x1874741493432320/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787893300 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893284.905727:0:17925:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787893284.905745:0:17925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17925:1874741493432320:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1787893284.905766:0:17925:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1787893284.905836:0:17925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17925:1874741493432448:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1787893284.905886:0:17925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893284.905927:0:17925:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c5e93300 going to sleep for 11 seconds 00000100:00100000:1.0:1787893284.907557:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493432448 00000100:00100000:1.0:1787893284.907582:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493432448 00000100:00100000:1.0:1787893284.907649:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787893284.907660:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17925:x1874741493432448:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1787893284.907775:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17925:x1874741493432448:12345-0@lo:900:osp-pre-0-1.0 Request processed in 116us (1888us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893284.907783:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787893284.908017:0:17925:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c7ce1c00 x1874741493432448/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787893300 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893284.908037:0:17925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17925:1874741493432448:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1787893285.046998:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493432576:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787893285.047084:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893285.047481:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493432576 00000100:00100000:0.0:1787893285.047517:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493432576 00000100:00100000:0.0:1787893285.047581:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787893285.047601:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493432576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787893285.047637:0:18203:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787893285.047691:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493432576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893285.047698:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787893285.047760:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493432576:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787893285.049818:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787893285.049840:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7ce1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493432704:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787893285.049905:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893285.049949:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493432704 00000100:00100000:0.0:1787893285.049956:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493432704 00000100:00100000:0.0:1787893285.049998:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787893285.050008:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493432704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787893285.050041:0:17189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787893285.050085:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493432704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893285.050092:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787893285.050134:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7ce1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493432704:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787893285.363147:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893286.386269:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787893286.905580:0:17220:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787893287.411201:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893288.438719:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893289.458791:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893289.970648:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787893269/real 1787893269] req@ffff9fc9fe349180 x1874741493424768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893289 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893289.971148:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc9fe349180 x1874741493424768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893289 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893289.971165:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787893269/real 1787893269] req@ffff9fc9fe348380 x1874741493424896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893289 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893289.971182:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc9fe348380 x1874741493424896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893289 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787893289.971202:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9d24d5000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787893289.971258:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787893289.971270:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe349180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493424768:0@lo:8:kworker.0 00000100:00080000:0.0:1787893289.971277:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9e5eaa000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787893289.971356:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787893289.971360:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787893289.971363:0:38:0:(import.c:65:import_set_state_nolock()) ffff9fc9d24d5000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787893289.971368:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 513 00000100:00080000:1.0:1787893289.971373:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787893289.971379:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fc9d24d5000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:1.0:1787893289.971397:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c76f6a00 x1874741493433088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787893289.971407:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787893289.971410:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787893289.971412:0:38:0:(import.c:65:import_set_state_nolock()) ffff9fc9e5eaa000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787893289.971415:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 513 00000100:00080000:1.0:1787893289.971417:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787893289.971421:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fc9e5eaa000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:1.0:1787893289.971450:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c76f7100 x1874741493433216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787893289.971529:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787893289.971533:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787893289.971535:0:38:0:(import.c:65:import_set_state_nolock()) ffff9fc9d29e9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787893289.971538:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 528 00000100:00080000:1.0:1787893289.971551:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787893289.971556:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9fc9d29e9000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:1.0:1787893289.971568:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c76f7480 x1874741493433728/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787893289.971610:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13b37fca-0eda-4b14-a6ef-4a378c945d17:3632:1874741493432832:0@lo:400:kworker.0 00000100:00100000:1.0:1787893289.971673:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893289.971721:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493433600:0@lo:400:kworker.0 00000100:00100000:1.0:1787893289.971748:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893289.971772:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787893289.971778:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493432960:0@lo:400:kworker.0 00000100:00100000:1.0:1787893289.971802:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893289.971818:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493433856:0@lo:400:kworker.0 00000100:00100000:1.0:1787893289.971843:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893289.971875:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493433344:0@lo:400:kworker.0 00000100:00100000:1.0:1787893289.971899:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893289.971916:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493433984:0@lo:400:kworker.0 00000100:00100000:1.0:1787893289.971953:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893289.971971:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787893289.971977:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493433472:0@lo:400:kworker.0 00000100:00100000:1.0:1787893289.972009:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893289.972028:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493434112:0@lo:400:kworker.0 00000100:00100000:1.0:1787893289.972047:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893289.972073:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493432832 00000100:00100000:1.0:1787893289.972080:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493432832 00000100:00100000:1.0:1787893289.972123:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787893289.972132:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+21:3632:x1874741493432832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893289.972177:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+21:3632:x1874741493432832:12345-0@lo:400:kworker.0 Request processed in 46us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893289.972185:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787893289.972216:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493433600 00000100:00100000:1.0:1787893289.972220:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493433600 00000100:00100000:1.0:1787893289.972256:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787893289.972263:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493433600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893289.972294:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493433600:12345-0@lo:400:kworker.0 Request processed in 32us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893289.972300:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787893289.972318:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493432960 00000100:00100000:1.0:1787893289.972322:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493432960 00000100:00100000:1.0:1787893289.972342:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493433472 00000100:00100000:1.0:1787893289.972345:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493433472 00000100:00100000:1.0:1787893289.972359:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787893289.972364:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493432960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893289.972397:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493432960:12345-0@lo:400:kworker.0 Request processed in 32us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893289.972403:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787893289.972414:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787893289.972424:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493433472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893289.972458:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493433472:12345-0@lo:400:kworker.0 Request processed in 34us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893289.972464:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787893289.972481:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493433856 00000100:00100000:1.0:1787893289.972485:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493433856 00000100:00100000:1.0:1787893289.972521:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493433344 00000100:00100000:1.0:1787893289.972524:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493433344 00000100:00100000:1.0:1787893289.972534:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493433984 00000100:00100000:1.0:1787893289.972536:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493433984 00000100:00100000:1.0:1787893289.972564:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493434112 00000100:00100000:1.0:1787893289.972567:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493434112 00000100:00100000:1.0:1787893289.972581:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787893289.972588:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493433856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893289.972620:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493433856:12345-0@lo:400:kworker.0 Request processed in 32us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893289.972626:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787893289.972637:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787893289.972643:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493433344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893289.972668:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493433344:12345-0@lo:400:kworker.0 Request processed in 26us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893289.972673:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787893289.972682:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787893289.972688:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493433984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893289.972710:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493433984:12345-0@lo:400:kworker.0 Request processed in 23us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893289.972716:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787893289.972734:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787893289.972740:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493434112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893289.972770:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493434112:12345-0@lo:400:kworker.0 Request processed in 30us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893289.972776:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1787893289.972804:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787893289.972807:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787893289.972810:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787893289.972850:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493433472:0@lo:400:kworker.0 00010000:00080000:1.0:1787893289.972862:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c76f7b80 x1874741493434112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893289.972871:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493434112:0@lo:400:kworker.0 00010000:00080000:1.0:1787893289.972879:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c76f6300 x1874741493433344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893289.972887:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493433344:0@lo:400:kworker.0 00010000:00080000:1.0:1787893289.972896:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c76f4380 x1874741493433984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893289.972902:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493433984:0@lo:400:kworker.0 00000100:00100000:1.0:1787893289.972932:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493432960:0@lo:400:kworker.0 00010000:00080000:1.0:1787893289.972941:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c76f4a80 x1874741493433856/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893289.972948:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493433856:0@lo:400:kworker.0 00000100:00100000:1.0:1787893289.972956:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13b37fca-0eda-4b14-a6ef-4a378c945d17:3632:1874741493432832:0@lo:400:kworker.0 00010000:00080000:1.0:1787893289.972974:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c76f4000 x1874741493433600/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893289.972982:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493433600:0@lo:400:kworker.0 00000100:00080000:0.0:1787893289.973718:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787893289.973725:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe348380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493424896:0@lo:8:kworker.0 00000100:00100000:0.0:1787893289.973753:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493433088:0@lo:8:kworker.0 00000100:00100000:0.0:1787893289.973794:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893289.973823:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493433216:0@lo:8:kworker.0 00000100:00100000:0.0:1787893289.973845:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893289.973865:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493433728:0@lo:8:kworker.0 00000100:00100000:0.0:1787893289.973884:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893289.973916:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493433088 00000100:00100000:0.0:1787893289.973922:0:18702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493433088 00000100:00100000:1.0:1787893289.974034:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493433216 00000100:00100000:1.0:1787893289.974039:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493433216 00000100:00100000:1.0:1787893289.974061:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493433728 00000100:00100000:1.0:1787893289.974064:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493433728 00000100:00100000:1.0:1787893289.974075:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787893289.974081:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3629:x1874741493433216:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787893289.974100:0:18703:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787893289.974649:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787893289.974655:0:18702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3629:x1874741493433728:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787893289.974667:0:18702:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787893289.974714:0:18702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3629:x1874741493433728:12345-0@lo:8:kworker.0 Request processed in 57us (827us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787893289.974721:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787893289.974736:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787893289.974741:0:18702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3629:x1874741493433088:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787893289.974758:0:18702:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:0.0:1787893289.974791:0:18702:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9232577658cf1fe7 00002000:00100000:0.0:1787893289.974805:0:18702:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9fc8c7c69800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787893289.974809:0:18702:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787893289.974817:0:18702:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787893289.974888:0:18702:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787893289.974912:0:18702:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7c6f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787893289.975625:0:18702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3629:x1874741493433088:12345-0@lo:8:kworker.0 Request processed in 880us (1828us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893289.975632:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787893289.975674:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c76f6a00 x1874741493433088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787893314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893289.975685:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787893289.975692:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787893289.975699:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787893289.975704:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787893289.975706:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9d24d5000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787893289.975724:0:3629:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787893289.975728:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493433088:0@lo:8:kworker.0 00000100:00080000:0.0:1787893289.975741:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9d29e9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787893289.975744:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787893289.975747:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493433728:0@lo:8:kworker.0 00000004:00080000:0.0:1787893289.976715:0:17208:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:0.0:1787893289.976744:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d29f9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17208:1874741493434368:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787893289.976745:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d29fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493434240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787893289.979130:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893289.979286:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493434240 00000100:00100000:2.0:1787893289.979294:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493434240 00000100:00100000:2.0:1787893289.979350:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787893289.979360:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7789880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3632:x1874741493434240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787893289.979390:0:18705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787893289.979441:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7789880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3632:x1874741493434240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893289.979448:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787893289.979471:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787893289.979527:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9d29fad80 x1874741493434240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893305 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893289.979557:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d29fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493434240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787893289.980198:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893289.980220:0:17208:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9edf37780 going to sleep for 11 seconds 00000004:00080000:0.0:1787893289.980582:0:17207:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787893289.980664:0:17207:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 533802172379ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787893289.980671:0:17207:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1787893289.980758:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493434368 00000100:00100000:2.0:1787893289.980769:0:18702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493434368 00000100:00100000:2.0:1787893289.980803:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787893289.980810:0:18702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17208:x1874741493434368:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787893289.988194:0:17163:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:0.0:1787893289.988636:0:18702:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1787893289.988654:0:18702:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1787893289.988661:0:18702:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00002000:00010000:0.0:1787893289.989058:0:18702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787893289.989068:0:18702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b1d3144/0x9232577658cf1fee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.989084:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=533s v=(0 0) 00010000:00010000:0.0:1787893289.989089:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787893289.989095:0:18702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b1d3144/0x9232577658cf1fee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.989114:0:18702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b1d3144/0x9232577658cf1fee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.989125:0:18702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b1d3144/0x9232577658cf1fee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.989133:0:18702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b1d3144/0x9232577658cf1fee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.989159:0:18702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787893289.989479:0:18702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787893289.989486:0:18702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fb335a5/0x9232577658cf1ff5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.989522:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=533s v=(0 0) 00010000:00010000:0.0:1787893289.989526:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787893289.989530:0:18702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fb335a5/0x9232577658cf1ff5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.989557:0:18702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fb335a5/0x9232577658cf1ff5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.989566:0:18702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fb335a5/0x9232577658cf1ff5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.989573:0:18702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003fb335a5/0x9232577658cf1ff5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.989593:0:18702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787893289.990009:0:18702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787893289.990015:0:18702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2775db3/0x9232577658cf1ffc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.990023:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=533s v=(0 0) 00010000:00010000:0.0:1787893289.990026:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787893289.990031:0:18702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2775db3/0x9232577658cf1ffc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.990038:0:18702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2775db3/0x9232577658cf1ffc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.990045:0:18702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2775db3/0x9232577658cf1ffc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.990063:0:18702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2775db3/0x9232577658cf1ffc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.990071:0:18702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1787893289.990339:0:18702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787893289.990345:0:18702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3e1fcbd/0x9232577658cf2003 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.990353:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=533s v=(0 0) 00010000:00010000:0.0:1787893289.990357:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787893289.990361:0:18702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3e1fcbd/0x9232577658cf2003 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.990369:0:18702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3e1fcbd/0x9232577658cf2003 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.990375:0:18702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3e1fcbd/0x9232577658cf2003 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.990381:0:18702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3e1fcbd/0x9232577658cf2003 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.990389:0:18702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1787893289.990993:0:18702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787893289.991010:0:18702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6279780/0x9232577658cf200a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.991026:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=533s v=(0 0) 00010000:00010000:0.0:1787893289.991030:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787893289.991034:0:18702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6279780/0x9232577658cf200a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.991044:0:18702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6279780/0x9232577658cf200a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.991053:0:18702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6279780/0x9232577658cf200a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.991061:0:18702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6279780/0x9232577658cf200a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.991069:0:18702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1787893289.991365:0:18702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787893289.991371:0:18702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000878ce811/0x9232577658cf2011 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.991380:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=533s v=(0 0) 00010000:00010000:0.0:1787893289.991383:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787893289.991387:0:18702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000878ce811/0x9232577658cf2011 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.991397:0:18702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000878ce811/0x9232577658cf2011 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.991415:0:18702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000878ce811/0x9232577658cf2011 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.991422:0:18702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000878ce811/0x9232577658cf2011 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.991441:0:18702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:2.0:1787893289.991714:0:17171:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1787893289.991722:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b1d3144/0x9232577658cf1fee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.991731:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd69c800 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787893289.991736:0:17171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b1d3144/0x9232577658cf1fee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.991746:0:17171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b1d3144/0x9232577658cf1fee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.991768:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b1d3144/0x9232577658cf1fee lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.991777:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b1d3144/0x9232577658cf1fee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.991796:0:17171:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787893289.991800:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003fb335a5/0x9232577658cf1ff5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.991806:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd69ce00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787893289.991809:0:17171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003fb335a5/0x9232577658cf1ff5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.991828:0:17171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003fb335a5/0x9232577658cf1ff5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787893289.991828:0:18702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787893289.991833:0:18702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002170d5bd/0x9232577658cf2018 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.991839:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003fb335a5/0x9232577658cf1ff5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.991841:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=533s v=(0 0) 00010000:00010000:0.0:1787893289.991844:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893289.991847:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fb335a5/0x9232577658cf1ff5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.991849:0:18702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002170d5bd/0x9232577658cf2018 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.991858:0:18702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002170d5bd/0x9232577658cf2018 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.991861:0:17171:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787893289.991864:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2775db3/0x9232577658cf1ffc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.991866:0:18702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002170d5bd/0x9232577658cf2018 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.991871:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd69de00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787893289.991875:0:17171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2775db3/0x9232577658cf1ffc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.991875:0:18702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002170d5bd/0x9232577658cf2018 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.991883:0:17171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2775db3/0x9232577658cf1ffc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.991893:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2775db3/0x9232577658cf1ffc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.991894:0:18702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1787893289.991900:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2775db3/0x9232577658cf1ffc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.991922:0:17171:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787893289.991926:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3e1fcbd/0x9232577658cf2003 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.991932:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd69dc00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787893289.991936:0:17171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3e1fcbd/0x9232577658cf2003 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.991944:0:17171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3e1fcbd/0x9232577658cf2003 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.991954:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3e1fcbd/0x9232577658cf2003 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.991961:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3e1fcbd/0x9232577658cf2003 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.991975:0:17171:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787893289.991978:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6279780/0x9232577658cf200a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.991984:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd69c600 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787893289.991987:0:17171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6279780/0x9232577658cf200a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.992005:0:17171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6279780/0x9232577658cf200a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.992015:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6279780/0x9232577658cf200a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.992023:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6279780/0x9232577658cf200a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.992037:0:17171:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787893289.992040:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000878ce811/0x9232577658cf2011 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.992047:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd69c400 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787893289.992050:0:17171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000878ce811/0x9232577658cf2011 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.992058:0:17171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000878ce811/0x9232577658cf2011 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.992068:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000878ce811/0x9232577658cf2011 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.992075:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000878ce811/0x9232577658cf2011 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.992099:0:17171:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893289.992103:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002170d5bd/0x9232577658cf2018 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.992109:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd69d800 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787893289.992113:0:17171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002170d5bd/0x9232577658cf2018 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.992121:0:17171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002170d5bd/0x9232577658cf2018 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.992131:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002170d5bd/0x9232577658cf2018 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787893289.992132:0:18702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787893289.992138:0:18702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083fbba8b/0x9232577658cf201f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.992139:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002170d5bd/0x9232577658cf2018 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.992147:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=533s v=(0 0) 00010000:00010000:0.0:1787893289.992149:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893289.992152:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893289.992153:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893289.992154:0:18702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083fbba8b/0x9232577658cf201f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.992156:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893289.992162:0:18702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083fbba8b/0x9232577658cf201f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.992169:0:18702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083fbba8b/0x9232577658cf201f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.992175:0:18702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083fbba8b/0x9232577658cf201f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.992189:0:18702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787893289.992380:0:17171:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893289.992385:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083fbba8b/0x9232577658cf201f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.992393:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31400 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787893289.992401:0:17171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083fbba8b/0x9232577658cf201f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.992409:0:17171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083fbba8b/0x9232577658cf201f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787893289.992417:0:18702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893289.992420:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083fbba8b/0x9232577658cf201f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.992423:0:18702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000909d720a/0x9232577658cf2026 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.992428:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083fbba8b/0x9232577658cf201f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.992441:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893289.992442:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893289.992444:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893289.992521:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=533s v=(0 0) 00010000:00010000:0.0:1787893289.992530:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787893289.992535:0:18702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000909d720a/0x9232577658cf2026 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.992556:0:18702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000909d720a/0x9232577658cf2026 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.992564:0:18702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000909d720a/0x9232577658cf2026 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.992571:0:18702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000909d720a/0x9232577658cf2026 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.992585:0:18702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787893289.992590:0:17171:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893289.992594:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000909d720a/0x9232577658cf2026 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.992600:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30e00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787893289.992604:0:17171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000909d720a/0x9232577658cf2026 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.992611:0:17171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000909d720a/0x9232577658cf2026 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.992621:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000909d720a/0x9232577658cf2026 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.992634:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000909d720a/0x9232577658cf2026 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.992647:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893289.992649:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893289.992650:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787893289.993024:0:18702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893289.993030:0:18702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bcc2445/0x9232577658cf202d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.993039:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787893289.993042:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893289.993047:0:18702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bcc2445/0x9232577658cf202d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.993056:0:18702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bcc2445/0x9232577658cf202d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.993064:0:18702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bcc2445/0x9232577658cf202d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.993070:0:18702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008bcc2445/0x9232577658cf202d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.993090:0:18702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787893289.993374:0:18702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893289.993385:0:18702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000b3acc1/0x9232577658cf2034 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.993393:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787893289.993396:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893289.993400:0:18702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000b3acc1/0x9232577658cf2034 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.993408:0:18702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000b3acc1/0x9232577658cf2034 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.993415:0:18702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000b3acc1/0x9232577658cf2034 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.993421:0:18702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000b3acc1/0x9232577658cf2034 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.993428:0:18702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787893289.993763:0:17171:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787893289.993769:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008bcc2445/0x9232577658cf202d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.993777:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c4152c00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893289.993781:0:17171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008bcc2445/0x9232577658cf202d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.993790:0:17171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008bcc2445/0x9232577658cf202d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.993803:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008bcc2445/0x9232577658cf202d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.993822:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bcc2445/0x9232577658cf202d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.993841:0:17171:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893289.993845:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000b3acc1/0x9232577658cf2034 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.993852:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c4153600 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893289.993855:0:17171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000b3acc1/0x9232577658cf2034 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.993862:0:17171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000b3acc1/0x9232577658cf2034 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.993873:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000b3acc1/0x9232577658cf2034 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.993880:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000b3acc1/0x9232577658cf2034 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.993893:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893289.993895:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893289.993897:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787893289.994285:0:18702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893289.994292:0:18702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea0e6912/0x9232577658cf203b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.994300:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787893289.994303:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893289.994307:0:18702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea0e6912/0x9232577658cf203b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.994315:0:18702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea0e6912/0x9232577658cf203b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.994329:0:18702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea0e6912/0x9232577658cf203b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.994336:0:18702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea0e6912/0x9232577658cf203b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.994356:0:18702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787893289.995648:0:18702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893289.995659:0:18702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000148e3b59/0x9232577658cf2042 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.995670:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787893289.995674:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893289.995678:0:18702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000148e3b59/0x9232577658cf2042 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.995689:0:18702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000148e3b59/0x9232577658cf2042 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.995698:0:18702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000148e3b59/0x9232577658cf2042 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.995705:0:18702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000148e3b59/0x9232577658cf2042 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.995727:0:18702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787893289.995930:0:17171:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787893289.995938:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea0e6912/0x9232577658cf203b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.995953:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c4153400 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893289.995957:0:17171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea0e6912/0x9232577658cf203b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.995965:0:17171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea0e6912/0x9232577658cf203b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.995979:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea0e6912/0x9232577658cf203b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.995986:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea0e6912/0x9232577658cf203b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.996010:0:17171:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893289.996013:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000148e3b59/0x9232577658cf2042 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.996019:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c4152200 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893289.996022:0:17171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000148e3b59/0x9232577658cf2042 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.996029:0:17171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000148e3b59/0x9232577658cf2042 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.996039:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000148e3b59/0x9232577658cf2042 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.996051:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000148e3b59/0x9232577658cf2042 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.996064:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893289.996066:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893289.996068:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787893289.996603:0:18702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893289.996610:0:18702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a3c1877/0x9232577658cf2049 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.996620:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787893289.996623:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893289.996628:0:18702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a3c1877/0x9232577658cf2049 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.996637:0:18702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a3c1877/0x9232577658cf2049 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.996644:0:18702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a3c1877/0x9232577658cf2049 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.996652:0:18702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a3c1877/0x9232577658cf2049 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.996666:0:18702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787893289.996799:0:17171:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893289.996804:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a3c1877/0x9232577658cf2049 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.996812:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c4153000 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893289.996816:0:17171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a3c1877/0x9232577658cf2049 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.996824:0:17171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a3c1877/0x9232577658cf2049 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.996836:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a3c1877/0x9232577658cf2049 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.996844:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a3c1877/0x9232577658cf2049 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.996859:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893289.996861:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893289.996862:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787893289.996991:0:18702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893289.996997:0:18702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b973388/0x9232577658cf2050 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.997011:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787893289.997020:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893289.997025:0:18702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b973388/0x9232577658cf2050 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.997034:0:18702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b973388/0x9232577658cf2050 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.997042:0:18702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b973388/0x9232577658cf2050 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.997049:0:18702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b973388/0x9232577658cf2050 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.997069:0:18702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787893289.997331:0:17171:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893289.997336:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b973388/0x9232577658cf2050 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.997344:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c4153200 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893289.997348:0:17171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b973388/0x9232577658cf2050 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.997355:0:17171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b973388/0x9232577658cf2050 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.997366:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b973388/0x9232577658cf2050 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.997373:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b973388/0x9232577658cf2050 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.997386:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893289.997388:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893289.997390:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787893289.997478:0:18702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893289.997484:0:18702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073e2235c/0x9232577658cf2057 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.997515:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787893289.997518:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893289.997522:0:18702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073e2235c/0x9232577658cf2057 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.997531:0:18702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073e2235c/0x9232577658cf2057 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.997540:0:18702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073e2235c/0x9232577658cf2057 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.997562:0:18702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073e2235c/0x9232577658cf2057 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.997576:0:18702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787893289.997889:0:17171:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893289.997894:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073e2235c/0x9232577658cf2057 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.997901:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c4152e00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893289.997905:0:17171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073e2235c/0x9232577658cf2057 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.997925:0:17171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073e2235c/0x9232577658cf2057 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.997937:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073e2235c/0x9232577658cf2057 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.997944:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073e2235c/0x9232577658cf2057 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893289.997958:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893289.997960:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893289.997961:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787893289.998208:0:18702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893289.998215:0:18702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b624ade/0x9232577658cf205e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.998223:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787893289.998226:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893289.998231:0:18702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b624ade/0x9232577658cf205e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.998241:0:18702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b624ade/0x9232577658cf205e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.998249:0:18702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b624ade/0x9232577658cf205e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.998257:0:18702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b624ade/0x9232577658cf205e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.998308:0:18702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787893289.999009:0:18702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893289.999016:0:18702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aab34693/0x9232577658cf2065 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.999033:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787893289.999036:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893289.999041:0:18702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aab34693/0x9232577658cf2065 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.999051:0:18702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aab34693/0x9232577658cf2065 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.999059:0:18702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aab34693/0x9232577658cf2065 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893289.999067:0:18702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aab34693/0x9232577658cf2065 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.000759:0:17171:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787893290.000774:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b624ade/0x9232577658cf205e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.000787:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c4152400 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893290.000792:0:17171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b624ade/0x9232577658cf205e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.000802:0:17171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b624ade/0x9232577658cf205e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.000823:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b624ade/0x9232577658cf205e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.000851:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b624ade/0x9232577658cf205e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.000881:0:17171:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893290.000885:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aab34693/0x9232577658cf2065 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.000892:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c4152000 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893290.000896:0:17171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aab34693/0x9232577658cf2065 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.000905:0:17171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aab34693/0x9232577658cf2065 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.000916:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aab34693/0x9232577658cf2065 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.000925:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893290.000927:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893290.000929:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893290.000996:0:18702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787893290.001004:0:18702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aab34693/0x9232577658cf2065 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.001233:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893290.001589:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787893290.003068:0:18702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893290.003079:0:18702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000736517a/0x9232577658cf206c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.003093:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787893290.003097:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893290.003104:0:18702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000736517a/0x9232577658cf206c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.003136:0:18702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000736517a/0x9232577658cf206c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.003146:0:18702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000736517a/0x9232577658cf206c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.003154:0:18702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000736517a/0x9232577658cf206c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.003210:0:18702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787893290.003794:0:18702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893290.003801:0:18702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e543cf83/0x9232577658cf2073 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.003811:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787893290.003814:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893290.003818:0:18702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e543cf83/0x9232577658cf2073 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.003828:0:18702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e543cf83/0x9232577658cf2073 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.003835:0:18702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e543cf83/0x9232577658cf2073 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.003853:0:18702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e543cf83/0x9232577658cf2073 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.003989:0:17171:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787893290.003997:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000736517a/0x9232577658cf206c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.004028:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c4152600 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893290.004032:0:17171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000736517a/0x9232577658cf206c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.004039:0:17171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000736517a/0x9232577658cf206c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.004055:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000736517a/0x9232577658cf206c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.004061:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000736517a/0x9232577658cf206c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.004175:0:18702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787893290.004185:0:17171:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893290.004189:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e543cf83/0x9232577658cf2073 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.004196:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e1600 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787893290.004200:0:17171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e543cf83/0x9232577658cf2073 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.004207:0:17171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e543cf83/0x9232577658cf2073 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.004218:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e543cf83/0x9232577658cf2073 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.004225:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e543cf83/0x9232577658cf2073 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.004238:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893290.004240:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893290.004241:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893290.004915:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787893290.006301:0:19517:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787893290.006303:0:19517:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1787893290.006305:0:19517:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1787893290.006440:0:19517:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fc8c64bb800 00000020:01000004:3.0:1787893290.006457:0:19517:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787893290.006472:0:19517:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787893290.006486:0:19517:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9fc9d911b370) 00000020:00000080:3.0:1787893290.006538:0:19517:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00002000:00010000:2.0:1787893290.007210:0:18702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893290.007229:0:18702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2e1f989/0x9232577658cf2081 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.007246:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787893290.007252:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893290.007258:0:18702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2e1f989/0x9232577658cf2081 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.007273:0:18702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2e1f989/0x9232577658cf2081 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.007283:0:18702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2e1f989/0x9232577658cf2081 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.007291:0:18702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2e1f989/0x9232577658cf2081 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.007368:0:18702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787893290.008174:0:18702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893290.008182:0:18702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bd1c3c2/0x9232577658cf2088 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.008194:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787893290.008198:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893290.008203:0:18702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004bd1c3c2/0x9232577658cf2088 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.008215:0:18702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004bd1c3c2/0x9232577658cf2088 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.008232:0:18702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bd1c3c2/0x9232577658cf2088 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.008240:0:18702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004bd1c3c2/0x9232577658cf2088 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.012243:0:17171:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787893290.012259:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2e1f989/0x9232577658cf2081 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.012275:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e0c00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893290.012279:0:17171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2e1f989/0x9232577658cf2081 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.012290:0:17171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2e1f989/0x9232577658cf2081 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.012336:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2e1f989/0x9232577658cf2081 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.012344:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2e1f989/0x9232577658cf2081 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.012375:0:17171:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893290.012379:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004bd1c3c2/0x9232577658cf2088 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.012385:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e0000 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893290.012389:0:17171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004bd1c3c2/0x9232577658cf2088 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.012397:0:17171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004bd1c3c2/0x9232577658cf2088 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.012407:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004bd1c3c2/0x9232577658cf2088 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.012415:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893290.012417:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893290.012419:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893290.012709:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3629:x1874741493433216:12345-0@lo:8:kworker.0 Request processed in 38622us (38858us total) trans 0 rc -19/-19 00010000:00010000:0.0:1787893290.012713:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893290.012721:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787893290.012752:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9e5eaa000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787893290.012758:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787893290.012769:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493433216:0@lo:8:kworker.0 00010000:00010000:2.0:1787893290.012827:0:18702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787893290.012835:0:18702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004bd1c3c2/0x9232577658cf2088 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787893290.014382:0:18702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893290.014397:0:18702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c35b197/0x9232577658cf208f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.014413:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787893290.014417:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893290.014424:0:18702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c35b197/0x9232577658cf208f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.014785:0:18702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c35b197/0x9232577658cf208f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.014796:0:18702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c35b197/0x9232577658cf208f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.014817:0:18702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c35b197/0x9232577658cf208f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.014839:0:18702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787893290.015222:0:18702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893290.015228:0:18702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fed994f3/0x9232577658cf2096 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.015236:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787893290.015238:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893290.015242:0:18702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fed994f3/0x9232577658cf2096 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.015248:0:18702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fed994f3/0x9232577658cf2096 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.015253:0:18702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fed994f3/0x9232577658cf2096 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.015258:0:18702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fed994f3/0x9232577658cf2096 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.015417:0:18702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787893290.015419:0:17172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787893290.015426:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c35b197/0x9232577658cf208f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893290.015435:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e0600 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:1.0:1787893290.015439:0:17172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c35b197/0x9232577658cf208f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893290.015449:0:17172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c35b197/0x9232577658cf208f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893290.015468:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c35b197/0x9232577658cf208f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893290.015486:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c35b197/0x9232577658cf208f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893290.015525:0:17172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893290.015528:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fed994f3/0x9232577658cf2096 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893290.015535:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e1a00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:1.0:1787893290.015538:0:17172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fed994f3/0x9232577658cf2096 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893290.015558:0:17172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fed994f3/0x9232577658cf2096 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893290.015569:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fed994f3/0x9232577658cf2096 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787893290.015756:0:18702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893290.015763:0:18702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e368ce9/0x9232577658cf209d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.015776:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787893290.015779:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893290.015784:0:18702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e368ce9/0x9232577658cf209d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.015793:0:18702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e368ce9/0x9232577658cf209d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.015802:0:18702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e368ce9/0x9232577658cf209d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.015809:0:18702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e368ce9/0x9232577658cf209d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893290.015811:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fed994f3/0x9232577658cf2096 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.015819:0:18702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787893290.015825:0:17172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893290.015828:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e368ce9/0x9232577658cf209d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893290.015835:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e0400 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:1.0:1787893290.015843:0:17172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e368ce9/0x9232577658cf209d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893290.015851:0:17172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e368ce9/0x9232577658cf209d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893290.015863:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e368ce9/0x9232577658cf209d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893290.015870:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e368ce9/0x9232577658cf209d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893290.015882:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893290.015884:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893290.015886:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787893290.016115:0:18702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893290.016121:0:18702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5362880/0x9232577658cf20a4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.016129:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787893290.016132:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893290.016137:0:18702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5362880/0x9232577658cf20a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.016146:0:18702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5362880/0x9232577658cf20a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.016160:0:18702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5362880/0x9232577658cf20a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.016165:0:18702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5362880/0x9232577658cf20a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.016177:0:18702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787893290.016198:0:17172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893290.016203:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5362880/0x9232577658cf20a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893290.016210:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e1e00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:1.0:1787893290.016213:0:17172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5362880/0x9232577658cf20a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893290.016221:0:17172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5362880/0x9232577658cf20a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893290.016233:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5362880/0x9232577658cf20a4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893290.016245:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5362880/0x9232577658cf20a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893290.016257:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893290.016259:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893290.016261:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787893290.016485:0:18702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893290.016521:0:18702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017d550a0/0x9232577658cf20ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.016530:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787893290.016533:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893290.016537:0:18702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017d550a0/0x9232577658cf20ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.016562:0:18702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017d550a0/0x9232577658cf20ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.016571:0:18702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017d550a0/0x9232577658cf20ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.016578:0:18702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017d550a0/0x9232577658cf20ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.016602:0:18702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787893290.016622:0:17172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893290.016627:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017d550a0/0x9232577658cf20ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893290.016634:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e1c00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:1.0:1787893290.016637:0:17172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017d550a0/0x9232577658cf20ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893290.016645:0:17172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017d550a0/0x9232577658cf20ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893290.016655:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017d550a0/0x9232577658cf20ab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893290.016662:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017d550a0/0x9232577658cf20ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893290.016674:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893290.016676:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893290.016678:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787893290.017306:0:18702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893290.017313:0:18702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f39d8850/0x9232577658cf20b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.017323:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787893290.017326:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893290.017331:0:18702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f39d8850/0x9232577658cf20b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.017340:0:18702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f39d8850/0x9232577658cf20b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.017348:0:18702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f39d8850/0x9232577658cf20b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.017356:0:18702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f39d8850/0x9232577658cf20b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.017375:0:18702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1787893290.017415:0:18702:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00010000:00010000:1.0:1787893290.017561:0:17172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893290.017566:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f39d8850/0x9232577658cf20b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893290.017586:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e0e00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:1.0:1787893290.017590:0:17172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f39d8850/0x9232577658cf20b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893290.017597:0:17172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f39d8850/0x9232577658cf20b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893290.017608:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f39d8850/0x9232577658cf20b2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893290.017613:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f39d8850/0x9232577658cf20b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893290.017627:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893290.017628:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893290.017630:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893290.017663:0:18702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17208:x1874741493434368:12345-0@lo:5:osp-pre-0-0.0 Request processed in 36849us (37462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893290.017673:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787893290.017681:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d29f9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17208:1874741493434368:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787893290.017695:0:17208:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:1.0:1787893290.017741:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17208:1874741493434496:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787893290.017779:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893290.017811:0:17208:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fe47f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787893290.018890:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493434496 00000100:00100000:2.0:1787893290.018906:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493434496 00000100:00100000:2.0:1787893290.018954:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787893290.018963:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17208:x1874741493434496:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787893290.019003:0:18704:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:0.0:1787893290.019208:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787893290.024485:0:18699:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:0.0:1787893290.024566:0:18699:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1787893290.025134:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17208:x1874741493434496:12345-0@lo:5:osp-pre-0-0.0 Request processed in 6166us (7349us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787893290.025152:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787893290.025194:0:17208:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1787893290.025203:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17208:1874741493434496:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787893290.025219:0:17208:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00100000:10000000:2.0:1787893290.060239:0:19517:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787893290.060663:0:19517:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787893290.060884:0:19517:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787893290.061245:0:19517:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787893290.061426:0:19517:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787893290.061810:0:19517:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787893290.062050:0:19517:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:2.0:1787893290.064750:0:19517:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787893290.064964:0:19517:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787893290.064980:0:19517:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787893290.064993:0:19517:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9232577658cf20b9 00000020:01000004:2.0:1787893290.065213:0:19517:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787893290.065237:0:19517:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.135@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787893290.065241:0:19517:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.135@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787893290.065248:0:19517:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787893290.065279:0:19517:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1787893290.065283:0:19517:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.135@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787893290.074439:0:19517:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.135@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787893290.074478:0:19517:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.135@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1787893290.074483:0:19517:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787893290.075202:0:19517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787893290.075204:0:19517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787893290.075205:0:19517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787893290.075207:0:19517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787893290.075208:0:19517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787893290.075210:0:19517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787893290.075212:0:19517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787893290.075213:0:19517:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787893290.075217:0:19517:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1787893290.075221:0:19517:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787893290.075222:0:19517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787893290.075223:0:19517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787893290.075224:0:19517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787893290.075225:0:19517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787893290.075226:0:19517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787893290.075226:0:19517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787893290.075227:0:19517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787893290.075228:0:19517:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787893290.075261:0:19517:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787893290.075283:0:19517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c778b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:19517:1874741493434624:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787893290.075356:0:19517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893290.075471:0:19517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c108ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787893290.076726:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493434624 00000100:00100000:1.0:1787893290.076738:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493434624 00000100:00100000:1.0:1787893290.076843:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787893290.076854:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+21:19517:x1874741493434624:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787893290.076892:0:17177:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787893290.076896:0:17177:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1787893290.076900:0:17177:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787893290.077338:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+21:19517:x1874741493434624:12345-0@lo:253:mount.lustre.0 Request processed in 484us (1980us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893290.077347:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787893290.077450:0:19517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c778b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:19517:1874741493434624:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787893290.077479:0:19517:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787893290.077482:0:19517:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787893290.077483:0:19517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787893290.077485:0:19517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787893290.077486:0:19517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787893290.077487:0:19517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787893290.077506:0:19517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787893290.077508:0:19517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787893290.077510:0:19517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787893290.077512:0:19517:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787893290.077534:0:19517:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fc8c64bb800 from lustre-OST0001 10000000:01000000:3.0:1787893290.077587:0:19517:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787893290.077590:0:19517:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787893290.077600:0:19517:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fc8c7730000 local copy 00010000:00010000:3.0:1787893290.077611:0:19517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c800/0x9232577658cf1d08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1d0f expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893290.077708:0:19517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8504700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:19517:1874741493434752:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787893290.077747:0:19517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893290.077970:0:19517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7686f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787893290.078127:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493434752 00000100:00100000:2.0:1787893290.078133:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493434752 00000100:00100000:3.0:1787893290.078283:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787893290.078292:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+21:19517:x1874741493434752:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787893290.078381:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+21:19517:x1874741493434752:12345-0@lo:501:mount.lustre.0 Request processed in 90us (634us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787893290.078389:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787893290.078470:0:19517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8504700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:19517:1874741493434752:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787893290.078487:0:19517:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.135@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787893290.078549:0:19517:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.135@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787893290.078556:0:19517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c800/0x9232577658cf1d08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1d0f expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.078566:0:19517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c800/0x9232577658cf1d08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1d0f expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893290.078597:0:19517:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fc8c64bb800 10000000:01000000:2.0:1787893290.078611:0:19517:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787893290.078618:0:19517:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787893290.078621:0:19517:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787893290.078625:0:19517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787893290.078628:0:19517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787893290.078653:0:19517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e0000/0x9232577658cf20c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.078661:0:19517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e0000/0x9232577658cf20c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.078670:0:19517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e0000/0x9232577658cf20c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893290.078685:0:19517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7789180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:19517:1874741493434880:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787893290.078714:0:19517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893290.078734:0:19517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c108ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1787893290.078785:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493434880 00000100:00100000:3.0:1787893290.078790:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493434880 00000100:00100000:3.0:1787893290.078810:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787893290.078817:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+21:19517:x1874741493434880:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787893290.078826:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893290.078845:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c84f7400/0x9232577658cf20c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf20c0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893290.078867:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c84f7400/0x9232577658cf20c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf20c0 expref: 22 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893290.078878:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c84f7400/0x9232577658cf20c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf20c0 expref: 22 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893290.078887:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c84f7400, rc 0) 00000100:00100000:3.0:1787893290.078926:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+22:19517:x1874741493434880:12345-0@lo:101:mount.lustre.0 Request processed in 109us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893290.078932:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787893290.079007:0:19517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7789180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:19517:1874741493434880:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787893290.079022:0:19517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e0000/0x9232577658cf20c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf20c7 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893290.079030:0:19517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e0000/0x9232577658cf20c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf20c7 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787893290.083861:0:19517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787893290.084483:0:19517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787893290.086261:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787893290.086309:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787893290.086327:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787893290.086342:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787893290.086355:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787893290.086368:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787893290.086391:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787893290.086396:0:19517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787893290.086717:0:19517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8507480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:19517:1874741493435008:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787893290.086788:0:19517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893290.086875:0:19517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7686c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787893290.086922:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493435008 00000100:00100000:1.0:1787893290.086930:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493435008 00000100:00100000:1.0:1787893290.087017:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787893290.087027:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+22:19517:x1874741493435008:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787893290.087181:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+22:19517:x1874741493435008:12345-0@lo:501:mount.lustre.0 Request processed in 155us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893290.087189:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787893290.087277:0:19517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8507480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:19517:1874741493435008:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787893290.087312:0:19517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d29f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:19517:1874741493435136:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787893290.087355:0:19517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893290.087673:0:19517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c70b8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787893290.087737:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493435136 00000100:00100000:3.0:1787893290.087742:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493435136 00000100:00100000:2.0:1787893290.087782:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787893290.087793:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+22:19517:x1874741493435136:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787893290.088430:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+22:19517:x1874741493435136:12345-0@lo:503:mount.lustre.0 Request processed in 638us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893290.088439:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787893290.088619:0:19517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d29f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:19517:1874741493435136:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787893290.089049:0:19517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787893290.089131:0:19517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d29f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:19517:1874741493435264:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787893290.089176:0:19517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893290.089212:0:19517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c70b8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787893290.089313:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493435264 00000100:00100000:2.0:1787893290.089319:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493435264 00000100:00100000:2.0:1787893290.089360:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787893290.089368:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+22:19517:x1874741493435264:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787893290.089888:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+22:19517:x1874741493435264:12345-0@lo:502:mount.lustre.0 Request processed in 519us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893290.089896:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787893290.090074:0:19517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d29f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:19517:1874741493435264:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787893290.090283:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1787893290.090324:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1787893290.090340:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1787893290.090353:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1787893290.090366:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1787893290.090378:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1787893290.090390:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1787893290.090403:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1787893290.090414:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1787893290.090442:0:19517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d29f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:19517:1874741493435392:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787893290.090483:0:19517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893290.090595:0:19517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c70b8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787893290.091012:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493435392 00000100:00100000:3.0:1787893290.091019:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493435392 00000100:00100000:2.0:1787893290.091135:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787893290.091145:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+22:19517:x1874741493435392:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787893290.091255:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+22:19517:x1874741493435392:12345-0@lo:502:mount.lustre.0 Request processed in 111us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893290.091264:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787893290.091416:0:19517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d29f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:19517:1874741493435392:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787893290.091465:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1787893290.091475:0:19517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1787893290.092182:0:19521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787893290.092191:0:19521:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1787893290.092198:0:19521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893290.092200:0:19521:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787893290.092206:0:19521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787893290.092221:0:19521:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9fc8c74c19b8) 00000020:00000080:0.0:1787893290.092244:0:19521:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787893290.092251:0:19521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787893290.092325:0:19521:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc8c64bb800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787893290.092334:0:19521:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787893290.092342:0:19521:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9232577658cf20d5 00010000:00010000:0.0:1787893290.095863:0:19521:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1787893290.096307:0:19521:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:0.0:1787893290.097875:0:19521:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1787893290.098968:0:19521:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787893290.098979:0:19521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787893290.098985:0:19521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893290.098987:0:19521:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787893290.098990:0:19521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787893290.098993:0:19521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893290.098995:0:19521:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787893290.099070:0:19521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787893290.099072:0:19521:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787893290.099075:0:19521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787893290.099077:0:19521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893290.099078:0:19521:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787893290.099081:0:19521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787893290.099083:0:19521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893290.099085:0:19521:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787893290.099094:0:19521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787893290.099118:0:19521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787893290.099121:0:19521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893290.099123:0:19521:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787893290.099125:0:19521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1787893290.100684:0:19517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1787893290.100739:0:19517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787893290.100769:0:19517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e0000/0x9232577658cf20c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf20c7 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893290.100781:0:19517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e0000/0x9232577658cf20c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf20c7 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787893290.100790:0:19517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc8c64bb800 from 1 10000000:01000000:3.0:1787893290.100792:0:19517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787893290.100829:0:19517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6a00/0x9232577658cf20dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893290.100837:0:19517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6a00/0x9232577658cf20dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893290.100848:0:19517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6a00/0x9232577658cf20dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893290.100872:0:19517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8507800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:19517:1874741493435520:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787893290.100939:0:19517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893290.100983:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493435520 00000100:00100000:3.0:1787893290.100991:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493435520 00000100:00100000:3.0:1787893290.101827:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787893290.101838:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+22:19517:x1874741493435520:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787893290.101852:0:17177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893290.101866:0:17177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9c147d400/0x9232577658cf20e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf20dc expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893290.101890:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9c147d400/0x9232577658cf20e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf20dc expref: 23 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893290.101914:0:17177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9c147d400/0x9232577658cf20e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf20dc expref: 23 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893290.101924:0:17177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9c147d400, rc 0) 00000100:00100000:3.0:1787893290.101967:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+23:19517:x1874741493435520:12345-0@lo:101:mount.lustre.0 Request processed in 131us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893290.101974:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787893290.102091:0:19517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c76863c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787893290.102115:0:19517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8507800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:19517:1874741493435520:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787893290.102130:0:19517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6a00/0x9232577658cf20dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf20e3 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893290.102139:0:19517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6a00/0x9232577658cf20dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf20e3 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787893290.104463:0:19517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1787893290.104775:0:19517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787893290.104957:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1787893290.104983:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1787893290.106328:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1787893290.106348:0:19517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1787893290.106456:0:19517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8507800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:19517:1874741493435648:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787893290.106705:0:19517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893290.106744:0:19517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7686480 going to sleep for 11 seconds 00000100:00100000:2.0:1787893290.107175:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493435648 00000100:00100000:2.0:1787893290.107184:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493435648 00000100:00100000:2.0:1787893290.107269:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787893290.107279:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+23:19517:x1874741493435648:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787893290.107410:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+23:19517:x1874741493435648:12345-0@lo:501:mount.lustre.0 Request processed in 132us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893290.107418:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787893290.107517:0:19517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8507800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:19517:1874741493435648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787893290.107564:0:19517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:19517:1874741493435776:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787893290.107610:0:19517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893290.109571:0:19517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fe47fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1787893290.109806:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493435776 00000100:00100000:3.0:1787893290.109815:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493435776 00000100:00100000:3.0:1787893290.109858:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787893290.109867:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+23:19517:x1874741493435776:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787893290.110020:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+23:19517:x1874741493435776:12345-0@lo:503:mount.lustre.0 Request processed in 154us (2409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893290.110028:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787893290.110170:0:19517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:19517:1874741493435776:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787893290.110617:0:19517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787893290.110704:0:19517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:19517:1874741493435904:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787893290.110756:0:19517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893290.110779:0:19517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fe47fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1787893290.110846:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493435904 00000100:00100000:3.0:1787893290.110852:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493435904 00000100:00100000:3.0:1787893290.110875:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787893290.110882:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+23:19517:x1874741493435904:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787893290.110967:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+23:19517:x1874741493435904:12345-0@lo:502:mount.lustre.0 Request processed in 84us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893290.110974:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787893290.111123:0:19517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:19517:1874741493435904:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787893290.111317:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787893290.111344:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787893290.111358:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787893290.111373:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787893290.111388:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787893290.111402:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787893290.111416:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787893290.111431:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1787893290.111445:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787893290.111459:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1787893290.111474:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1787893290.111526:0:19517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:19517:1874741493436032:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787893290.111570:0:19517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893290.111588:0:19517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fe47fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1787893290.111645:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493436032 00000100:00100000:3.0:1787893290.111650:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493436032 00000100:00100000:3.0:1787893290.111672:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787893290.111679:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+23:19517:x1874741493436032:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787893290.111759:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+23:19517:x1874741493436032:12345-0@lo:502:mount.lustre.0 Request processed in 79us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893290.111766:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787893290.111839:0:19517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:19517:1874741493436032:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787893290.111875:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1787893290.111883:0:19517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1787893290.112550:0:19525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787893290.112561:0:19525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893290.112563:0:19525:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787893290.112569:0:19525:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc8c64bb800 00000020:00000080:1.0:1787893290.112572:0:19525:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787893290.112580:0:19525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787893290.112583:0:19525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893290.112584:0:19525:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787893290.112586:0:19525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787893290.112594:0:19525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893290.112595:0:19525:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787893290.112598:0:19525:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc8c64bb800 00000020:00000080:1.0:1787893290.112600:0:19525:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787893290.112653:0:19525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787893290.112657:0:19525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893290.112659:0:19525:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787893290.112661:0:19525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787893290.112663:0:19525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893290.112664:0:19525:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787893290.112667:0:19525:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc8c64bb800 00000020:00000080:1.0:1787893290.112669:0:19525:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787893290.112685:0:19525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787893290.112688:0:19525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893290.112689:0:19525:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787893290.112691:0:19525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787893290.112693:0:19525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893290.112695:0:19525:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787893290.112698:0:19525:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc8c64bb800 00000020:00000080:1.0:1787893290.112699:0:19525:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787893290.112720:0:19525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787893290.112723:0:19525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893290.112724:0:19525:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787893290.112726:0:19525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1787893290.112854:0:19517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787893290.112883:0:19517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787893290.112909:0:19517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6a00/0x9232577658cf20dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf20e3 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893290.112920:0:19517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6a00/0x9232577658cf20dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf20e3 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787893290.112967:0:19517:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787893290.112970:0:19517:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fc8c64bb800 10000000:01000000:3.0:1787893290.112978:0:19517:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fc8c64bb800 10000000:01000000:3.0:1787893290.112981:0:19517:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787893290.112987:0:19517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc8c64bb800 from 1 10000000:01000000:3.0:1787893290.112989:0:19517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787893290.113031:0:19517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ca00/0x9232577658cf20ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893290.113039:0:19517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ca00/0x9232577658cf20ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893290.113049:0:19517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ca00/0x9232577658cf20ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893290.113066:0:19517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8504380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:19517:1874741493436160:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787893290.113111:0:19517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893290.113143:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493436160 00000100:00100000:3.0:1787893290.113148:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493436160 00000100:00100000:3.0:1787893290.113176:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787893290.113185:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+23:19517:x1874741493436160:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787893290.113195:0:17177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893290.113207:0:17177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9c147dc00/0x9232577658cf20f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf20ea expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893290.113231:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9c147dc00/0x9232577658cf20f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf20ea expref: 24 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893290.113241:0:17177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9c147dc00/0x9232577658cf20f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf20ea expref: 24 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893290.113249:0:17177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9c147dc00, rc 0) 00000100:00100000:3.0:1787893290.113283:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:19517:x1874741493436160:12345-0@lo:101:mount.lustre.0 Request processed in 100us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893290.113291:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787893290.113322:0:19517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7686480 going to sleep for 11 seconds 00000100:00100000:3.0:1787893290.113339:0:19517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8504380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:19517:1874741493436160:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787893290.113352:0:19517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ca00/0x9232577658cf20ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf20f1 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893290.113362:0:19517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ca00/0x9232577658cf20ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf20f1 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787893290.114574:0:19517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:3.0:1787893290.114827:0:19517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787893290.115075:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787893290.115102:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1787893290.115119:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1787893290.115135:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1787893290.115152:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1787893290.115166:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1787893290.115184:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1787893290.115212:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1787893290.115229:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1787893290.115242:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1787893290.115256:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1787893290.115270:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1787893290.115285:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1787893290.115299:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1787893290.115312:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1787893290.115327:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1787893290.115341:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1787893290.115352:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1787893290.115377:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1787893290.115390:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1787893290.115401:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1787893290.115412:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1787893290.115425:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1787893290.115451:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1787893290.115467:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1787893290.115480:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1787893290.115520:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1787893290.115537:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1787893290.115565:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1787893290.115581:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1787893290.115594:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1787893290.115608:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1787893290.115622:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1787893290.115634:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1787893290.115647:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1787893290.115659:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1787893290.115671:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1787893290.115682:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1787893290.115696:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:3.0:1787893290.115724:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:3.0:1787893290.115741:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:3.0:1787893290.115755:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:3.0:1787893290.115769:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:3.0:1787893290.115783:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:3.0:1787893290.115797:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:3.0:1787893290.115810:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:3.0:1787893290.115829:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:3.0:1787893290.115834:0:19517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:3.0:1787893290.115923:0:19517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8504380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:19517:1874741493436288:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787893290.115988:0:19517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893290.116299:0:19517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7686f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787893290.116418:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493436288 00000100:00100000:2.0:1787893290.116425:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493436288 00000100:00100000:2.0:1787893290.116467:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787893290.116476:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:19517:x1874741493436288:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787893290.116637:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:19517:x1874741493436288:12345-0@lo:501:mount.lustre.0 Request processed in 161us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893290.116644:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787893290.116781:0:19517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8504380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:19517:1874741493436288:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787893290.116815:0:19517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8504380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:19517:1874741493436416:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787893290.116854:0:19517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893290.116871:0:19517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7686f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787893290.116922:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493436416 00000100:00100000:2.0:1787893290.116927:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493436416 00000100:00100000:2.0:1787893290.116946:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787893290.116952:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:19517:x1874741493436416:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787893290.117045:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:19517:x1874741493436416:12345-0@lo:503:mount.lustre.0 Request processed in 93us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893290.117052:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787893290.117186:0:19517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8504380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:19517:1874741493436416:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787893290.117587:0:19517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787893290.117646:0:19517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8504380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:19517:1874741493436544:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787893290.117682:0:19517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893290.117699:0:19517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7686480 going to sleep for 11 seconds 00000100:00100000:2.0:1787893290.117769:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493436544 00000100:00100000:2.0:1787893290.117773:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493436544 00000100:00100000:2.0:1787893290.117796:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787893290.117803:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd285c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:19517:x1874741493436544:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787893290.117887:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd285c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:19517:x1874741493436544:12345-0@lo:502:mount.lustre.0 Request processed in 83us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893290.117894:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787893290.117959:0:19517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8504380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:19517:1874741493436544:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787893290.118120:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787893290.118146:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1787893290.118161:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1787893290.118175:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1787893290.118189:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1787893290.118204:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1787893290.118232:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1787893290.118248:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1787893290.118261:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787893290.118274:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1787893290.118287:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1787893290.118300:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1787893290.118313:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1787893290.118327:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1787893290.118340:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1787893290.118353:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1787893290.118364:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1787893290.118390:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1787893290.118403:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1787893290.118415:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1787893290.118428:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1787893290.118441:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1787893290.118466:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1787893290.118481:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1787893290.118532:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1787893290.118561:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1787893290.118574:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1787893290.118586:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1787893290.118597:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1787893290.118610:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1787893290.118621:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1787893290.118632:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1787893290.118643:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1787893290.118655:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1787893290.118667:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1787893290.118680:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1787893290.118693:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1787893290.118704:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1787893290.118728:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1787893290.118744:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1787893290.118756:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1787893290.118767:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1787893290.118779:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1787893290.118791:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1787893290.118805:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1787893290.118817:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1787893290.118829:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1787893290.118843:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1787893290.118881:0:19517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8504380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:19517:1874741493436672:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787893290.118932:0:19517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893290.118965:0:19517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7686480 going to sleep for 11 seconds 00000100:00100000:2.0:1787893290.119112:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493436672 00000100:00100000:2.0:1787893290.119117:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493436672 00000100:00100000:2.0:1787893290.119146:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787893290.119153:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd286450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:19517:x1874741493436672:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787893290.119249:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd286450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:19517:x1874741493436672:12345-0@lo:502:mount.lustre.0 Request processed in 96us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893290.119257:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787893290.119335:0:19517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8504380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:19517:1874741493436672:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787893290.119477:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1787893290.121145:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1787893290.121205:0:19517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8504380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:19517:1874741493436800:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787893290.121275:0:19517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893290.121311:0:19517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7686480 going to sleep for 11 seconds 00000100:00100000:0.0:1787893290.121379:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493436800 00000100:00100000:0.0:1787893290.121386:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493436800 00000100:00100000:1.0:1787893290.128780:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787893290.128793:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd285450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:19517:x1874741493436800:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787893290.128961:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd285450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:19517:x1874741493436800:12345-0@lo:502:mount.lustre.0 Request processed in 169us (7685us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893290.128969:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787893290.132177:0:19517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8504380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:19517:1874741493436800:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787893290.132283:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1787893290.132297:0:19517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1787893290.135232:0:19529:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787893290.135250:0:19529:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9fc9e735cd28) 00000020:00000080:1.0:1787893290.135280:0:19529:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1787893290.135368:0:19529:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc8c64bb800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787893290.135373:0:19529:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc8c64bb800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787893290.135375:0:19529:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc8c64bb800 3 00010000:00080000:1.0:1787893290.135405:0:19529:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc9ffc1b800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.135@tcp at head 00010000:00010000:1.0:1787893290.142226:0:19529:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1787893290.142455:0:19529:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787893290.142517:0:19529:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787893290.142531:0:19529:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9232577658cf20ff 00000100:00080000:1.0:1787893290.142550:0:19529:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787893290.142557:0:19529:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fc9ffc1b800 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:1.0:1787893290.142594:0:19529:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c64b5500 x1874741493436928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787893290.142615:0:19529:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787893290.145369:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c64b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3629:1874741493436928:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787893290.145445:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893290.145616:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493436928 00000100:00100000:0.0:1787893290.145623:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493436928 00000100:00100000:0.0:1787893290.145658:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787893290.145664:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3629:x1874741493436928:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787893290.145690:0:17183:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:0.0:1787893290.145726:0:17183:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9232577658cf2106 00000004:00100000:0.0:1787893290.145740:0:17183:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787893290.145771:0:17183:0:(import.c:65:import_set_state_nolock()) ffff9fc8c5e4d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787893290.145819:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1874741493436928:12345-0@lo:38:llog_process_th.0 Request processed in 153us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893290.145827:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787893290.145884:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c64b5500 x1874741493436928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787893300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893290.145896:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787893290.145904:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1787893290.145912:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787893290.145917:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787893290.145919:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9ffc1b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787893290.145924:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c64b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3629:1874741493436928:0@lo:38:llog_process_th.0 00000020:01000004:0.0:1787893290.147667:0:19529:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787893290.147694:0:19529:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9fc8c71d99b8) 00000020:00000080:0.0:1787893290.147718:0:19529:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1787893290.147797:0:19529:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc8c64bb800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787893290.147801:0:19529:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc8c64bb800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787893290.147804:0:19529:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc8c64bb800 3 00010000:00080000:0.0:1787893290.147834:0:19529:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc8c5e4b800@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.135@tcp at head 00010000:00010000:0.0:1787893290.161379:0:19529:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000100:00100000:0.0:1787893290.164371:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d29fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493437056:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787893290.164446:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893290.164555:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493437056 00000100:00100000:0.0:1787893290.164562:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493437056 00000100:00100000:0.0:1787893290.167410:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787893290.167421:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493437056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787893290.167444:0:18705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787893290.167552:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493437056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 122us (3095us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893290.167559:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787893290.167831:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d29fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493437056:0@lo:13:osp-pre-0-1.0 00000020:00000080:0.0:1787893290.167992:0:19529:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1787893290.168040:0:19529:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787893290.168049:0:19529:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x9232577658cf2114 00000100:00080000:0.0:1787893290.168055:0:19529:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787893290.168059:0:19529:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9fc8c5e4b800 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:0.0:1787893290.168078:0:19529:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9d29fa300 x1874741493437312/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787893290.168101:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d29fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3629:1874741493437312:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787893290.168144:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893290.168185:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493437312 00000100:00100000:0.0:1787893290.168190:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493437312 00000100:00100000:0.0:1787893290.168212:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787893290.168218:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3629:x1874741493437312:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787893290.168239:0:17185:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:0.0:1787893290.168271:0:17185:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x9232577658cf211b 00000004:00100000:0.0:1787893290.168283:0:17185:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787893290.168306:0:17185:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7419800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787893290.168335:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1874741493437312:12345-0@lo:38:llog_process_th.0 Request processed in 117us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893290.168340:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787893290.168360:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9d29fa300 x1874741493437312/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787893300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893290.168366:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787893290.168370:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1787893290.168375:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787893290.168377:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787893290.168379:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc8c5e4b800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787893290.168382:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d29fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3629:1874741493437312:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1787893290.168392:0:19529:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1787893290.169644:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493437184:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787893290.169700:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893290.169777:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493437184 00000100:00100000:1.0:1787893290.169783:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493437184 00000100:00100000:1.0:1787893290.169823:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787893290.169832:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493437184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787893290.169862:0:17188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787893290.169913:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493437184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893290.169920:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787893290.169979:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493437184:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1787893290.170270:0:19529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1787893290.170609:0:19517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1787893290.170667:0:19517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787893290.170694:0:19517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ca00/0x9232577658cf20ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf20f1 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893290.170882:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7789180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493437440:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787893290.170948:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893290.173864:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493437440 00000100:00100000:0.0:1787893290.173880:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493437440 00000100:00100000:0.0:1787893290.173941:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787893290.173952:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493437440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787893290.173994:0:18203:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787893290.177307:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493437440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3347us (6349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893290.177322:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787893290.177458:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7789180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493437440:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787893290.185802:0:19517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ca00/0x9232577658cf20ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf20f1 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787893290.185926:0:19517:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787893290.185929:0:19517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787893290.185931:0:19517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787893290.185932:0:19517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787893290.185934:0:19517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787893290.185935:0:19517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787893290.185937:0:19517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787893290.185939:0:19517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787893290.185941:0:19517:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787893290.185946:0:19517:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1787893290.185948:0:19517:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787893290.185950:0:19517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787893290.185951:0:19517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787893290.185952:0:19517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787893290.185953:0:19517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787893290.185954:0:19517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787893290.185964:0:19517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787893290.185965:0:19517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787893290.185966:0:19517:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787893290.186018:0:19517:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787893290.186047:0:19517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8504e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:19517:1874741493437568:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787893290.186157:0:19517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893290.186222:0:19517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7686840 going to sleep for 11 seconds 00000100:00100000:2.0:1787893290.186281:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493437568 00000100:00100000:2.0:1787893290.186295:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493437568 00000100:00100000:2.0:1787893290.186400:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787893290.186427:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd286850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:19517:x1874741493437568:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787893290.186460:0:17178:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787893290.186474:0:17178:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787893290.196290:0:17178:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787893290.196312:0:17178:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1787893290.196745:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd286850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:19517:x1874741493437568:12345-0@lo:253:mount.lustre.0 Request processed in 10312us (10579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893290.196760:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787893290.196899:0:19517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8504e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13b37fca-0eda-4b14-a6ef-4a378c945d17:19517:1874741493437568:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787893290.196914:0:19517:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787893290.196918:0:19517:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787893290.196919:0:19517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787893290.196921:0:19517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787893290.196923:0:19517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787893290.196924:0:19517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787893290.196925:0:19517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787893290.196927:0:19517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787893290.196929:0:19517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787893290.196930:0:19517:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787893290.196946:0:19517:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1787893290.202835:0:17199:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787893290.202849:0:17199:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787893290.202885:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fc9edb31200/0x9232577658cf2122 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.202913:0:17199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc8c84f7e00/0x9232577658cf1fcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf1fc4 expref: 23 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.202923:0:17199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc8c84f7600/0x9232577658cf1fd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf1fd2 expref: 23 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.202933:0:17199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fc9edb31200/0x9232577658cf2122 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.202994:0:17199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc8c84f7600/0x9232577658cf1fd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf1fd2 expref: 23 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.203012:0:17199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc8c84f7600/0x9232577658cf1fd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf1fd2 expref: 23 pid: 17177 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893290.203030:0:17199:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d29fa300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17199:1874741493437696:0@lo:104: 00000100:00100000:0.0:1787893290.203140:0:17199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787893290.203222:0:17199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc8c84f7e00/0x9232577658cf1fcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf1fc4 expref: 23 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.203231:0:17199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc8c84f7e00/0x9232577658cf1fcb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf1fc4 expref: 23 pid: 17175 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893290.203260:0:17199:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d29f9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17199:1874741493437824:0@lo:104: 00000100:00100000:3.0:1787893290.203276:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493437696 00000100:00100000:0.0:1787893290.203290:0:17199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893290.203291:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493437696 00000100:00100000:0.0:1787893290.203321:0:17199:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c299bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787893290.203334:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493437824 00000100:00100000:3.0:1787893290.203339:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493437824 00000100:00100000:3.0:1787893290.203364:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787893290.203374:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13b37fca-0eda-4b14-a6ef-4a378c945d17+4:17199:x1874741493437696:12345-0@lo:104: 00010000:00010000:3.0:1787893290.203393:0:17166:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6000/0x9232577658cf1fd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf1fd9 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893290.203482:0:17166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787893290.203507:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13b37fca-0eda-4b14-a6ef-4a378c945d17+4:17199:x1874741493437696:12345-0@lo:104: Request processed in 117us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893290.203515:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787893290.203534:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787893290.203552:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13b37fca-0eda-4b14-a6ef-4a378c945d17+3:17199:x1874741493437824:12345-0@lo:104: 00010000:00010000:3.0:1787893290.203561:0:17166:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9c4152a00/0x9232577658cf1fc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf1fcb expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893290.203617:0:17166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787893290.203622:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13b37fca-0eda-4b14-a6ef-4a378c945d17+3:17199:x1874741493437824:12345-0@lo:104: Request processed in 83us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893290.203629:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1787893290.203928:0:17172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787893290.203935:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6000/0x9232577658cf1fd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf1fd9 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893290.203944:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c84f6000 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:1.0:1787893290.203948:0:17172:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6000/0x9232577658cf1fd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf1fd9 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893290.203957:0:17172:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6000/0x9232577658cf1fd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf1fd9 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787893290.203964:0:17172:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6000/0x9232577658cf1fd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf1fd9 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893290.203970:0:17172:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787893290.204122:0:17172:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6000/0x9232577658cf1fd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf1fd9 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893290.204130:0:17172:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787893290.204162:0:17171:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893290.204171:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6000/0x9232577658cf1fd2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf1fd9 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893290.204180:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6000/0x9232577658cf1fd2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf1fd9 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893290.204194:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893290.204196:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893290.204198:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893290.204224:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13b37fca-0eda-4b14-a6ef-4a378c945d17:3632:1874741493437952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787893290.204272:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893290.204355:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493437952 00000100:00100000:0.0:1787893290.204358:0:17199:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d29fa300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17199:1874741493437696:0@lo:104: 00000100:00100000:1.0:1787893290.204363:0:17170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493437952 00000100:00100000:0.0:1787893290.204378:0:17199:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d29f9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17199:1874741493437824:0@lo:104: 00010000:00010000:1.0:1787893290.204392:0:17170:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc8c84f7600/0x9232577658cf1fd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf1fd2 expref: 24 pid: 17177 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.204405:0:17199:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fc9edb31200/0x9232577658cf2122 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893290.204425:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787893290.204435:0:17170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:3632:x1874741493437952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787893290.204448:0:17170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893290.204454:0:17170:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc8c84f7600/0x9232577658cf1fd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf1fd2 expref: 24 pid: 17177 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893290.204467:0:17170:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc8c84f7600/0x9232577658cf1fd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf1fd2 expref: 24 pid: 17177 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893290.204482:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c84f7600/0x9232577658cf1fd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf1fd2 expref: 24 pid: 17177 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893290.204529:0:17170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787893290.204550:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893290.204561:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9c4152a00/0x9232577658cf1fc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf1fcb expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.204572:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c4152a00 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:0.0:1787893290.204576:0:17171:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c4152a00/0x9232577658cf1fc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf1fcb expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893290.204585:0:17170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13b37fca-0eda-4b14-a6ef-4a378c945d17+23:3632:x1874741493437952:12345-0@lo:103:ldlm_bl.0 Request processed in 147us (308us total) trans 0 rc 0/0 00010000:00010000:0.0:1787893290.204596:0:17171:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9c4152a00/0x9232577658cf1fc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf1fcb expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893290.204602:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 10000000:00010000:0.0:1787893290.204619:0:17171:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c4152a00/0x9232577658cf1fc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf1fcb expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787893290.204626:0:17171:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787893290.204661:0:17171:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9c4152a00/0x9232577658cf1fc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf1fcb expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893290.204663:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13b37fca-0eda-4b14-a6ef-4a378c945d17:3632:1874741493437952:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787893290.204679:0:17171:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787893290.204717:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9c4152a00/0x9232577658cf1fc4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf1fcb expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.204726:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9c4152a00/0x9232577658cf1fc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf1fcb expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893290.204734:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d29f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13b37fca-0eda-4b14-a6ef-4a378c945d17:3633:1874741493438080:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787893290.204750:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893290.204754:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893290.204757:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893290.204767:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893290.204771:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893290.204772:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893290.204808:0:17169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493438080 00000100:00100000:0.0:1787893290.204816:0:17169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493438080 00010000:00010000:0.0:1787893290.204839:0:17169:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc8c84f7e00/0x9232577658cf1fcb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf1fc4 expref: 23 pid: 17175 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893290.204874:0:17169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787893290.204881:0:17169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:13b37fca-0eda-4b14-a6ef-4a378c945d17+23:3633:x1874741493438080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787893290.204894:0:17169:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893290.204899:0:17169:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc8c84f7e00/0x9232577658cf1fcb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf1fc4 expref: 23 pid: 17175 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.204910:0:17169:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc8c84f7e00/0x9232577658cf1fcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf1fc4 expref: 23 pid: 17175 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.204922:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c84f7e00/0x9232577658cf1fcb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf1fc4 expref: 23 pid: 17175 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.204937:0:17169:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fc9edb31200/0x9232577658cf2122 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.204958:0:17169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9edb31200/0x9232577658cf2122 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787893290.204978:0:17169:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.028463491s 00010000:00010000:0.0:1787893290.204983:0:17169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc9edb31200/0x9232577658cf2122 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.204992:0:17169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc9edb31200/0x9232577658cf2122 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.205000:0:17169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fc9edb31200/0x9232577658cf2122 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.205007:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fc9edb31200/0x9232577658cf2122 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.205012:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31200 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893290.205017:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fc9edb31200/0x9232577658cf2122 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.205025:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fc9edb31200/0x9232577658cf2122 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.205044:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fc9edb31200/0x9232577658cf2122 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.205055:0:17169:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893290.205102:0:17169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:13b37fca-0eda-4b14-a6ef-4a378c945d17+22:3633:x1874741493438080:12345-0@lo:103:ldlm_bl.0 Request processed in 220us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893290.205112:0:17169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1787893290.205147:0:17199:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fc9edb31200/0x9232577658cf2122 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.205157:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fc9edb31200/0x9232577658cf2122 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893290.205164:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9edb31200/0x9232577658cf2122 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893290.205651:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d29f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13b37fca-0eda-4b14-a6ef-4a378c945d17:3633:1874741493438080:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1787893290.209427:0:19517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1787893290.214819:0:19517:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787893290.214830:0:19517:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787893290.214869:0:19517:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787893290.214914:0:19517:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.135@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787893290.214932:0:19517:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1787893290.214958:0:19517:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1787893290.215866:0:19517:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787893290.216104:0:19517:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787893290.483312:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787893291.235041:0:19586:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787893291.235384:0:19586:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1787893291.315887:0:17180:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787893291.315895:0:17180:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc9ffb45000 from 10 10000000:01000000:1.0:1787893291.315902:0:17180:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787893291.315963:0:17180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540400/0x9232577658cf2129 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893291.315975:0:17180:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540400/0x9232577658cf2129 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893291.315987:0:17180:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540400/0x9232577658cf2129 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893291.316097:0:17180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493438208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787893291.316400:0:17180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893291.316896:0:17180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c4d98e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787893291.316973:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493438208 00000100:00100000:0.0:1787893291.316981:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493438208 00000040:00080000:2.0:1787893291.317147:0:17937:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787893291.317951:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787893291.317968:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd285050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+22:17180:x1874741493438208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787893291.317987:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893291.318007:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf2130 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf2129 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893291.318043:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf2130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf2129 expref: 23 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893291.318053:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf2130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf2129 expref: 23 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893291.318062:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb30c00, rc 0) 00000100:00100000:0.0:1787893291.318149:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd285050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+23:17180:x1874741493438208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (1750us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893291.318155:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787893291.319515:0:17180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493438208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787893291.319563:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540400/0x9232577658cf2129 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf2130 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893291.319579:0:17180:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540400/0x9232577658cf2129 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf2130 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893291.319687:0:17180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7789c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493438336:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787893291.319893:0:17180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893291.325941:0:17180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fe47fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787893291.326862:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493438336 00000100:00100000:1.0:1787893291.326882:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493438336 00000100:00100000:1.0:1787893291.326959:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787893291.326970:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd287850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+23:17180:x1874741493438336:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787893291.326996:0:17177:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787893291.327090:0:17177:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787893291.327094:0:17177:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1787893291.327328:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd287850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+23:17180:x1874741493438336:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 360us (7434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893291.327337:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787893291.327383:0:17180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7789c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493438336:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787893291.327488:0:17180:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787893291.327563:0:17180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540400/0x9232577658cf2129 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf2130 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893291.327576:0:17180:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540400/0x9232577658cf2129 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf2130 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893291.327589:0:17180:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787893291.327592:0:17180:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc9d0f72800 from 10 10000000:01000000:2.0:1787893291.327595:0:17180:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787893291.328367:0:17180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf2137 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893291.328381:0:17180:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf2137 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893291.328395:0:17180:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf2137 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893291.328423:0:17180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7789c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493438464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787893291.328517:0:17180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893291.328577:0:17180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fe47fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787893291.328629:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493438464 00000100:00100000:0.0:1787893291.328639:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493438464 00000100:00100000:0.0:1787893291.328695:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787893291.328715:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd284850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+23:17180:x1874741493438464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787893291.328730:0:17178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893291.328749:0:17178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9edb30400/0x9232577658cf213e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf2137 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893291.328775:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9edb30400/0x9232577658cf213e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf2137 expref: 24 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893291.328786:0:17178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9edb30400/0x9232577658cf213e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf2137 expref: 24 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893291.328796:0:17178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb30400, rc 0) 00000100:00100000:0.0:1787893291.328862:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd284850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:17180:x1874741493438464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893291.328869:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787893291.329089:0:17180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7789c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493438464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787893291.329109:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf2137 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf213e expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893291.329121:0:17180:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf2137 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf213e expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893291.329182:0:17180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7789c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493438592:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787893291.329235:0:17180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893291.329266:0:17180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fe47fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787893291.329415:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493438592 00000100:00100000:0.0:1787893291.329424:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493438592 00000100:00100000:0.0:1787893291.329453:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787893291.329459:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd287050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:17180:x1874741493438592:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787893291.329472:0:17175:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787893291.329509:0:17175:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787893291.329512:0:17175:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1787893291.330478:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd287050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:17180:x1874741493438592:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1011us (1237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893291.330523:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787893291.330859:0:17180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7789c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493438592:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787893291.330946:0:17180:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787893291.330962:0:17180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf2137 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf213e expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893291.330974:0:17180:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf2137 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf213e expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893291.508706:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893292.535653:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893293.555349:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893294.579484:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893295.282851:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d29fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493438720:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787893295.282934:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893295.282994:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493438720 00000100:00100000:0.0:1787893295.283002:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493438720 00000100:00100000:0.0:1787893295.283055:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787893295.283065:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493438720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787893295.283094:0:18705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787893295.283138:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493438720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893295.283146:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787893295.283168:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787893295.283202:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d29fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493438720:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787893295.284605:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493438848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787893295.284656:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893295.284703:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493438848 00000100:00100000:3.0:1787893295.284709:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493438848 00000100:00100000:3.0:1787893295.284753:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787893295.284761:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493438848:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787893295.284874:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787893295.284879:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787893295.284882:0:38:0:(import.c:65:import_set_state_nolock()) ffff9fc9e5eaa000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787893295.284887:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 533 00000100:00080000:2.0:1787893295.284891:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787893295.284897:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fc9e5eaa000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:2.0:1787893295.284915:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c7788a80 x1874741493439232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787893295.284946:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787893295.284950:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787893295.284951:0:38:0:(import.c:65:import_set_state_nolock()) ffff9fc9d29e9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787893295.284955:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 533 00000100:00080000:2.0:1787893295.284957:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787893295.284960:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9fc9d29e9000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:2.0:1787893295.284972:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c778a680 x1874741493439616/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787893295.286551:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7788a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493439232:0@lo:8:kworker.0 00000100:00100000:0.0:1787893295.286623:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893295.286657:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c778a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493439616:0@lo:8:kworker.0 00000100:00100000:0.0:1787893295.286679:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893295.286718:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493439232 00000100:00100000:0.0:1787893295.286724:0:18702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493439232 00000100:00100000:0.0:1787893295.286755:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493439616 00000100:00100000:0.0:1787893295.286758:0:18702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493439616 00000100:00100000:0.0:1787893295.286773:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787893295.286853:0:18702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3629:x1874741493439232:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787893295.286886:0:18702:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 539 last 0 00000020:00000080:0.0:1787893295.286915:0:18702:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9232577658cf2145 00002000:00100000:0.0:1787893295.286929:0:18702:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9fc8c5e49000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787893295.286933:0:18702:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1787893295.286935:0:18702:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787893295.287101:0:18702:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787893295.287125:0:18702:0:(import.c:65:import_set_state_nolock()) ffff9fc8c5e48000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787893295.287175:0:18702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3629:x1874741493439232:12345-0@lo:8:kworker.0 Request processed in 323us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893295.287182:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787893295.287201:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787893295.287205:0:18702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3629:x1874741493439616:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787893295.287220:0:18702:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 539 last 0 00000020:00000080:0.0:1787893295.287235:0:18702:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9232577658cf214c 00002000:00100000:0.0:1787893295.287241:0:18702:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9fc8c5e4c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1787893295.287245:0:18702:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1787893295.287246:0:18702:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787893295.287267:0:18702:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1787893295.287278:0:18702:0:(import.c:65:import_set_state_nolock()) ffff9fc8c5e4a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787893295.287306:0:18702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3629:x1874741493439616:12345-0@lo:8:kworker.0 Request processed in 99us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893295.287312:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1787893295.287351:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7788a80 x1874741493439232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787893320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893295.287362:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787893295.287369:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00002000:00000024:3.0:1787893295.287515:0:18705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787893295.287556:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493438848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2794us (2898us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893295.287564:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787893295.287588:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787893295.287631:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7788380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493439360:0@lo:400:kworker.0 00000100:00100000:3.0:1787893295.287664:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893295.287686:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7789500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493440000:0@lo:400:kworker.0 00000100:00100000:3.0:1787893295.287711:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893295.287744:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787893295.287751:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c778a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493439488:0@lo:400:kworker.0 00000100:00100000:3.0:1787893295.287775:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893295.287867:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7789c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1874741493440128:0@lo:400:kworker.0 00000100:00100000:3.0:1787893295.287892:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893295.287920:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493439360 00000100:00100000:3.0:1787893295.287926:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493439360 00000100:00100000:3.0:1787893295.287952:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493440000 00000100:00100000:3.0:1787893295.287955:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493440000 00000100:00100000:3.0:1787893295.287977:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493440128 00000100:00100000:3.0:1787893295.287980:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493440128 00000100:00100000:3.0:1787893295.287994:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787893295.288000:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8504380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493439360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893295.288038:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8504380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493439360:12345-0@lo:400:kworker.0 Request processed in 38us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893295.288045:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787893295.288057:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787893295.288064:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493440000:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787893295.288890:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787893295.288897:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787893295.288901:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9e5eaa000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787893295.288917:0:3629:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787893295.288924:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7788a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493439232:0@lo:8:kworker.0 00000100:00100000:1.0:1787893295.288996:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c778bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13b37fca-0eda-4b14-a6ef-4a378c945d17:3632:1874741493438976:0@lo:400:kworker.0 00010000:00080000:0.0:1787893295.293098:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c778a680 x1874741493439616/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787893320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893295.293113:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787893295.293122:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1787893295.293131:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787893295.293137:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787893295.293140:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9d29e9000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787893295.293162:0:3629:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787893295.293168:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c778a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493439616:0@lo:8:kworker.0 00000004:00080000:0.0:1787893295.293236:0:17210:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:0.0:1787893295.293254:0:17210:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d29f9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17210:1874741493440512:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787893295.293304:0:17210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893295.293327:0:17210:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c85e8840 going to sleep for 11 seconds 00000004:00080000:0.0:1787893295.293349:0:17927:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787893295.293362:0:17927:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d29f9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17927:1874741493440768:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1787893295.293393:0:17927:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893295.293405:0:17927:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c5faaa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787893295.293419:0:19239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493440512 00000100:00100000:0.0:1787893295.293424:0:19239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493440512 00000100:00100000:0.0:1787893295.293456:0:19239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493440768 00000100:00100000:0.0:1787893295.293458:0:19239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493440768 00000100:00100000:0.0:1787893295.293471:0:19239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787893295.293478:0:19239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17210:x1874741493440512:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787893295.293715:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787893295.293724:0:18702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17927:x1874741493440768:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1787893295.293913:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c778b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493439104:0@lo:400:kworker.0 00000100:00100000:0.0:1787893295.293942:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893295.293968:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c778aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1874741493439872:0@lo:400:kworker.0 00000100:00100000:0.0:1787893295.293988:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893295.293997:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d29f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493440384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787893295.294019:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893295.294081:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493439488 00000100:00100000:0.0:1787893295.294085:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493439488 00000100:00100000:0.0:1787893295.294107:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493439104 00000100:00100000:0.0:1787893295.294109:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493439104 00000100:00100000:0.0:1787893295.294120:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787893295.294125:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493439488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893295.294159:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493439488:12345-0@lo:400:kworker.0 Request processed in 34us (6383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893295.294165:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787893295.294177:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787893295.294182:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493439104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893295.294204:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493439104:12345-0@lo:400:kworker.0 Request processed in 23us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893295.294209:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787893295.294233:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c778b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493439104:0@lo:400:kworker.0 00000004:00080000:0.0:1787893295.295686:0:17209:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787893295.295763:0:17209:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 539117270985ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787893295.295770:0:17209:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1787893295.296000:0:17926:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787893295.296048:0:17926:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 539117556139ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787893295.296054:0:17926:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1787893295.296258:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893295.296307:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7789f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493439744:0@lo:400:kworker.0 00000100:00100000:1.0:1787893295.296340:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893295.296354:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7789180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493440256:0@lo:400:kworker.0 00000100:00100000:1.0:1787893295.296393:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893295.296578:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493438976 00000100:00100000:0.0:1787893295.296585:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493438976 00000100:00100000:0.0:1787893295.296666:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787893295.296676:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd286050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:3632:x1874741493438976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893295.296728:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd286050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:3632:x1874741493438976:12345-0@lo:400:kworker.0 Request processed in 53us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893295.296736:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787893295.298472:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493440000:12345-0@lo:400:kworker.0 Request processed in 10402us (10753us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893295.298486:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787893295.298553:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493439872 00000100:00100000:3.0:1787893295.298561:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493439872 00000100:00100000:3.0:1787893295.298593:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493439744 00000100:00100000:3.0:1787893295.298596:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493439744 00000100:00100000:3.0:1787893295.298606:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493440256 00000100:00100000:3.0:1787893295.298608:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493440256 00000100:00100000:3.0:1787893295.298625:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787893295.298633:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874741493440128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893295.298701:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874741493440128:12345-0@lo:400:kworker.0 Request processed in 68us (10808us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893295.298707:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787893295.298722:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787893295.298728:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1874741493439872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893295.298773:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1874741493439872:12345-0@lo:400:kworker.0 Request processed in 44us (4783us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893295.299115:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787893295.299129:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787893295.299136:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493439744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893295.299164:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493439744:12345-0@lo:400:kworker.0 Request processed in 29us (2824us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893295.299169:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787893295.299178:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787893295.299183:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493440256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893295.299204:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493440256:12345-0@lo:400:kworker.0 Request processed in 21us (2811us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893295.299209:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1787893295.299234:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787893295.299238:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787893295.299240:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787893295.299291:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d29faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493440640:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787893295.299323:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893295.299362:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c778a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493439488:0@lo:400:kworker.0 00010000:00080000:2.0:1787893295.299524:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c778aa00 x1874741493439872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893295.299536:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c778aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1874741493439872:0@lo:400:kworker.0 00000100:00100000:2.0:1787893295.299548:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787893295.299555:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493441024:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787893295.299587:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787893295.299856:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7789c00 x1874741493440128/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893295.299876:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7789c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1874741493440128:0@lo:400:kworker.0 00010000:00080000:3.0:1787893295.299892:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7788380 x1874741493439360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893295.299900:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7788380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493439360:0@lo:400:kworker.0 00010000:00080000:3.0:1787893295.299911:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7789500 x1874741493440000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893295.299919:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7789500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493440000:0@lo:400:kworker.0 00000100:00100000:3.0:1787893295.299936:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787893295.299941:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d15ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493440896:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787893295.299976:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893295.300011:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493440384 00000100:00100000:3.0:1787893295.300016:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493440384 00000100:00100000:3.0:1787893295.300036:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493440640 00000100:00100000:3.0:1787893295.300038:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493440640 00000100:00100000:3.0:1787893295.300050:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787893295.300057:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3633:x1874741493440384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787893295.300082:0:18706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787893295.300117:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3633:x1874741493440384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (6096us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893295.300123:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787893295.300137:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787893295.300143:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe348380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3630:x1874741493440640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787893295.300152:0:18706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787893295.300178:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe348380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3630:x1874741493440640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893295.300191:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787893295.300217:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9d29faa00 x1874741493440640/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893311 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893295.300231:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d29faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493440640:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787893295.300262:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493438848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787893295.301065:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c778bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13b37fca-0eda-4b14-a6ef-4a378c945d17:3632:1874741493438976:0@lo:400:kworker.0 00010000:00080000:1.0:1787893295.301081:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7789f80 x1874741493439744/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893295.301090:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7789f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493439744:0@lo:400:kworker.0 00010000:00080000:1.0:1787893295.301100:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7789180 x1874741493440256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893295.301107:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7789180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493440256:0@lo:400:kworker.0 00000100:00100000:1.0:1787893295.301555:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493441024 00000100:00100000:1.0:1787893295.301561:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493441024 00000100:00100000:1.0:1787893295.301593:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493440896 00000100:00100000:1.0:1787893295.301596:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493440896 00000100:00100000:1.0:1787893295.301607:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787893295.301614:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c778aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493441024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787893295.301648:0:18203:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787893295.301701:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c778aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493441024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (2112us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893295.301707:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787893295.301721:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787893295.301727:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe349180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493440896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787893295.301743:0:18203:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787893295.301858:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe349180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493440896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 50us (1801us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893295.301865:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787893295.301903:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d15ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493440896:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787893295.302088:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493441024:0@lo:41:osp-pre-1-0.0 00010000:00080000:2.0:1787893295.302105:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9d29f9880 x1874741493440384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893311 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893295.302119:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d29f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493440384:0@lo:13:osp-pre-1-0.0 00002000:00080000:0.0:1787893295.303227:0:19239:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1787893295.303236:0:19239:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1787893295.303242:0:19239:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00002000:00080000:1.0:1787893295.307640:0:18702:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1787893295.307652:0:18702:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1787893295.307748:0:18702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17927:x1874741493440768:12345-0@lo:7:osp-pre-1-1.0 Request processed in 14021us (14350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893295.307759:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1787893295.309590:0:17927:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9d29f9f80 x1874741493440768/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787893311 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893295.309609:0:17927:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d29f9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17927:1874741493440768:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1787893295.309624:0:17927:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1787893295.309666:0:17927:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17927:1874741493441152:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1787893295.309719:0:17927:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893295.309747:0:17927:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9f3e75780 going to sleep for 11 seconds 00000100:00100000:0.0:1787893295.327022:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493441152 00000100:00100000:0.0:1787893295.327036:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493441152 00000100:00100000:0.0:1787893295.327089:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787893295.327099:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17927:x1874741493441152:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1787893295.327130:0:18704:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1787893295.327212:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17927:x1874741493441152:12345-0@lo:5:osp-pre-1-1.0 Request processed in 115us (17493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893295.327218:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1787893295.327261:0:17927:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c76f4e00 x1874741493441152/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787893311 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893295.327276:0:17927:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17927:1874741493441152:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1787893295.327288:0:17927:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1787893295.327325:0:17927:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d15c8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17927:1874741493441280:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1787893295.327353:0:17927:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893295.327399:0:17927:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9f3517a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787893295.327412:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493441280 00000100:00100000:0.0:1787893295.327415:0:18702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493441280 00000100:00100000:0.0:1787893295.327440:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787893295.327446:0:18702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17927:x1874741493441280:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1787893295.327471:0:18702:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00000004:00080000:0.0:1787893295.334912:0:17916:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:0.0:1787893295.334957:0:17163:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:3.0:1787893295.347266:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787893295.347281:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007afcdc65/0x9232577658cf2153 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893295.347299:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1787893295.347303:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893295.347310:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007afcdc65/0x9232577658cf2153 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893295.347328:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007afcdc65/0x9232577658cf2153 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893295.347339:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007afcdc65/0x9232577658cf2153 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893295.347347:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007afcdc65/0x9232577658cf2153 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893295.347362:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787893295.347902:0:19536:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893295.347909:0:19536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007afcdc65/0x9232577658cf2153 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.347918:0:19536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7f800 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787893295.347923:0:19536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007afcdc65/0x9232577658cf2153 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.347931:0:19536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007afcdc65/0x9232577658cf2153 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.347949:0:19536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007afcdc65/0x9232577658cf2153 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.347956:0:19536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007afcdc65/0x9232577658cf2153 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.347977:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893295.347979:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893295.347981:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787893295.348535:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893295.348547:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e368ce9/0x9232577658cf215a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.348557:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1787893295.348561:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893295.348566:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e368ce9/0x9232577658cf215a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.348576:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e368ce9/0x9232577658cf215a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.348585:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e368ce9/0x9232577658cf215a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.348592:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e368ce9/0x9232577658cf215a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.348606:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787893295.348737:0:17172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893295.348743:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e368ce9/0x9232577658cf215a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.348751:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e0400 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787893295.348756:0:17172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e368ce9/0x9232577658cf215a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.348764:0:17172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e368ce9/0x9232577658cf215a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.348792:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e368ce9/0x9232577658cf215a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.348800:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e368ce9/0x9232577658cf215a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.348814:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893295.348816:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893295.348817:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787893295.357638:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787893295.357729:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006eb9ce41/0x9232577658cf2161 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893295.357746:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1787893295.357751:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893295.357757:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006eb9ce41/0x9232577658cf2161 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893295.357772:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006eb9ce41/0x9232577658cf2161 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893295.358881:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006eb9ce41/0x9232577658cf2161 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893295.358891:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006eb9ce41/0x9232577658cf2161 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893295.358919:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787893295.360473:0:17171:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893295.360484:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006eb9ce41/0x9232577658cf2161 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.360519:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7ec00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893295.360525:0:17171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006eb9ce41/0x9232577658cf2161 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.360535:0:17171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006eb9ce41/0x9232577658cf2161 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.360558:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006eb9ce41/0x9232577658cf2161 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.360566:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006eb9ce41/0x9232577658cf2161 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.360590:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893295.360592:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893295.360594:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787893295.361853:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787893295.361864:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a929ac94/0x9232577658cf2168 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893295.361879:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1787893295.361884:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893295.361890:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a929ac94/0x9232577658cf2168 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893295.361904:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a929ac94/0x9232577658cf2168 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893295.361921:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a929ac94/0x9232577658cf2168 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893295.361929:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a929ac94/0x9232577658cf2168 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893295.361951:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787893295.362760:0:19536:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893295.362768:0:19536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a929ac94/0x9232577658cf2168 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.363366:0:19536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7fc00 already unused, calling callback (ffffffffc0cb7230) 00002000:00010000:3.0:1787893295.363603:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787893295.363611:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da04e8ad/0x9232577658cf216f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893295.363623:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1787893295.363627:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893295.363632:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da04e8ad/0x9232577658cf216f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.363734:0:19536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a929ac94/0x9232577658cf2168 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.363745:0:19536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a929ac94/0x9232577658cf2168 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.363762:0:19536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a929ac94/0x9232577658cf2168 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.363770:0:19536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a929ac94/0x9232577658cf2168 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893295.363848:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da04e8ad/0x9232577658cf216f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893295.363859:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da04e8ad/0x9232577658cf216f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893295.363866:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da04e8ad/0x9232577658cf216f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893295.363899:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787893295.364476:0:19536:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893295.364480:0:19536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da04e8ad/0x9232577658cf216f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.364487:0:19536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7f600 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787893295.364519:0:19536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da04e8ad/0x9232577658cf216f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.364528:0:19536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da04e8ad/0x9232577658cf216f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.364540:0:19536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da04e8ad/0x9232577658cf216f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.364548:0:19536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da04e8ad/0x9232577658cf216f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.364559:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893295.364561:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893295.364563:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787893295.366014:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893295.366026:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e368ce9/0x9232577658cf2176 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.366042:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1787893295.366053:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893295.366059:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e368ce9/0x9232577658cf2176 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.366073:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e368ce9/0x9232577658cf2176 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.366083:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e368ce9/0x9232577658cf2176 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.366090:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e368ce9/0x9232577658cf2176 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.366108:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787893295.366520:0:17172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893295.366527:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e368ce9/0x9232577658cf2176 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.366535:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e0400 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893295.366541:0:17172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e368ce9/0x9232577658cf2176 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.366549:0:17172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e368ce9/0x9232577658cf2176 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.366564:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e368ce9/0x9232577658cf2176 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.366570:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e368ce9/0x9232577658cf2176 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.366587:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893295.366589:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893295.366591:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893295.366599:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787893295.366917:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893295.366924:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fed994f3/0x9232577658cf217d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.366933:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1787893295.366936:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893295.366940:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fed994f3/0x9232577658cf217d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.367437:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fed994f3/0x9232577658cf217d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.367452:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fed994f3/0x9232577658cf217d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.367465:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fed994f3/0x9232577658cf217d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.367485:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787893295.368182:0:19536:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787893295.368190:0:19536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fed994f3/0x9232577658cf217d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893295.368199:0:19536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e1a00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:3.0:1787893295.368204:0:19536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fed994f3/0x9232577658cf217d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893295.368213:0:19536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fed994f3/0x9232577658cf217d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893295.368227:0:19536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fed994f3/0x9232577658cf217d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893295.368235:0:19536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fed994f3/0x9232577658cf217d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893295.368252:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893295.368254:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893295.368256:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787893295.369545:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893295.369554:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c35b197/0x9232577658cf2184 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.369569:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1787893295.369573:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893295.369578:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c35b197/0x9232577658cf2184 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.369591:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c35b197/0x9232577658cf2184 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.369600:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c35b197/0x9232577658cf2184 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.369608:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c35b197/0x9232577658cf2184 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.369624:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787893295.370129:0:17172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893295.370136:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c35b197/0x9232577658cf2184 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.370145:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e0600 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893295.370150:0:17172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c35b197/0x9232577658cf2184 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.370170:0:17172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c35b197/0x9232577658cf2184 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.370184:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c35b197/0x9232577658cf2184 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.370191:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c35b197/0x9232577658cf2184 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.370207:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893295.370209:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893295.370210:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787893295.370593:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893295.370600:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2e1f989/0x9232577658cf218b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.370616:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1787893295.370620:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893295.370624:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2e1f989/0x9232577658cf218b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.370633:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2e1f989/0x9232577658cf218b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.370641:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2e1f989/0x9232577658cf218b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.371459:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2e1f989/0x9232577658cf218b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.371481:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787893295.371755:0:17171:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893295.371762:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2e1f989/0x9232577658cf218b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.371769:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e0c00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893295.371774:0:17171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2e1f989/0x9232577658cf218b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.372469:0:17171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2e1f989/0x9232577658cf218b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.372524:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2e1f989/0x9232577658cf218b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.372544:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2e1f989/0x9232577658cf218b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.372569:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893295.372572:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893295.372573:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787893295.373097:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893295.373105:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5362880/0x9232577658cf2192 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.373118:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1787893295.373122:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893295.373128:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5362880/0x9232577658cf2192 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.373141:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5362880/0x9232577658cf2192 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.373160:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5362880/0x9232577658cf2192 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.373168:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5362880/0x9232577658cf2192 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.373187:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787893295.373416:0:19536:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787893295.373423:0:19536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5362880/0x9232577658cf2192 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893295.373432:0:19536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e1e00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:3.0:1787893295.373441:0:19536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5362880/0x9232577658cf2192 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893295.373450:0:19536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5362880/0x9232577658cf2192 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893295.373462:0:19536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5362880/0x9232577658cf2192 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893295.373470:0:19536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5362880/0x9232577658cf2192 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893295.373484:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893295.373486:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893295.373487:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787893295.374576:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893295.374587:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017d550a0/0x9232577658cf2199 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.374600:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1787893295.374604:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893295.374610:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017d550a0/0x9232577658cf2199 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.374622:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017d550a0/0x9232577658cf2199 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.374631:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017d550a0/0x9232577658cf2199 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.374638:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000017d550a0/0x9232577658cf2199 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.375485:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787893295.376578:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893295.376591:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f39d8850/0x9232577658cf21a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.376605:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1787893295.376609:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893295.376616:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f39d8850/0x9232577658cf21a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.376629:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f39d8850/0x9232577658cf21a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.376638:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f39d8850/0x9232577658cf21a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.376920:0:17172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893295.376929:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000017d550a0/0x9232577658cf2199 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.376938:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e1c00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893295.376943:0:17172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000017d550a0/0x9232577658cf2199 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.376963:0:17172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000017d550a0/0x9232577658cf2199 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.376981:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000017d550a0/0x9232577658cf2199 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.376989:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017d550a0/0x9232577658cf2199 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.377008:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893295.377010:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893295.377012:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893295.377449:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f39d8850/0x9232577658cf21a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.377473:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787893295.378298:0:17171:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893295.378306:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f39d8850/0x9232577658cf21a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.378316:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e0e00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893295.378320:0:17171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f39d8850/0x9232577658cf21a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.378329:0:17171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f39d8850/0x9232577658cf21a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.378345:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f39d8850/0x9232577658cf21a0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.378352:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f39d8850/0x9232577658cf21a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.378877:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893295.378880:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893295.378882:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787893295.379138:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893295.379146:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e543cf83/0x9232577658cf21a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.379159:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1787893295.379168:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893295.379175:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e543cf83/0x9232577658cf21a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.379187:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e543cf83/0x9232577658cf21a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.379197:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e543cf83/0x9232577658cf21a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.379204:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e543cf83/0x9232577658cf21a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.379220:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787893295.379332:0:19536:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893295.379338:0:19536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e543cf83/0x9232577658cf21a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.379346:0:19536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e1600 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787893295.379350:0:19536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e543cf83/0x9232577658cf21a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.379359:0:19536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e543cf83/0x9232577658cf21a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.379371:0:19536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e543cf83/0x9232577658cf21a7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.381067:0:19536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e543cf83/0x9232577658cf21a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.381088:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893295.381090:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893295.381092:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787893295.381161:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893295.381168:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed620a3a/0x9232577658cf21ae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.381179:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1787893295.381184:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893295.381190:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed620a3a/0x9232577658cf21ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.381203:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed620a3a/0x9232577658cf21ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.381212:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed620a3a/0x9232577658cf21ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.381220:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed620a3a/0x9232577658cf21ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.381238:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787893295.381695:0:17172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893295.381705:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed620a3a/0x9232577658cf21ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.381713:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e1800 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893295.381717:0:17172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed620a3a/0x9232577658cf21ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.381737:0:17172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed620a3a/0x9232577658cf21ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.381753:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed620a3a/0x9232577658cf21ae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.381759:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed620a3a/0x9232577658cf21ae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.381775:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893295.382443:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893295.382447:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787893295.382729:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893295.382742:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0daceaa/0x9232577658cf21b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.382755:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1787893295.382759:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893295.382764:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0daceaa/0x9232577658cf21b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.383036:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0daceaa/0x9232577658cf21b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.383048:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0daceaa/0x9232577658cf21b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.383056:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0daceaa/0x9232577658cf21b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.383073:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787893295.383313:0:17171:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893295.383319:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0daceaa/0x9232577658cf21b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.383327:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e0800 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893295.383332:0:17171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0daceaa/0x9232577658cf21b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.383340:0:17171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0daceaa/0x9232577658cf21b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.383353:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0daceaa/0x9232577658cf21b5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.383448:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0daceaa/0x9232577658cf21b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.383470:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893295.383472:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893295.383474:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787893295.383983:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893295.383990:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5a51341/0x9232577658cf21bc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.383999:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1787893295.384002:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893295.384008:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5a51341/0x9232577658cf21bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.384017:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5a51341/0x9232577658cf21bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.384031:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5a51341/0x9232577658cf21bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.384038:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5a51341/0x9232577658cf21bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.384052:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787893295.384152:0:19536:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893295.384157:0:19536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5a51341/0x9232577658cf21bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.384164:0:19536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e1000 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787893295.384168:0:19536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5a51341/0x9232577658cf21bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.384176:0:19536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5a51341/0x9232577658cf21bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.384187:0:19536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5a51341/0x9232577658cf21bc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.384195:0:19536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5a51341/0x9232577658cf21bc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.384209:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893295.384215:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893295.384217:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787893295.385846:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787893295.385857:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb6ffe74/0x9232577658cf21c3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893295.385871:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1787893295.385875:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893295.385880:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6ffe74/0x9232577658cf21c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893295.385893:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb6ffe74/0x9232577658cf21c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893295.385903:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb6ffe74/0x9232577658cf21c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893295.385920:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6ffe74/0x9232577658cf21c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893295.389218:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787893295.390200:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787893295.390212:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006355df25/0x9232577658cf21ca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893295.390230:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1787893295.390234:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893295.390240:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006355df25/0x9232577658cf21ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893295.390255:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006355df25/0x9232577658cf21ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893295.390265:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006355df25/0x9232577658cf21ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893295.390273:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006355df25/0x9232577658cf21ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787893295.395016:0:19518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1787893295.395050:0:19518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1787893295.395054:0:19518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787893295.395195:0:18702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17927:x1874741493441280:12345-0@lo:5:osp-pre-1-1.0 Request processed in 67744us (67835us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787893295.395206:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787893295.395255:0:17927:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787893295.395262:0:17927:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d15c8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17927:1874741493441280:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1787893295.395275:0:17927:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1787893295.395319:0:17927:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d15c8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17927:1874741493441408:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1787893295.395352:0:17927:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893295.395370:0:17927:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9f3517a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787893295.395404:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493441408 00000100:00100000:0.0:1787893295.395409:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493441408 00000100:00100000:0.0:1787893295.395442:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787893295.395449:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17927:x1874741493441408:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1787893295.395486:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17927:x1874741493441408:12345-0@lo:900:osp-pre-1-1.0 Request processed in 38us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893295.395534:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787893295.395563:0:17927:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9d15c8700 x1874741493441408/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787893311 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893295.395574:0:17927:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d15c8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17927:1874741493441408:0@lo:900:osp-pre-1-1.0 00010000:00010000:1.0:1787893295.395795:0:17172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787893295.395806:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb6ffe74/0x9232577658cf21c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.395824:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7f000 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:1.0:1787893295.395828:0:17172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb6ffe74/0x9232577658cf21c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.395839:0:17172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb6ffe74/0x9232577658cf21c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.395861:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb6ffe74/0x9232577658cf21c3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.395868:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb6ffe74/0x9232577658cf21c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.395890:0:17172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893295.395894:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006355df25/0x9232577658cf21ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.395900:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7ee00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:1.0:1787893295.395903:0:17172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006355df25/0x9232577658cf21ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.395909:0:17172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006355df25/0x9232577658cf21ca lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.395915:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006355df25/0x9232577658cf21ca lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.395927:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893295.395928:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893295.395930:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893295.396102:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787893295.396110:0:19239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006355df25/0x9232577658cf21ca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.396205:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787893295.397112:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787893295.397123:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ea533e4/0x9232577658cf21d1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.397138:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=539s v=(0 0) 00010000:00010000:0.0:1787893295.397142:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787893295.397149:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ea533e4/0x9232577658cf21d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.397161:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ea533e4/0x9232577658cf21d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.397170:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ea533e4/0x9232577658cf21d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.397177:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ea533e4/0x9232577658cf21d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.397195:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787893295.397207:0:19536:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893295.397212:0:19536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ea533e4/0x9232577658cf21d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.397227:0:19536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31600 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893295.397231:0:19536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ea533e4/0x9232577658cf21d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.397240:0:19536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ea533e4/0x9232577658cf21d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.397253:0:19536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ea533e4/0x9232577658cf21d1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.397260:0:19536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ea533e4/0x9232577658cf21d1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.397274:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893295.397275:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893295.397277:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787893295.397763:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787893295.397769:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f66a0dc2/0x9232577658cf21d8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.397851:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=539s v=(0 0) 00010000:00010000:0.0:1787893295.397855:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787893295.397859:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f66a0dc2/0x9232577658cf21d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.397869:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f66a0dc2/0x9232577658cf21d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.397885:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f66a0dc2/0x9232577658cf21d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.397892:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f66a0dc2/0x9232577658cf21d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.398460:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787893295.399465:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787893295.399474:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df3051c2/0x9232577658cf21df lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.399487:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=539s v=(0 0) 00010000:00010000:0.0:1787893295.399520:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787893295.399526:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df3051c2/0x9232577658cf21df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.399538:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df3051c2/0x9232577658cf21df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.399548:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df3051c2/0x9232577658cf21df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.399556:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df3051c2/0x9232577658cf21df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.399883:0:17172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787893295.399892:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f66a0dc2/0x9232577658cf21d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.399900:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30600 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:1.0:1787893295.399905:0:17172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f66a0dc2/0x9232577658cf21d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.399913:0:17172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f66a0dc2/0x9232577658cf21d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.399929:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f66a0dc2/0x9232577658cf21d8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.399937:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f66a0dc2/0x9232577658cf21d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.399968:0:17172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893295.399973:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df3051c2/0x9232577658cf21df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.399979:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31e00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:1.0:1787893295.399989:0:17172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df3051c2/0x9232577658cf21df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.399996:0:17172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df3051c2/0x9232577658cf21df lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.400006:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df3051c2/0x9232577658cf21df lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.400014:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893295.400015:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893295.400017:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893295.400213:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787893295.400219:0:19239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df3051c2/0x9232577658cf21df lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.400663:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787893295.400930:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787893295.400938:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005cdc76c/0x9232577658cf21e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.401004:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=539s v=(0 0) 00010000:00010000:0.0:1787893295.401009:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787893295.401015:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005cdc76c/0x9232577658cf21e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.401027:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005cdc76c/0x9232577658cf21e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.401037:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005cdc76c/0x9232577658cf21e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.401044:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005cdc76c/0x9232577658cf21e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.401066:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787893295.401303:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787893295.401309:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001414b08e/0x9232577658cf21ed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.401323:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=539s v=(0 0) 00010000:00010000:0.0:1787893295.401326:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787893295.401331:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001414b08e/0x9232577658cf21ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.401340:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001414b08e/0x9232577658cf21ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.401348:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001414b08e/0x9232577658cf21ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.401356:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001414b08e/0x9232577658cf21ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.401367:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787893295.402042:0:19536:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787893295.402050:0:19536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005cdc76c/0x9232577658cf21e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.402059:0:19536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30000 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:1.0:1787893295.402064:0:19536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005cdc76c/0x9232577658cf21e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.402073:0:19536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005cdc76c/0x9232577658cf21e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.402087:0:19536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005cdc76c/0x9232577658cf21e6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.402095:0:19536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005cdc76c/0x9232577658cf21e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.402119:0:19536:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893295.402122:0:19536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001414b08e/0x9232577658cf21ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.402128:0:19536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31000 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:1.0:1787893295.402132:0:19536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001414b08e/0x9232577658cf21ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.402138:0:19536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001414b08e/0x9232577658cf21ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.402147:0:19536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001414b08e/0x9232577658cf21ed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.402154:0:19536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001414b08e/0x9232577658cf21ed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.402164:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893295.402165:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893295.402167:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893295.402173:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787893295.402458:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787893295.402465:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000013cd21a/0x9232577658cf21f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.402473:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=539s v=(0 0) 00010000:00010000:0.0:1787893295.402477:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787893295.402482:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000013cd21a/0x9232577658cf21f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.402702:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000013cd21a/0x9232577658cf21f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.402724:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000013cd21a/0x9232577658cf21f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.402732:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000013cd21a/0x9232577658cf21f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893295.402783:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787893295.409051:0:17171:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893295.409065:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000013cd21a/0x9232577658cf21f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.409079:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30800 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:1.0:1787893295.409092:0:17171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000013cd21a/0x9232577658cf21f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.409104:0:17171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000013cd21a/0x9232577658cf21f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.409125:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000013cd21a/0x9232577658cf21f4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.409133:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000013cd21a/0x9232577658cf21f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787893295.409912:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893295.409922:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5a51341/0x9232577658cf21fb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.409936:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1787893295.409940:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893295.409946:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5a51341/0x9232577658cf21fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.410034:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5a51341/0x9232577658cf21fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.410044:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5a51341/0x9232577658cf21fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.410051:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5a51341/0x9232577658cf21fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.410066:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787893295.410595:0:19536:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893295.410601:0:19536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5a51341/0x9232577658cf21fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.410609:0:19536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e1000 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:1.0:1787893295.410614:0:19536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5a51341/0x9232577658cf21fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.410622:0:19536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5a51341/0x9232577658cf21fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.410635:0:19536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5a51341/0x9232577658cf21fb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.410653:0:19536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5a51341/0x9232577658cf21fb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.410675:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893295.410677:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893295.410679:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787893295.410892:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893295.410898:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e543cf83/0x9232577658cf2202 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.410906:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1787893295.410910:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893295.410915:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e543cf83/0x9232577658cf2202 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.410929:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e543cf83/0x9232577658cf2202 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.410937:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e543cf83/0x9232577658cf2202 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.410944:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e543cf83/0x9232577658cf2202 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.411023:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787893295.412561:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893295.412571:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003a37e24/0x9232577658cf2209 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.412584:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1787893295.412589:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893295.412595:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003a37e24/0x9232577658cf2209 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.412608:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003a37e24/0x9232577658cf2209 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.412618:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003a37e24/0x9232577658cf2209 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.412637:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003a37e24/0x9232577658cf2209 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893295.412723:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:2.0:1787893295.412775:0:19239:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:2.0:1787893295.413620:0:19239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17210:x1874741493440512:12345-0@lo:5:osp-pre-1-0.0 Request processed in 120137us (120311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893295.413630:0:19239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1787893295.414320:0:17172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787893295.414329:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e543cf83/0x9232577658cf2202 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.414340:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e1600 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:1.0:1787893295.414344:0:17172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e543cf83/0x9232577658cf2202 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.414354:0:17172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e543cf83/0x9232577658cf2202 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.414386:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e543cf83/0x9232577658cf2202 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.414394:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e543cf83/0x9232577658cf2202 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.414412:0:17172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893295.414416:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003a37e24/0x9232577658cf2209 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.414423:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e0200 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:1.0:1787893295.414432:0:17172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003a37e24/0x9232577658cf2209 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.414440:0:17172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003a37e24/0x9232577658cf2209 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.414451:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003a37e24/0x9232577658cf2209 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.414457:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003a37e24/0x9232577658cf2209 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893295.414471:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893295.414473:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893295.414474:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893295.414918:0:17210:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d29f9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17210:1874741493440512:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787893295.414935:0:17210:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:2.0:1787893295.415042:0:17210:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c778b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17210:1874741493441536:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787893295.415092:0:17210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893295.415126:0:17210:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fd02a180 going to sleep for 11 seconds 00000100:00100000:2.0:1787893295.415146:0:19239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493441536 00000100:00100000:2.0:1787893295.415152:0:19239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493441536 00010000:00010000:3.0:1787893295.416741:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893295.416957:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893295.416960:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893295.416962:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893295.417146:0:19239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787893295.417163:0:19239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c778b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17210:x1874741493441536:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1787893295.417208:0:19239:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:2.0:1787893295.428462:0:19239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c778b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17210:x1874741493441536:12345-0@lo:5:osp-pre-1-0.0 Request processed in 11299us (13363us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787893295.428475:0:19239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787893295.428775:0:17210:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c778b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17210:1874741493441536:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787893295.428792:0:17210:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:1.0:1787893295.623996:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787893296.116322:0:17220:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787893296.626023:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787893297.470152:0:19876:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg235-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787893297.651745:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787893298.455977:0:19928:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787893298.457374:0:19928:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787893298.680977:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893299.698957:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787893299.712563:0:19978:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787893299.713207:0:19978:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787893300.158466:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893300.158630:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481821440 00000100:00100000:0.0:1787893300.158652:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481821440 00000100:00100000:0.0:1787893300.158690:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 113 00000100:00100000:0.0:1787893300.158698:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd286c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2389:x1874741481821440:12345-192.168.202.35@tcp:250:mount.lustre.0 00010000:00080000:0.0:1787893300.158726:0:17175:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from bf022523-db7f-4c9e-a3ea-97d11e9985e2@192.168.202.35@tcp t0 exp 0000000000000000 cur 543 last 0 00000020:00000080:0.0:1787893300.158762:0:17175:0:(genops.c:1385:class_connect()) connect: client bf022523-db7f-4c9e-a3ea-97d11e9985e2, cookie 0x9232577658cf2210 00000100:00080000:0.0:1787893300.158899:0:17175:0:(import.c:65:import_set_state_nolock()) ffff9fc8c741f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787893300.158995:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd286c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf022523-db7f-4c9e-a3ea-97d11e9985e2+5:2389:x1874741481821440:12345-192.168.202.35@tcp:250:mount.lustre.0 Request processed in 296us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893300.159003:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 113 00000100:00100000:3.0:1787893300.177746:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893300.177868:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481821568 00000100:00100000:0.0:1787893300.177878:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481821568 00000100:00100000:0.0:1787893300.177960:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 114 00000100:00100000:0.0:1787893300.177971:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd284c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf022523-db7f-4c9e-a3ea-97d11e9985e2+5:14916:x1874741481821568:12345-192.168.202.35@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787893300.177988:0:17177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893300.178023:0:17177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9edb30000/0x9232577658cf2217 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fab07 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893300.178053:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9edb30000/0x9232577658cf2217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fab07 expref: 6 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893300.178064:0:17177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9edb30000/0x9232577658cf2217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fab07 expref: 6 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893300.178075:0:17177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb30000, rc 0) 00000100:00100000:0.0:1787893300.178137:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd284c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf022523-db7f-4c9e-a3ea-97d11e9985e2+6:14916:x1874741481821568:12345-192.168.202.35@tcp:101:mount.lustre.0 Request processed in 168us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893300.178144:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 114 00000100:00100000:2.0:1787893300.191440:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893300.191638:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481821696 00000100:00100000:1.0:1787893300.191649:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481821696 00000100:00100000:1.0:1787893300.191714:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 115 00000100:00100000:1.0:1787893300.191726:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd285850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf022523-db7f-4c9e-a3ea-97d11e9985e2+6:14916:x1874741481821696:12345-192.168.202.35@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787893300.191869:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd285850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf022523-db7f-4c9e-a3ea-97d11e9985e2+6:14916:x1874741481821696:12345-192.168.202.35@tcp:501:mount.lustre.0 Request processed in 145us (438us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787893300.191877:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 115 00000100:00100000:3.0:1787893300.200345:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893300.203529:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481821824 00000100:00100000:1.0:1787893300.203560:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481821824 00000100:00100000:1.0:1787893300.203639:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 116 00000100:00100000:1.0:1787893300.203650:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd287450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf022523-db7f-4c9e-a3ea-97d11e9985e2+6:14916:x1874741481821824:12345-192.168.202.35@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787893300.203667:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893300.203687:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9fe541c00/0x9232577658cf221e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fab0e expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893300.203717:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9fe541c00/0x9232577658cf221e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fab0e expref: 7 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893300.203729:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9fe541c00/0x9232577658cf221e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fab0e expref: 7 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893300.203738:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe541c00, rc 0) 00000100:00100000:1.0:1787893300.203813:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd287450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf022523-db7f-4c9e-a3ea-97d11e9985e2+7:14916:x1874741481821824:12345-192.168.202.35@tcp:101:mount.lustre.0 Request processed in 164us (3475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893300.203820:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 116 00000100:00100000:2.0:1787893300.207766:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893300.207868:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481821952 00000100:00100000:0.0:1787893300.207879:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481821952 00000100:00100000:0.0:1787893300.207953:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 117 00000100:00100000:0.0:1787893300.207963:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd287c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf022523-db7f-4c9e-a3ea-97d11e9985e2+7:14916:x1874741481821952:12345-192.168.202.35@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787893300.208126:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd287c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf022523-db7f-4c9e-a3ea-97d11e9985e2+8:14916:x1874741481821952:12345-192.168.202.35@tcp:501:mount.lustre.0 Request processed in 164us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893300.208135:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 117 00000100:00100000:0.0:1787893300.221250:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893300.221479:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481822080 00000100:00100000:2.0:1787893300.221524:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481822080 00000100:00100000:2.0:1787893300.221637:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 118 00000100:00100000:2.0:1787893300.221657:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd284450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf022523-db7f-4c9e-a3ea-97d11e9985e2+8:14916:x1874741481822080:12345-192.168.202.35@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787893300.221860:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd284450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf022523-db7f-4c9e-a3ea-97d11e9985e2+8:14916:x1874741481822080:12345-192.168.202.35@tcp:503:mount.lustre.0 Request processed in 204us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893300.221868:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 118 00000100:00100000:3.0:1787893300.235778:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893300.236144:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481822208 00000100:00100000:1.0:1787893300.236155:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481822208 00000100:00100000:1.0:1787893300.236216:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 119 00000100:00100000:1.0:1787893300.236226:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd284050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf022523-db7f-4c9e-a3ea-97d11e9985e2+8:14935:x1874741481822208:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787893300.236390:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd284050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf022523-db7f-4c9e-a3ea-97d11e9985e2+8:14935:x1874741481822208:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 165us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893300.236399:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 119 00000100:00100000:3.0:1787893300.320528:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893300.320804:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481822336 00000100:00100000:0.0:1787893300.320814:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481822336 00000100:00100000:0.0:1787893300.320869:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 120 00000100:00100000:0.0:1787893300.320879:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd2abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf022523-db7f-4c9e-a3ea-97d11e9985e2+8:14935:x1874741481822336:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787893300.321035:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd2abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf022523-db7f-4c9e-a3ea-97d11e9985e2+8:14935:x1874741481822336:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 156us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893300.321051:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 120 00000100:00100000:0.0:1787893300.333000:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893300.333119:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481822464 00000100:00100000:2.0:1787893300.333130:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481822464 00000100:00100000:2.0:1787893300.333189:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 121 00000100:00100000:2.0:1787893300.333200:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd2a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf022523-db7f-4c9e-a3ea-97d11e9985e2+8:14935:x1874741481822464:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787893300.333363:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd2a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf022523-db7f-4c9e-a3ea-97d11e9985e2+8:14935:x1874741481822464:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 164us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893300.333370:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 121 00000100:00100000:3.0:1787893300.354621:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893300.354880:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481822592 00000100:00100000:1.0:1787893300.354892:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481822592 00000100:00100000:1.0:1787893300.354968:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 122 00000100:00100000:1.0:1787893300.354979:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd2a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf022523-db7f-4c9e-a3ea-97d11e9985e2+8:14916:x1874741481822592:12345-192.168.202.35@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787893300.355010:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893300.355028:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9fe541e00/0x9232577658cf2225 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fab3f expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893300.355055:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9fe541e00/0x9232577658cf2225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fab3f expref: 9 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893300.355065:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9fe541e00/0x9232577658cf2225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fab3f expref: 9 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893300.355073:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe541e00, rc 0) 00000100:00100000:1.0:1787893300.355123:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd2a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf022523-db7f-4c9e-a3ea-97d11e9985e2+9:14916:x1874741481822592:12345-192.168.202.35@tcp:101:mount.lustre.0 Request processed in 146us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893300.355130:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 122 00000100:00100000:3.0:1787893300.360483:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893300.360793:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481822720 00000100:00100000:0.0:1787893300.360804:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481822720 00000100:00100000:0.0:1787893300.360854:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 123 00000100:00100000:0.0:1787893300.360864:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd2aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf022523-db7f-4c9e-a3ea-97d11e9985e2+9:14916:x1874741481822720:12345-192.168.202.35@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787893300.360887:0:17177:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787893300.360919:0:17177:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787893300.360923:0:17177:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787893300.360926:0:17177:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787893300.360928:0:17177:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787893300.360930:0:17177:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1787893300.365584:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd2aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf022523-db7f-4c9e-a3ea-97d11e9985e2+9:14916:x1874741481822720:12345-192.168.202.35@tcp:256:mount.lustre.0 Request processed in 4710us (5098us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893300.365600:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 123 00000100:00100000:3.0:1787893300.371059:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893300.371167:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481822848 00000100:00100000:2.0:1787893300.371177:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481822848 00000100:00100000:2.0:1787893300.371230:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 124 00000100:00100000:2.0:1787893300.371239:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd2a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf022523-db7f-4c9e-a3ea-97d11e9985e2+9:14916:x1874741481822848:12345-192.168.202.35@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787893300.371256:0:17178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893300.371274:0:17178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c67e1c00/0x9232577658cf222c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fab46 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893300.371302:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c67e1c00/0x9232577658cf222c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fab46 expref: 10 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893300.371331:0:17178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c67e1c00/0x9232577658cf222c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fab46 expref: 10 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893300.371340:0:17178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c67e1c00, rc 0) 00000100:00100000:2.0:1787893300.371401:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd2a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf022523-db7f-4c9e-a3ea-97d11e9985e2+10:14916:x1874741481822848:12345-192.168.202.35@tcp:101:mount.lustre.0 Request processed in 163us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893300.371408:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 124 00000100:00100000:3.0:1787893300.374888:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893300.380510:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481822976 00000100:00100000:1.0:1787893300.380527:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481822976 00000100:00100000:1.0:1787893300.380929:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 125 00000100:00100000:1.0:1787893300.380942:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd2a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf022523-db7f-4c9e-a3ea-97d11e9985e2+10:14916:x1874741481822976:12345-192.168.202.35@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787893300.381108:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd2a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf022523-db7f-4c9e-a3ea-97d11e9985e2+10:14916:x1874741481822976:12345-192.168.202.35@tcp:501:mount.lustre.0 Request processed in 169us (6227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893300.381116:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 125 00000100:00100000:0.0:1787893300.384178:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893300.384580:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481823104 00000100:00100000:2.0:1787893300.384591:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481823104 00000100:00100000:2.0:1787893300.384829:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 126 00000100:00100000:2.0:1787893300.384842:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd2a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf022523-db7f-4c9e-a3ea-97d11e9985e2+10:14916:x1874741481823104:12345-192.168.202.35@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787893300.385012:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd2a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf022523-db7f-4c9e-a3ea-97d11e9985e2+10:14916:x1874741481823104:12345-192.168.202.35@tcp:503:mount.lustre.0 Request processed in 172us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893300.385020:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 126 00000100:00100000:1.0:1787893300.393376:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893300.394354:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481823232 00000100:00100000:2.0:1787893300.394366:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481823232 00000100:00100000:2.0:1787893300.394425:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 127 00000100:00100000:2.0:1787893300.394437:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd2aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf022523-db7f-4c9e-a3ea-97d11e9985e2+10:14939:x1874741481823232:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787893300.394648:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd2aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf022523-db7f-4c9e-a3ea-97d11e9985e2+10:14939:x1874741481823232:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 204us (1272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893300.394658:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 127 00000100:00100000:0.0:1787893300.399625:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893300.399843:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481823360 00000100:00100000:3.0:1787893300.399854:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481823360 00000100:00100000:3.0:1787893300.399917:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 128 00000100:00100000:3.0:1787893300.399928:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf022523-db7f-4c9e-a3ea-97d11e9985e2+10:14939:x1874741481823360:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787893300.400073:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf022523-db7f-4c9e-a3ea-97d11e9985e2+10:14939:x1874741481823360:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 146us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893300.400082:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 128 00000100:00100000:2.0:1787893300.402298:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d15c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493441664:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787893300.402365:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893300.402534:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493441664 00000100:00100000:1.0:1787893300.402542:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493441664 00000100:00100000:1.0:1787893300.402619:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787893300.402628:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7789180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493441664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787893300.402673:0:18203:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787893300.402720:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7789180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493441664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893300.402727:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787893300.402964:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13b37fca-0eda-4b14-a6ef-4a378c945d17:3630:1874741493441792:0@lo:400:kworker.0 00000100:00100000:1.0:1787893300.402997:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893300.403032:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493441792 00000100:00100000:1.0:1787893300.403036:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493441792 00000100:00100000:1.0:1787893300.403060:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787893300.403066:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:3630:x1874741493441792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893300.403102:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:3630:x1874741493441792:12345-0@lo:400:kworker.0 Request processed in 36us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893300.403109:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787893300.403146:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13b37fca-0eda-4b14-a6ef-4a378c945d17:3630:1874741493441792:0@lo:400:kworker.0 00000100:00100000:1.0:1787893300.403176:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787893300.403183:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493441920:0@lo:400:kworker.0 00000100:00100000:1.0:1787893300.403207:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893300.403236:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493441920 00000100:00100000:1.0:1787893300.403240:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493441920 00000100:00100000:1.0:1787893300.403263:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787893300.403269:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493441920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893300.403302:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493441920:12345-0@lo:400:kworker.0 Request processed in 33us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893300.403309:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787893300.403344:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493441920:0@lo:400:kworker.0 00000100:00100000:1.0:1787893300.403374:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493442048:0@lo:400:kworker.0 00000100:00100000:1.0:1787893300.403401:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893300.403441:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787893300.403458:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493442176:0@lo:400:kworker.0 00000100:00100000:1.0:1787893300.403482:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893300.403534:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493442048 00000100:00100000:1.0:1787893300.403538:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493442048 00000100:00100000:1.0:1787893300.403568:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493442176 00000100:00100000:1.0:1787893300.403571:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493442176 00000100:00100000:1.0:1787893300.403587:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787893300.403594:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493442048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893300.403630:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493442048:12345-0@lo:400:kworker.0 Request processed in 37us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893300.403636:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787893300.403647:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787893300.403652:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3632:x1874741493442176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893300.403677:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3632:x1874741493442176:12345-0@lo:400:kworker.0 Request processed in 25us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893300.403682:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787893300.403704:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493442176:0@lo:400:kworker.0 00000100:00100000:1.0:1787893300.403715:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493442048:0@lo:400:kworker.0 00000100:00100000:1.0:1787893300.403745:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493442304:0@lo:400:kworker.0 00000100:00100000:1.0:1787893300.403766:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893300.403808:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787893300.403823:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493442432:0@lo:400:kworker.0 00000100:00100000:1.0:1787893300.403847:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893300.403868:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493442432 00000100:00100000:1.0:1787893300.403872:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493442432 00000100:00100000:1.0:1787893300.403891:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787893300.403897:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493442432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893300.403927:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493442432:12345-0@lo:400:kworker.0 Request processed in 30us (79us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893300.403933:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787893300.403955:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493442432:0@lo:400:kworker.0 00000100:00100000:1.0:1787893300.403983:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493442560:0@lo:400:kworker.0 00000100:00100000:1.0:1787893300.404005:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893300.404028:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493442560 00000100:00100000:1.0:1787893300.404032:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493442560 00000100:00100000:1.0:1787893300.404049:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787893300.404055:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493442560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893300.404086:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493442560:12345-0@lo:400:kworker.0 Request processed in 32us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893300.404091:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787893300.404113:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493442560:0@lo:400:kworker.0 00000100:00100000:1.0:1787893300.404139:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787893300.404144:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493442688:0@lo:400:kworker.0 00000100:00100000:1.0:1787893300.404166:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893300.404201:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493442816:0@lo:400:kworker.0 00000100:00100000:1.0:1787893300.404221:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893300.404266:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787893300.404273:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493442944:0@lo:400:kworker.0 00000100:00100000:1.0:1787893300.404296:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893300.404330:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1874741493443072:0@lo:400:kworker.0 00000100:00100000:3.0:1787893300.405225:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787893300.405237:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe34ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493443328:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787893300.405282:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787893300.405312:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787893300.405316:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787893300.405328:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493442304 00000100:00100000:3.0:1787893300.405333:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493442304 00000100:00100000:3.0:1787893300.405424:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493442688 00000100:00100000:3.0:1787893300.405428:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493442688 00000100:00100000:3.0:1787893300.405440:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493442816 00000100:00100000:3.0:1787893300.405442:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493442816 00000100:00100000:3.0:1787893300.405475:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493442944 00000100:00100000:3.0:1787893300.405478:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493442944 00000100:00100000:3.0:1787893300.405510:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787893300.405518:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493442304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893300.405555:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493442304:12345-0@lo:400:kworker.0 Request processed in 38us (1787us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893300.405562:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787893300.405577:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787893300.405582:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493442688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893300.405608:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493442688:12345-0@lo:400:kworker.0 Request processed in 26us (1440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893300.405614:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787893300.405625:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787893300.405631:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493442816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893300.406025:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d15c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493443456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787893300.406056:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893300.406170:0:17184:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787893300.406185:0:17184:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787893300.406207:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787893300.406215:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787893300.406222:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493442944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893300.408389:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493442944:12345-0@lo:400:kworker.0 Request processed in 2160us (4084us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893300.408402:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787893300.408458:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787893300.408472:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d15c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493443840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787893300.408537:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787893300.408609:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787893300.408615:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787893300.408628:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493443328 00000100:00100000:3.0:1787893300.408745:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493443456 00000100:00100000:3.0:1787893300.408752:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493443456 00000100:00100000:3.0:1787893300.408782:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493443840 00000100:00100000:3.0:1787893300.408785:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493443840 00000100:00100000:3.0:1787893300.408797:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787893300.408805:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3631:x1874741493443456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787893300.408839:0:18705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787893300.409192:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493443328 00000100:00100000:0.0:1787893300.409227:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787893300.409233:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe34a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493443328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787893300.409255:0:17188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787893300.409297:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe34a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493443328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (4015us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893300.409304:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787893300.409347:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe34ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493443328:0@lo:41:osp-pre-1-0.0 00010000:00080000:0.0:1787893300.409386:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffc5d180 x1874741493442944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893300.409398:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493442944:0@lo:400:kworker.0 00010000:00080000:0.0:1787893300.409411:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c76f6300 x1874741493442304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893300.409418:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493442304:0@lo:400:kworker.0 00000100:00100000:2.0:1787893300.409796:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe34b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493443200:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787893300.409842:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893300.409877:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d15cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1874741493443712:0@lo:400:kworker.0 00000100:00100000:2.0:1787893300.409905:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893300.409935:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d15c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493441664:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787893300.409950:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787893300.409956:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d15c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493443584:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787893300.409979:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893300.409999:0:18706:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1787893300.410006:0:18706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1787893300.410018:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787893300.410024:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493443712 00000100:00100000:2.0:1787893300.410028:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493443712 00000100:00100000:2.0:1787893300.410060:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787893300.410067:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787893300.410074:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c778bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1874741493443712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893300.410112:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c778bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1874741493443712:12345-0@lo:400:kworker.0 Request processed in 38us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893300.410125:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1787893300.410193:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787893300.410218:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9d15cad80 x1874741493443712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893300.410228:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d15cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1874741493443712:0@lo:400:kworker.0 00000100:00100000:2.0:1787893300.410252:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493443200 00000100:00100000:2.0:1787893300.410255:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493443200 00000100:00100000:2.0:1787893300.410271:0:18706:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1787893300.410274:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493443584 00000100:00100000:2.0:1787893300.410277:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493443584 00000100:00100000:2.0:1787893300.410347:0:19991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787893300.410355:0:19991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493443840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787893300.410375:0:19991:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787893300.410411:0:19991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493443840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (1873us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893300.410417:0:19991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787893300.410458:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d15c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493443840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787893300.410478:0:19991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787893300.410485:0:19991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7789f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493443200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787893300.410536:0:19991:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787893300.410565:0:19991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7789f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493443200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893300.410572:0:19991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787893300.410597:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe34b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493443200:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787893300.410616:0:19991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787893300.410623:0:19991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7789500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493443584:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787893300.410840:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3631:x1874741493443456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2033us (4782us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893300.411822:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787893300.411903:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d15c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493443456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787893300.411976:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493442816:12345-0@lo:400:kworker.0 Request processed in 6345us (7753us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893300.411985:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1787893300.414904:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffc5ce00 x1874741493442816/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893300.414922:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493442816:0@lo:400:kworker.0 00002000:00000024:2.0:1787893300.415138:0:19991:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787893300.415219:0:19991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7789500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493443584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4595us (5237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893300.415228:0:19991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787893300.415829:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d15c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493443584:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787893300.422266:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893300.425050:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493443072 00000100:00100000:2.0:1787893300.425066:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493443072 00000100:00100000:2.0:1787893300.425148:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787893300.425159:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1874741493443072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893300.425253:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1874741493443072:12345-0@lo:400:kworker.0 Request processed in 96us (2994us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893300.425275:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1787893300.425299:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787893300.425420:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffc5d880 x1874741493443072/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893300.425436:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1874741493443072:0@lo:400:kworker.0 00010000:00080000:0.0:1787893300.425460:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffc5fb80 x1874741493442688/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893300.425470:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493442688:0@lo:400:kworker.0 00000100:00100000:0.0:1787893300.428178:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893300.428254:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893300.428328:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481823488 00000100:00100000:3.0:1787893300.428337:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481823488 00000100:00100000:3.0:1787893300.428420:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481823744 00000100:00100000:3.0:1787893300.428423:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481823744 00000100:00100000:3.0:1787893300.428453:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 7 00000100:00100000:3.0:1787893300.428461:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2389:x1874741481823488:12345-192.168.202.35@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787893300.428510:0:17185:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from af98d6ca-b952-492d-ad71-083813d6f146@192.168.202.35@tcp t0 exp 0000000000000000 cur 544 last 0 00000020:00000080:3.0:1787893300.428567:0:17185:0:(genops.c:1385:class_connect()) connect: client af98d6ca-b952-492d-ad71-083813d6f146, cookie 0x9232577658cf2233 00000004:00100000:3.0:1787893300.428591:0:17185:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787893300.428781:0:17185:0:(import.c:65:import_set_state_nolock()) ffff9fc8c75ac800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787893300.428842:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af98d6ca-b952-492d-ad71-083813d6f146+6:2389:x1874741481823488:12345-192.168.202.35@tcp:38:mount.lustre.0 Request processed in 380us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893300.428849:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 7 00000100:00100000:3.0:1787893300.428947:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 8 00000100:00100000:3.0:1787893300.428953:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2389:x1874741481823744:12345-192.168.202.35@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787893300.428968:0:17185:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from af98d6ca-b952-492d-ad71-083813d6f146@192.168.202.35@tcp t0 exp 0000000000000000 cur 544 last 0 00000020:00000080:3.0:1787893300.428996:0:17185:0:(genops.c:1385:class_connect()) connect: client af98d6ca-b952-492d-ad71-083813d6f146, cookie 0x9232577658cf223a 00000004:00100000:3.0:1787893300.429007:0:17185:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787893300.429183:0:17185:0:(import.c:65:import_set_state_nolock()) ffff9fc8c75aa800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787893300.429209:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af98d6ca-b952-492d-ad71-083813d6f146+6:2389:x1874741481823744:12345-192.168.202.35@tcp:38:mount.lustre.0 Request processed in 255us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893300.429216:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 8 00000100:00100000:0.0:1787893300.448344:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893300.448382:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893300.448415:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893300.448528:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481824000 00000100:00100000:2.0:1787893300.448538:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481824000 00000100:00100000:2.0:1787893300.448613:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481823872 00000100:00100000:2.0:1787893300.448616:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481823872 00000100:00100000:2.0:1787893300.448629:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481823616 00000100:00100000:2.0:1787893300.448632:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481823616 00000100:00100000:2.0:1787893300.448656:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 9 00000100:00100000:2.0:1787893300.448666:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af98d6ca-b952-492d-ad71-083813d6f146+7:14916:x1874741481824000:12345-192.168.202.35@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787893300.448698:0:17183:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787893300.448777:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af98d6ca-b952-492d-ad71-083813d6f146+7:14916:x1874741481824000:12345-192.168.202.35@tcp:41:mount.lustre.0 Request processed in 112us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893300.448784:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 9 00000100:00100000:2.0:1787893300.448800:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 10 00000100:00100000:2.0:1787893300.448805:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af98d6ca-b952-492d-ad71-083813d6f146+6:0:x1874741481823872:12345-192.168.202.35@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787893300.448815:0:17183:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787893300.448870:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af98d6ca-b952-492d-ad71-083813d6f146+6:0:x1874741481823872:12345-192.168.202.35@tcp:41:mount.lustre.0 Request processed in 63us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893300.448876:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 10 00000100:00100000:2.0:1787893300.448890:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 11 00000100:00100000:2.0:1787893300.448897:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af98d6ca-b952-492d-ad71-083813d6f146+6:0:x1874741481823616:12345-192.168.202.35@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787893300.449126:0:17183:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787893300.449152:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af98d6ca-b952-492d-ad71-083813d6f146+6:0:x1874741481823616:12345-192.168.202.35@tcp:41:mount.lustre.0 Request processed in 255us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893300.449168:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 11 00000100:00080000:0.0:1787893300.449812:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787893300.449817:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787893300.451882:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893300.452021:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481824128 00000100:00100000:2.0:1787893300.452030:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481824128 00000100:00100000:2.0:1787893300.452088:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 12 00000100:00100000:2.0:1787893300.452097:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af98d6ca-b952-492d-ad71-083813d6f146+6:14916:x1874741481824128:12345-192.168.202.35@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787893300.452178:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af98d6ca-b952-492d-ad71-083813d6f146+6:14916:x1874741481824128:12345-192.168.202.35@tcp:40:mount.lustre.0 Request processed in 82us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893300.452186:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 12 00000100:00100000:3.0:1787893300.464130:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893300.464284:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481824256 00000100:00100000:1.0:1787893300.464295:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481824256 00000100:00100000:1.0:1787893300.464345:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 17 00000100:00100000:1.0:1787893300.464354:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe349c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2389:x1874741481824256:12345-192.168.202.35@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787893300.464388:0:18703:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from af98d6ca-b952-492d-ad71-083813d6f146@192.168.202.35@tcp t0 exp 0000000000000000 cur 544 last 0 00000020:00000080:1.0:1787893300.464418:0:18703:0:(genops.c:1385:class_connect()) connect: client af98d6ca-b952-492d-ad71-083813d6f146, cookie 0x9232577658cf2241 00002000:00100000:1.0:1787893300.464429:0:18703:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli af98d6ca-b952-492d-ad71-083813d6f146/ffff9fc8c7613800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787893300.464440:0:18703:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787893300.464708:0:18703:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787893300.464739:0:18703:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7613000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787893300.464803:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe349c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af98d6ca-b952-492d-ad71-083813d6f146+6:2389:x1874741481824256:12345-192.168.202.35@tcp:8:mount.lustre.0 Request processed in 448us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893300.464811:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 17 00000100:00100000:0.0:1787893300.472326:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893300.472381:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893300.472487:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481824512 00000100:00100000:1.0:1787893300.472531:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481824512 00000100:00100000:1.0:1787893300.472592:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 3 00000100:00100000:1.0:1787893300.472601:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:af98d6ca-b952-492d-ad71-083813d6f146+6:14916:x1874741481824512:12345-192.168.202.35@tcp:900:mount.lustre.0 00000100:00100000:1.0:1787893300.472692:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:af98d6ca-b952-492d-ad71-083813d6f146+6:14916:x1874741481824512:12345-192.168.202.35@tcp:900:mount.lustre.0 Request processed in 92us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893300.472715:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 3 00000100:00100000:2.0:1787893300.473796:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481824384 00000100:00100000:2.0:1787893300.473805:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481824384 00000100:00100000:2.0:1787893300.473848:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 18 00000100:00100000:2.0:1787893300.473855:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2389:x1874741481824384:12345-192.168.202.35@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787893300.473884:0:18704:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from af98d6ca-b952-492d-ad71-083813d6f146@192.168.202.35@tcp t0 exp 0000000000000000 cur 544 last 0 00000020:00000080:2.0:1787893300.473921:0:18704:0:(genops.c:1385:class_connect()) connect: client af98d6ca-b952-492d-ad71-083813d6f146, cookie 0x9232577658cf2248 00002000:00100000:2.0:1787893300.473933:0:18704:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli af98d6ca-b952-492d-ad71-083813d6f146/ffff9fc9fa48d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787893300.473943:0:18704:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787893300.474126:0:18704:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787893300.474167:0:18704:0:(import.c:65:import_set_state_nolock()) ffff9fc9c74ee800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787893300.474229:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af98d6ca-b952-492d-ad71-083813d6f146+6:2389:x1874741481824384:12345-192.168.202.35@tcp:8:mount.lustre.0 Request processed in 372us (1913us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893300.474237:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 18 00000100:00100000:3.0:1787893300.483952:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893300.484091:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481824640 00000100:00100000:2.0:1787893300.484101:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481824640 00000100:00100000:2.0:1787893300.484166:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 0 00000100:00100000:2.0:1787893300.484176:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe349880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af98d6ca-b952-492d-ad71-083813d6f146+6:14916:x1874741481824640:12345-192.168.202.35@tcp:33:mount.lustre.0 00000004:00080000:3.0:1787893300.485587:0:17186:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1309us 00000001:00100000:0.0:1787893300.493236:0:19518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of af98d6ca-b952-492d-ad71-083813d6f146 00000001:00080000:0.0:1787893300.493256:0:19518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000004:00200000:2.0:1787893300.518818:0:17186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787893300.519198:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe349880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af98d6ca-b952-492d-ad71-083813d6f146+6:14916:x1874741481824640:12345-192.168.202.35@tcp:33:mount.lustre.0 Request processed in 34774us (35007us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893300.519212:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 0 00010000:00010000:1.0:1787893300.728130:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893300.818774:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893300.819528:0:19990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481824768 00000100:00100000:1.0:1787893300.819542:0:19990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481824768 00000100:00100000:3.0:1787893300.820230:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 13 00000100:00100000:3.0:1787893300.820247:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe34b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af98d6ca-b952-492d-ad71-083813d6f146+6:14962:x1874741481824768:12345-192.168.202.35@tcp:101:mkdir.0 00010000:00010000:3.0:1787893300.820277:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893300.820316:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf224f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fab77 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893300.820793:0:17185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f200/0x9232577658cf2256 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893300.820810:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f200/0x9232577658cf2256 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893300.820827:0:17185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f200/0x9232577658cf2256 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893300.820980:0:17185:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787893300.820985:0:17185:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787893300.821030:0:17185:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f200/0x9232577658cf2256 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893300.821134:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ee00/0x9232577658cf224f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fab77 expref: 8 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893300.821160:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f200/0x9232577658cf2256 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fab77 expref: 7 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893300.821170:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9e6fad400) 00010000:00010000:3.0:1787893300.821174:0:17185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787893300.821178:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7f200, rc 0) 00000100:00100000:3.0:1787893300.821352:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe34b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af98d6ca-b952-492d-ad71-083813d6f146+7:14962:x1874741481824768:12345-192.168.202.35@tcp:101:mkdir.0 Request processed in 1110us (2592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893300.821361:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 13 00000040:00080000:2.0:1787893301.554812:0:17937:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787893301.748832:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893302.769897:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893303.466202:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893303.466754:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481824896 00000100:00100000:2.0:1787893303.466768:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481824896 00000100:00100000:2.0:1787893303.466884:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 14 00000100:00100000:2.0:1787893303.466899:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af98d6ca-b952-492d-ad71-083813d6f146+7:15014:x1874741481824896:12345-192.168.202.35@tcp:41:lfs.0 00000004:00000024:2.0:1787893303.466952:0:17183:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787893303.467291:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af98d6ca-b952-492d-ad71-083813d6f146+7:15014:x1874741481824896:12345-192.168.202.35@tcp:41:lfs.0 Request processed in 393us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893303.467300:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 14 00000100:00080000:0.0:1787893303.467894:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787893303.476376:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893303.481327:0:19990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481825024 00000100:00100000:1.0:1787893303.481350:0:19990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481825024 00000100:00080000:0.0:1787893303.481573:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787893303.481874:0:19990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 15 00000100:00100000:1.0:1787893303.481896:0:19990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7788380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af98d6ca-b952-492d-ad71-083813d6f146+6:15014:x1874741481825024:12345-192.168.202.35@tcp:41:lfs.0 00000004:00000024:1.0:1787893303.481947:0:19990:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787893303.482280:0:19990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7788380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af98d6ca-b952-492d-ad71-083813d6f146+6:15014:x1874741481825024:12345-192.168.202.35@tcp:41:lfs.0 Request processed in 392us (5919us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893303.482289:0:19990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 15 00000100:00100000:3.0:1787893303.487639:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893303.487936:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481825152 00000100:00100000:2.0:1787893303.487952:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481825152 00000100:00100000:2.0:1787893303.488048:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 11 00000100:00100000:2.0:1787893303.488063:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe34ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:af98d6ca-b952-492d-ad71-083813d6f146+6:15014:x1874741481825152:12345-192.168.202.35@tcp:13:lfs.0 00002000:00000024:2.0:1787893303.488227:0:18706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787893303.488356:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe34ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:af98d6ca-b952-492d-ad71-083813d6f146+6:15014:x1874741481825152:12345-192.168.202.35@tcp:13:lfs.0 Request processed in 297us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893303.488365:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 11 00000100:00080000:0.0:1787893303.488682:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787893303.503060:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893303.517389:0:19991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481825280 00000100:00100000:0.0:1787893303.517411:0:19991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481825280 00000100:00100000:0.0:1787893303.517565:0:19991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 12 00000100:00100000:0.0:1787893303.517580:0:19991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7789c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:af98d6ca-b952-492d-ad71-083813d6f146+5:15014:x1874741481825280:12345-192.168.202.35@tcp:13:lfs.0 00002000:00000024:0.0:1787893303.517622:0:19991:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787893303.517743:0:19991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7789c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:af98d6ca-b952-492d-ad71-083813d6f146+5:15014:x1874741481825280:12345-192.168.202.35@tcp:13:lfs.0 Request processed in 168us (14699us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893303.517752:0:19991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 12 00000100:00080000:2.0:1787893303.518545:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787893303.793966:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893303.853253:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893303.853374:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481825408 00000100:00100000:2.0:1787893303.853388:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481825408 00000100:00100000:2.0:1787893303.853594:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 130 00000100:00100000:2.0:1787893303.853611:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf022523-db7f-4c9e-a3ea-97d11e9985e2+10:15048:x1874741481825408:12345-192.168.202.35@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787893303.853636:0:17178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893303.853673:0:17178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c67e1a00/0x9232577658cf225d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fab7e expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893303.853712:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c67e1a00/0x9232577658cf225d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fab7e expref: 11 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893303.853724:0:17178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c67e1a00/0x9232577658cf225d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fab7e expref: 11 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893303.853736:0:17178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c67e1a00, rc 0) 00000100:00100000:2.0:1787893303.853964:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf022523-db7f-4c9e-a3ea-97d11e9985e2+11:15048:x1874741481825408:12345-192.168.202.35@tcp:101:mount.lustre.0 Request processed in 357us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893303.853972:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 130 00000100:00100000:3.0:1787893303.858149:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893303.858701:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481825536 00000100:00100000:0.0:1787893303.858716:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481825536 00000100:00100000:0.0:1787893303.858790:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 131 00000100:00100000:0.0:1787893303.858803:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf022523-db7f-4c9e-a3ea-97d11e9985e2+11:15048:x1874741481825536:12345-192.168.202.35@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787893303.859020:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf022523-db7f-4c9e-a3ea-97d11e9985e2+11:15048:x1874741481825536:12345-192.168.202.35@tcp:501:mount.lustre.0 Request processed in 219us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893303.859049:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 131 00000100:00100000:3.0:1787893303.870321:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893303.870693:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481825664 00000100:00100000:1.0:1787893303.870707:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481825664 00000100:00100000:1.0:1787893303.870788:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 132 00000100:00100000:1.0:1787893303.870802:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf022523-db7f-4c9e-a3ea-97d11e9985e2+11:15048:x1874741481825664:12345-192.168.202.35@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787893303.871431:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf022523-db7f-4c9e-a3ea-97d11e9985e2+11:15048:x1874741481825664:12345-192.168.202.35@tcp:503:mount.lustre.0 Request processed in 628us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893303.871442:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 132 00000100:00100000:3.0:1787893303.876197:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893303.876326:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481825792 00000100:00100000:2.0:1787893303.876340:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481825792 00000100:00100000:2.0:1787893303.876404:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 133 00000100:00100000:2.0:1787893303.876457:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf022523-db7f-4c9e-a3ea-97d11e9985e2+11:15053:x1874741481825792:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787893303.877287:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf022523-db7f-4c9e-a3ea-97d11e9985e2+11:15053:x1874741481825792:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 869us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893303.877729:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 133 00000100:00100000:1.0:1787893303.913983:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893303.914111:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481825920 00000100:00100000:2.0:1787893303.914124:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481825920 00000100:00100000:2.0:1787893303.914198:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 134 00000100:00100000:2.0:1787893303.914219:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf022523-db7f-4c9e-a3ea-97d11e9985e2+11:15053:x1874741481825920:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787893303.914475:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf022523-db7f-4c9e-a3ea-97d11e9985e2+11:15053:x1874741481825920:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 266us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893303.914483:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 134 00000100:00100000:3.0:1787893303.923759:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893303.932083:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481826048 00000100:00100000:0.0:1787893303.932107:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481826048 00000100:00100000:0.0:1787893303.932199:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 135 00000100:00100000:0.0:1787893303.933636:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf022523-db7f-4c9e-a3ea-97d11e9985e2+11:15053:x1874741481826048:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787893303.934293:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf022523-db7f-4c9e-a3ea-97d11e9985e2+11:15053:x1874741481826048:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 2078us (10544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893303.934312:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 135 00000100:00100000:3.0:1787893303.951669:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893303.951846:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481826176 00000100:00100000:1.0:1787893303.951860:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481826176 00000100:00100000:1.0:1787893303.951963:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 136 00000100:00100000:1.0:1787893303.951977:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf022523-db7f-4c9e-a3ea-97d11e9985e2+11:15048:x1874741481826176:12345-192.168.202.35@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787893303.952002:0:17178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893303.952027:0:17178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9fe540200/0x9232577658cf2264 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fabaf expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893303.952066:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9fe540200/0x9232577658cf2264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fabaf expref: 12 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893303.952080:0:17178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9fe540200/0x9232577658cf2264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fabaf expref: 12 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893303.952090:0:17178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe540200, rc 0) 00000100:00100000:1.0:1787893303.952168:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf022523-db7f-4c9e-a3ea-97d11e9985e2+12:15048:x1874741481826176:12345-192.168.202.35@tcp:101:mount.lustre.0 Request processed in 193us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893303.952175:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 136 00000100:00100000:1.0:1787893303.959852:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893303.959973:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481826304 00000100:00100000:0.0:1787893303.959986:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481826304 00000100:00100000:0.0:1787893303.960060:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 137 00000100:00100000:0.0:1787893303.960072:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf022523-db7f-4c9e-a3ea-97d11e9985e2+12:15048:x1874741481826304:12345-192.168.202.35@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787893303.960107:0:17175:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787893303.960139:0:17175:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787893303.960144:0:17175:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787893303.960147:0:17175:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787893303.960151:0:17175:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787893303.960154:0:17175:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1787893303.964670:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf022523-db7f-4c9e-a3ea-97d11e9985e2+12:15048:x1874741481826304:12345-192.168.202.35@tcp:256:mount.lustre.0 Request processed in 4584us (4817us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893303.964689:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 137 00000100:00100000:3.0:1787893303.970959:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893303.971183:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481826432 00000100:00100000:2.0:1787893303.971196:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481826432 00000100:00100000:2.0:1787893303.971280:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 138 00000100:00100000:2.0:1787893303.971292:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf022523-db7f-4c9e-a3ea-97d11e9985e2+12:15048:x1874741481826432:12345-192.168.202.35@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787893303.971322:0:17177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893303.971345:0:17177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c67e0400/0x9232577658cf226b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fabb6 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893303.971383:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c67e0400/0x9232577658cf226b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fabb6 expref: 13 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893303.971395:0:17177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c67e0400/0x9232577658cf226b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fabb6 expref: 13 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893303.971407:0:17177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c67e0400, rc 0) 00000100:00100000:2.0:1787893303.971539:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf022523-db7f-4c9e-a3ea-97d11e9985e2+13:15048:x1874741481826432:12345-192.168.202.35@tcp:101:mount.lustre.0 Request processed in 249us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893303.971546:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 138 00000100:00100000:2.0:1787893303.975164:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893303.975405:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481826560 00000100:00100000:0.0:1787893303.975428:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481826560 00000100:00100000:2.0:1787893303.975663:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 139 00000100:00100000:2.0:1787893303.975678:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf022523-db7f-4c9e-a3ea-97d11e9985e2+13:15048:x1874741481826560:12345-192.168.202.35@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787893303.975897:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf022523-db7f-4c9e-a3ea-97d11e9985e2+13:15048:x1874741481826560:12345-192.168.202.35@tcp:501:mount.lustre.0 Request processed in 223us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893303.975931:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 139 00000100:00100000:3.0:1787893303.979544:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893303.979768:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481826688 00000100:00100000:1.0:1787893303.979780:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481826688 00000100:00100000:1.0:1787893303.979853:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 140 00000100:00100000:1.0:1787893303.979865:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf022523-db7f-4c9e-a3ea-97d11e9985e2+13:15048:x1874741481826688:12345-192.168.202.35@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787893303.980091:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf022523-db7f-4c9e-a3ea-97d11e9985e2+13:15048:x1874741481826688:12345-192.168.202.35@tcp:503:mount.lustre.0 Request processed in 227us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893303.980100:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 140 00000100:00100000:3.0:1787893303.985236:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893303.985565:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481826816 00000100:00100000:0.0:1787893303.985579:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481826816 00000100:00100000:0.0:1787893303.985656:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 141 00000100:00100000:0.0:1787893303.985669:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf022523-db7f-4c9e-a3ea-97d11e9985e2+13:15056:x1874741481826816:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787893303.985877:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf022523-db7f-4c9e-a3ea-97d11e9985e2+13:15056:x1874741481826816:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 210us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893303.985886:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 141 00000100:00100000:3.0:1787893304.006368:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893304.006661:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481826944 00000100:00100000:2.0:1787893304.006676:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481826944 00000100:00100000:2.0:1787893304.006752:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 142 00000100:00100000:2.0:1787893304.006765:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf022523-db7f-4c9e-a3ea-97d11e9985e2+13:15056:x1874741481826944:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787893304.006982:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf022523-db7f-4c9e-a3ea-97d11e9985e2+13:15056:x1874741481826944:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 218us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893304.006992:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 142 00000100:00100000:3.0:1787893304.048345:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893304.048421:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893304.048722:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481827072 00000100:00100000:1.0:1787893304.048738:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481827072 00000100:00100000:1.0:1787893304.048799:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481827328 00000100:00100000:1.0:1787893304.048815:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481827328 00000100:00100000:1.0:1787893304.048846:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 16 00000100:00100000:1.0:1787893304.048857:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2389:x1874741481827072:12345-192.168.202.35@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787893304.048908:0:17184:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 3f229414-7dd1-4cf5-a739-e3375b9be1a7@192.168.202.35@tcp t0 exp 0000000000000000 cur 547 last 0 00000020:00000080:1.0:1787893304.048960:0:17184:0:(genops.c:1385:class_connect()) connect: client 3f229414-7dd1-4cf5-a739-e3375b9be1a7, cookie 0x9232577658cf2272 00000004:00100000:1.0:1787893304.048999:0:17184:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787893304.049127:0:17184:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7610800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787893304.049235:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3f229414-7dd1-4cf5-a739-e3375b9be1a7+6:2389:x1874741481827072:12345-192.168.202.35@tcp:38:mount.lustre.0 Request processed in 377us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893304.049243:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 16 00000100:00100000:1.0:1787893304.049268:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 17 00000100:00100000:1.0:1787893304.049274:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2389:x1874741481827328:12345-192.168.202.35@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787893304.049291:0:17184:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 3f229414-7dd1-4cf5-a739-e3375b9be1a7@192.168.202.35@tcp t0 exp 0000000000000000 cur 547 last 0 00000020:00000080:1.0:1787893304.049318:0:17184:0:(genops.c:1385:class_connect()) connect: client 3f229414-7dd1-4cf5-a739-e3375b9be1a7, cookie 0x9232577658cf2279 00000004:00100000:1.0:1787893304.049333:0:17184:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787893304.049388:0:17184:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7615000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787893304.049424:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3f229414-7dd1-4cf5-a739-e3375b9be1a7+6:2389:x1874741481827328:12345-192.168.202.35@tcp:38:mount.lustre.0 Request processed in 149us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893304.049431:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 17 00000100:00100000:3.0:1787893304.057303:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893304.057411:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893304.060968:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893304.066386:0:19990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481827456 00000100:00100000:2.0:1787893304.066407:0:19990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481827456 00000100:00100000:2.0:1787893304.066590:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481827584 00000100:00100000:2.0:1787893304.066596:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481827584 00000100:00100000:1.0:1787893304.069359:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481827200 00000100:00100000:1.0:1787893304.069382:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481827200 00000100:00100000:1.0:1787893304.069485:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 18 00000100:00100000:1.0:1787893304.069514:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3f229414-7dd1-4cf5-a739-e3375b9be1a7+6:0:x1874741481827456:12345-192.168.202.35@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787893304.069571:0:17184:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787893304.069708:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3f229414-7dd1-4cf5-a739-e3375b9be1a7+6:0:x1874741481827456:12345-192.168.202.35@tcp:41:mount.lustre.0 Request processed in 198us (12420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893304.069737:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 18 00000100:00100000:1.0:1787893304.069762:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 19 00000100:00100000:1.0:1787893304.069770:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3f229414-7dd1-4cf5-a739-e3375b9be1a7+7:0:x1874741481827200:12345-192.168.202.35@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787893304.069785:0:17184:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787893304.069819:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3f229414-7dd1-4cf5-a739-e3375b9be1a7+7:0:x1874741481827200:12345-192.168.202.35@tcp:41:mount.lustre.0 Request processed in 51us (8868us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893304.069826:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 19 00000100:00080000:3.0:1787893304.072538:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787893304.072552:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787893304.073065:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 20 00000100:00100000:2.0:1787893304.073083:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3f229414-7dd1-4cf5-a739-e3375b9be1a7+6:15048:x1874741481827584:12345-192.168.202.35@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787893304.073124:0:17185:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787893304.073230:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3f229414-7dd1-4cf5-a739-e3375b9be1a7+6:15048:x1874741481827584:12345-192.168.202.35@tcp:41:mount.lustre.0 Request processed in 154us (15818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893304.073238:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 20 00000100:00100000:2.0:1787893304.075098:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893304.075197:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481827712 00000100:00100000:0.0:1787893304.075219:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481827712 00000100:00100000:0.0:1787893304.075291:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 21 00000100:00100000:0.0:1787893304.075303:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c778a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3f229414-7dd1-4cf5-a739-e3375b9be1a7+6:15048:x1874741481827712:12345-192.168.202.35@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787893304.075421:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c778a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3f229414-7dd1-4cf5-a739-e3375b9be1a7+6:15048:x1874741481827712:12345-192.168.202.35@tcp:40:mount.lustre.0 Request processed in 112us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893304.075430:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 21 00000100:00100000:0.0:1787893304.077843:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893304.077899:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893304.077984:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893304.078259:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481827840 00000100:00100000:2.0:1787893304.078273:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481827840 00000100:00100000:2.0:1787893304.078320:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481827968 00000100:00100000:2.0:1787893304.078324:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481827968 00000100:00100000:2.0:1787893304.078344:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 19 00000100:00100000:2.0:1787893304.078355:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2389:x1874741481827840:12345-192.168.202.35@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787893304.078399:0:18703:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3f229414-7dd1-4cf5-a739-e3375b9be1a7@192.168.202.35@tcp t0 exp 0000000000000000 cur 547 last 0 00000020:00000080:2.0:1787893304.078473:0:18703:0:(genops.c:1385:class_connect()) connect: client 3f229414-7dd1-4cf5-a739-e3375b9be1a7, cookie 0x9232577658cf2280 00002000:00100000:2.0:1787893304.078512:0:18703:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3f229414-7dd1-4cf5-a739-e3375b9be1a7/ffff9fc9c74ea800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787893304.078538:0:18703:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787893304.078674:0:18703:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787893304.078718:0:18703:0:(import.c:65:import_set_state_nolock()) ffff9fc9c74ec000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787893304.078808:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3f229414-7dd1-4cf5-a739-e3375b9be1a7+6:2389:x1874741481827840:12345-192.168.202.35@tcp:8:mount.lustre.0 Request processed in 453us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893304.078816:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 19 00000100:00100000:2.0:1787893304.078837:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 20 00000100:00100000:2.0:1787893304.078843:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2389:x1874741481827968:12345-192.168.202.35@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787893304.078862:0:18703:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 3f229414-7dd1-4cf5-a739-e3375b9be1a7@192.168.202.35@tcp t0 exp 0000000000000000 cur 547 last 0 00000020:00000080:2.0:1787893304.078895:0:18703:0:(genops.c:1385:class_connect()) connect: client 3f229414-7dd1-4cf5-a739-e3375b9be1a7, cookie 0x9232577658cf2287 00002000:00100000:2.0:1787893304.078901:0:18703:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3f229414-7dd1-4cf5-a739-e3375b9be1a7/ffff9fc9c74e8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787893304.078908:0:18703:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787893304.078961:0:18703:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787893304.078976:0:18703:0:(import.c:65:import_set_state_nolock()) ffff9fc9c74eb800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787893304.079002:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3f229414-7dd1-4cf5-a739-e3375b9be1a7+6:2389:x1874741481827968:12345-192.168.202.35@tcp:8:mount.lustre.0 Request processed in 157us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893304.079009:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 20 00000100:00100000:1.0:1787893304.079625:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481828096 00000100:00100000:1.0:1787893304.079635:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481828096 00000100:00100000:1.0:1787893304.079698:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 4 00000100:00100000:1.0:1787893304.079707:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3f229414-7dd1-4cf5-a739-e3375b9be1a7+6:15048:x1874741481828096:12345-192.168.202.35@tcp:900:mount.lustre.0 00000100:00100000:1.0:1787893304.079772:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3f229414-7dd1-4cf5-a739-e3375b9be1a7+6:15048:x1874741481828096:12345-192.168.202.35@tcp:900:mount.lustre.0 Request processed in 67us (1943us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893304.079780:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 4 00000100:00100000:0.0:1787893304.084400:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893304.084470:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893304.084549:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893304.084581:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893304.084604:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893304.084623:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893304.084892:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481828224 00000100:00100000:1.0:1787893304.084907:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481828224 00000100:00100000:1.0:1787893304.084976:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 143 00000100:00100000:1.0:1787893304.084988:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf022523-db7f-4c9e-a3ea-97d11e9985e2+13:2391:x1874741481828224:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893304.085079:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf022523-db7f-4c9e-a3ea-97d11e9985e2+13:2391:x1874741481828224:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 93us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893304.085087:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 143 00000100:00100000:1.0:1787893304.085177:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893304.085326:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481828480 00000100:00100000:1.0:1787893304.085331:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481828480 00000100:00100000:1.0:1787893304.085370:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481828992 00000100:00100000:1.0:1787893304.085373:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481828992 00000100:00100000:1.0:1787893304.085386:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481828352 00000100:00100000:1.0:1787893304.085389:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481828352 00000100:00100000:1.0:1787893304.085431:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481828864 00000100:00100000:1.0:1787893304.085434:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481828864 00000100:00100000:1.0:1787893304.085461:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 32 00000100:00100000:1.0:1787893304.085469:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af98d6ca-b952-492d-ad71-083813d6f146+6:2391:x1874741481828480:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893304.085545:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af98d6ca-b952-492d-ad71-083813d6f146+6:2391:x1874741481828480:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 76us (1074us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893304.085553:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 32 00000100:00100000:1.0:1787893304.085568:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 33 00000100:00100000:1.0:1787893304.085574:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3f229414-7dd1-4cf5-a739-e3375b9be1a7+6:2391:x1874741481828992:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893304.085600:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3f229414-7dd1-4cf5-a739-e3375b9be1a7+6:2391:x1874741481828992:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 26us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893304.085606:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 33 00000100:00100000:1.0:1787893304.085619:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 34 00000100:00100000:1.0:1787893304.085624:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af98d6ca-b952-492d-ad71-083813d6f146+7:2391:x1874741481828352:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893304.085661:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af98d6ca-b952-492d-ad71-083813d6f146+7:2391:x1874741481828352:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 37us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893304.085668:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 34 00000100:00100000:1.0:1787893304.085680:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 35 00000100:00100000:1.0:1787893304.085686:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3f229414-7dd1-4cf5-a739-e3375b9be1a7+6:2391:x1874741481828864:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893304.085712:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3f229414-7dd1-4cf5-a739-e3375b9be1a7+6:2391:x1874741481828864:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 25us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893304.085731:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 35 00000100:00100000:3.0:1787893304.093125:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481828736 00000100:00100000:3.0:1787893304.093146:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481828736 00000100:00100000:1.0:1787893304.093405:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481828608 00000100:00100000:1.0:1787893304.093419:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481828608 00000100:00100000:1.0:1787893304.093463:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 5 00000100:00100000:1.0:1787893304.093475:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af98d6ca-b952-492d-ad71-083813d6f146+5:2391:x1874741481828736:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893304.093624:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af98d6ca-b952-492d-ad71-083813d6f146+5:2391:x1874741481828736:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 151us (9073us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893304.093633:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 5 00000100:00100000:1.0:1787893304.093671:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 6 00000100:00100000:1.0:1787893304.093680:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af98d6ca-b952-492d-ad71-083813d6f146+6:2391:x1874741481828608:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893304.093707:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af98d6ca-b952-492d-ad71-083813d6f146+6:2391:x1874741481828608:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 30us (9084us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893304.093714:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 6 00000100:00100000:1.0:1787893304.098659:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893304.100770:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481829120 00000100:00100000:0.0:1787893304.100790:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481829120 00000100:00100000:0.0:1787893304.100887:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 1 00000100:00100000:0.0:1787893304.100902:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3f229414-7dd1-4cf5-a739-e3375b9be1a7+6:15048:x1874741481829120:12345-192.168.202.35@tcp:33:mount.lustre.0 00000004:00200000:0.0:1787893304.101041:0:17187:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787893304.101171:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3f229414-7dd1-4cf5-a739-e3375b9be1a7+6:15048:x1874741481829120:12345-192.168.202.35@tcp:33:mount.lustre.0 Request processed in 271us (2537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893304.101203:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 1 00000100:00100000:1.0:1787893304.359216:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893304.359603:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481829248 00000100:00100000:2.0:1787893304.359619:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481829248 00000100:00100000:2.0:1787893304.359706:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 22 00000100:00100000:2.0:1787893304.359719:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3f229414-7dd1-4cf5-a739-e3375b9be1a7+6:15079:x1874741481829248:12345-192.168.202.35@tcp:101:mkdir.0 00010000:00010000:2.0:1787893304.359747:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893304.359799:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0c00/0x9232577658cf228e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fabe7 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893304.359900:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0e00/0x9232577658cf2295 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893304.359918:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0e00/0x9232577658cf2295 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893304.359937:0:17184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0e00/0x9232577658cf2295 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893304.360000:0:17184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787893304.360004:0:17184:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787893304.360031:0:17184:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0e00/0x9232577658cf2295 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893304.360065:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0c00/0x9232577658cf228e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fabe7 expref: 8 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893304.360088:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0e00/0x9232577658cf2295 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fabe7 expref: 7 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893304.360099:0:17184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9e6fad400) 00010000:00010000:2.0:1787893304.360102:0:17184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787893304.360106:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c67e0e00, rc 0) 00000100:00100000:2.0:1787893304.360680:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3f229414-7dd1-4cf5-a739-e3375b9be1a7+7:15079:x1874741481829248:12345-192.168.202.35@tcp:101:mkdir.0 Request processed in 961us (1477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893304.360688:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 22 00010000:00010000:1.0:1787893304.819468:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893305.526178:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493443968:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787893305.526281:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893305.526377:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493444096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787893305.526414:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893305.526464:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493443968 00000100:00100000:0.0:1787893305.526474:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493443968 00000100:00100000:0.0:1787893305.526643:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493444096 00000100:00100000:0.0:1787893305.526647:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493444096 00000100:00100000:0.0:1787893305.526678:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787893305.526689:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493443968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787893305.526732:0:18705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787893305.526789:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493443968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893305.526798:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787893305.526961:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787893305.526969:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493444096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787893305.526981:0:18705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787893305.527013:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493444096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893305.527020:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1787893305.527046:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787893305.527078:0:3632:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1787893305.527109:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493444096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787893305.527141:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493443968:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787893305.528258:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13b37fca-0eda-4b14-a6ef-4a378c945d17:3630:1874741493444352:0@lo:400:kworker.0 00000100:00100000:1.0:1787893305.528320:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893305.528363:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493444864:0@lo:400:kworker.0 00000100:00100000:1.0:1787893305.528393:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893305.528427:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7d4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493445376:0@lo:400:kworker.0 00000100:00100000:1.0:1787893305.528453:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893305.530159:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d29faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493444224:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787893305.530237:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893305.530282:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874741493444736:0@lo:400:kworker.0 00000100:00100000:0.0:1787893305.530325:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493444864 00000100:00100000:0.0:1787893305.530335:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493444864 00000100:00100000:0.0:1787893305.530396:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493444224 00000100:00100000:0.0:1787893305.530411:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493444224 00000100:00100000:0.0:1787893305.530431:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787893305.530440:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493444864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893305.530533:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493444864:12345-0@lo:400:kworker.0 Request processed in 93us (2139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893305.530547:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787893305.530568:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787893305.530574:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493444224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787893305.530606:0:17188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787893305.530645:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493444224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893305.530652:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787893305.530678:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493444608:0@lo:400:kworker.0 00000100:00100000:0.0:1787893305.530708:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893305.530730:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493445120:0@lo:400:kworker.0 00000100:00100000:0.0:1787893305.530780:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493444352 00000100:00100000:0.0:1787893305.530784:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493444352 00000100:00100000:0.0:1787893305.530829:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787893305.530837:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5feec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:3630:x1874741493444352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893305.530891:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5feec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:3630:x1874741493444352:12345-0@lo:400:kworker.0 Request processed in 55us (2570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893305.530898:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787893305.530931:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493444480:0@lo:400:kworker.0 00000100:00100000:0.0:1787893305.530956:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893305.530974:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493444992:0@lo:400:kworker.0 00000100:00100000:0.0:1787893305.530998:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893305.531018:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7d49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1874741493445504:0@lo:400:kworker.0 00000100:00100000:0.0:1787893305.531041:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493444480 00000100:00100000:0.0:1787893305.531044:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493444480 00000100:00100000:0.0:1787893305.531062:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787893305.531067:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493444480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893305.531095:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493444480:12345-0@lo:400:kworker.0 Request processed in 27us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893305.531101:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787893305.531132:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493444608 00000100:00100000:0.0:1787893305.531135:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493444608 00000100:00100000:0.0:1787893305.531167:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493444992 00000100:00100000:0.0:1787893305.531169:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493444992 00000100:00100000:0.0:1787893305.531184:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787893305.531190:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493444608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893305.531236:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493444608:12345-0@lo:400:kworker.0 Request processed in 46us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893305.531242:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787893305.531252:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787893305.531257:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493444992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893305.531287:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493444992:12345-0@lo:400:kworker.0 Request processed in 30us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893305.531293:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1787893305.531307:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787893305.537956:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893305.538013:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7d48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1874741493445248:0@lo:400:kworker.0 00000100:00100000:1.0:1787893305.538107:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893305.538144:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c778b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493445760:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787893305.538175:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893305.538233:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d29faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493444224:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787893305.538279:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493445376 00000100:00100000:1.0:1787893305.538288:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493445376 00000100:00100000:1.0:1787893305.538347:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493444736 00000100:00100000:1.0:1787893305.538350:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493444736 00000100:00100000:1.0:1787893305.538363:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493445248 00000100:00100000:1.0:1787893305.538365:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493445248 00000100:00100000:1.0:1787893305.538382:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787893305.538392:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493445376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893305.538480:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493445376:12345-0@lo:400:kworker.0 Request processed in 88us (10025us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893305.538488:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1787893305.538738:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7d4b800 x1874741493445376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893305.538752:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7d4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493445376:0@lo:400:kworker.0 00000100:00100000:0.0:1787893305.538772:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493445888:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787893305.538817:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893305.538849:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13b37fca-0eda-4b14-a6ef-4a378c945d17:3630:1874741493444352:0@lo:400:kworker.0 00000100:00100000:0.0:1787893305.538863:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493444864:0@lo:400:kworker.0 00000100:00100000:0.0:1787893305.538876:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787893305.538883:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493446016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787893305.538906:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893305.538935:0:19991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493445888 00000100:00100000:0.0:1787893305.538939:0:19991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493445888 00000100:00100000:0.0:1787893305.538969:0:19991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493446016 00000100:00100000:0.0:1787893305.538971:0:19991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493446016 00000100:00100000:0.0:1787893305.538989:0:19991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787893305.538995:0:19991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493445888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787893305.539023:0:19991:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787893305.539065:0:19991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493445888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893305.539071:0:19991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787893305.539089:0:19991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787893305.539105:0:19991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493446016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787893305.539115:0:19991:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787893305.539139:0:19991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493446016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893305.539144:0:19991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787893305.539177:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493446016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787893305.539192:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493445888:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787893305.546766:0:19990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787893305.546909:0:19990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1874741493444736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893305.547052:0:19990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1874741493444736:12345-0@lo:400:kworker.0 Request processed in 252us (9105us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893305.547062:0:19990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787893305.547107:0:19990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787893305.547115:0:19990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1874741493445248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893305.547149:0:19990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1874741493445248:12345-0@lo:400:kworker.0 Request processed in 36us (9042us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893305.547156:0:19990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787893305.548805:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893305.548875:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7d49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493445632:0@lo:400:kworker.0 00000100:00100000:2.0:1787893305.548938:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893305.549000:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493444608:0@lo:400:kworker.0 00000100:00100000:2.0:1787893305.549046:0:19990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493445120 00000100:00100000:2.0:1787893305.549054:0:19990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493445120 00000100:00100000:2.0:1787893305.549105:0:19990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493445632 00000100:00100000:2.0:1787893305.549108:0:19990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493445632 00000100:00100000:2.0:1787893305.549134:0:19990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787893305.549143:0:19990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c778a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493445120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893305.549224:0:19990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c778a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493445120:12345-0@lo:400:kworker.0 Request processed in 81us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893305.549232:0:19990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787893305.549250:0:19990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787893305.549257:0:19990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7788a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493445632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893305.549283:0:19990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7788a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493445632:12345-0@lo:400:kworker.0 Request processed in 27us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893305.549300:0:19990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787893305.549321:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893305.549357:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493444480:0@lo:400:kworker.0 00000100:00100000:2.0:1787893305.549370:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493444992:0@lo:400:kworker.0 00000100:00100000:2.0:1787893305.549410:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493445760 00000100:00100000:2.0:1787893305.549415:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493445760 00000100:00100000:2.0:1787893305.549452:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787893305.549460:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493445760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787893305.549634:0:17188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787893305.549679:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493445760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 220us (11503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893305.549686:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787893305.549717:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493445120:0@lo:400:kworker.0 00010000:00080000:2.0:1787893305.549733:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7d49880 x1874741493445632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893305.549744:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7d49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493445632:0@lo:400:kworker.0 00000100:00100000:2.0:1787893305.549764:0:19990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493445504 00000100:00100000:2.0:1787893305.549768:0:19990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493445504 00000100:00100000:2.0:1787893305.549788:0:19990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787893305.549793:0:19990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c778b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1874741493445504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893305.549830:0:19990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c778b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1874741493445504:12345-0@lo:400:kworker.0 Request processed in 36us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893305.549837:0:19990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787893305.549871:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7d49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1874741493445504:0@lo:400:kworker.0 00000100:00080000:1.0:1787893305.557202:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787893305.557215:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787893305.557306:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c778b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493445760:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787893305.557335:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874741493444736:0@lo:400:kworker.0 00000100:00100000:1.0:1787893305.557352:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7d48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1874741493445248:0@lo:400:kworker.0 00010000:00010000:3.0:1787893305.844730:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787893306.036536:0:17916:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 3f229414-7dd1-4cf5-a739-e3375b9be1a7 00000001:00100000:3.0:1787893306.036548:0:17916:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of af98d6ca-b952-492d-ad71-083813d6f146 00000001:00100000:0.0:1787893306.038864:0:17163:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3f229414-7dd1-4cf5-a739-e3375b9be1a7 00000001:00100000:0.0:1787893306.038881:0:17163:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of af98d6ca-b952-492d-ad71-083813d6f146 00000001:00100000:3.0:1787893306.041669:0:18699:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3f229414-7dd1-4cf5-a739-e3375b9be1a7 00000001:00100000:3.0:1787893306.041683:0:18699:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of af98d6ca-b952-492d-ad71-083813d6f146 00000040:00080000:2.0:1787893306.357905:0:17220:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787893306.865875:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893307.889653:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787893308.106400:0:20078:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1787893308.914566:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893309.473548:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893309.473606:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893309.473632:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893309.473662:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893309.473700:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893309.473733:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893309.473765:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893309.473767:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481829504 00000100:00100000:2.0:1787893309.473785:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481829504 00000100:00100000:1.0:1787893309.473792:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893309.473825:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893309.473871:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481829376 00000100:00100000:1.0:1787893309.473880:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481829376 00000100:00100000:2.0:1787893309.473886:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481829632 00000100:00100000:2.0:1787893309.473893:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481829632 00000100:00100000:2.0:1787893309.473920:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481830144 00000100:00100000:2.0:1787893309.473924:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481830144 00000100:00100000:1.0:1787893309.473949:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 145 00000100:00100000:2.0:1787893309.473951:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481830016 00000100:00100000:2.0:1787893309.473957:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481830016 00000100:00100000:1.0:1787893309.473966:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf022523-db7f-4c9e-a3ea-97d11e9985e2+13:2390:x1874741481829376:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893309.473981:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 42 00000100:00100000:2.0:1787893309.473993:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af98d6ca-b952-492d-ad71-083813d6f146+6:2391:x1874741481829504:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893309.474045:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf022523-db7f-4c9e-a3ea-97d11e9985e2+13:2390:x1874741481829376:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 81us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893309.474055:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 145 00000100:00100000:2.0:1787893309.474070:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af98d6ca-b952-492d-ad71-083813d6f146+6:2391:x1874741481829504:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 75us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893309.474082:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 42 00000100:00100000:1.0:1787893309.474106:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 43 00000100:00100000:2.0:1787893309.474335:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 44 00000100:00100000:2.0:1787893309.474349:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3f229414-7dd1-4cf5-a739-e3375b9be1a7+5:2390:x1874741481830144:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893309.474400:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3f229414-7dd1-4cf5-a739-e3375b9be1a7+5:2390:x1874741481830144:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 53us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893309.474407:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 44 00000100:00100000:2.0:1787893309.474423:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 45 00000100:00100000:2.0:1787893309.474431:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3f229414-7dd1-4cf5-a739-e3375b9be1a7+6:2391:x1874741481830016:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893309.474460:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3f229414-7dd1-4cf5-a739-e3375b9be1a7+6:2391:x1874741481830016:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 31us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893309.474465:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 45 00000100:00100000:1.0:1787893309.476541:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af98d6ca-b952-492d-ad71-083813d6f146+5:2390:x1874741481829632:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893309.476626:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af98d6ca-b952-492d-ad71-083813d6f146+5:2390:x1874741481829632:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 2505us (2988us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893309.476638:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 43 00000100:00100000:1.0:1787893309.476686:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481829888 00000100:00100000:1.0:1787893309.476693:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481829888 00000100:00100000:1.0:1787893309.476735:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481830400 00000100:00100000:1.0:1787893309.476740:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481830400 00000100:00100000:1.0:1787893309.476767:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481829760 00000100:00100000:1.0:1787893309.476771:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481829760 00000100:00100000:1.0:1787893309.476797:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481830272 00000100:00100000:1.0:1787893309.476800:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481830272 00000100:00100000:1.0:1787893309.476827:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 9 00000100:00100000:1.0:1787893309.476845:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af98d6ca-b952-492d-ad71-083813d6f146+5:2390:x1874741481829888:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893309.476897:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af98d6ca-b952-492d-ad71-083813d6f146+5:2390:x1874741481829888:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 59us (3235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893309.476906:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 9 00000100:00100000:1.0:1787893309.476933:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 10 00000100:00100000:1.0:1787893309.476943:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3f229414-7dd1-4cf5-a739-e3375b9be1a7+6:2390:x1874741481830400:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893309.476973:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3f229414-7dd1-4cf5-a739-e3375b9be1a7+6:2390:x1874741481830400:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 33us (3240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893309.476985:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 10 00000100:00100000:1.0:1787893309.477016:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 11 00000100:00100000:1.0:1787893309.477026:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af98d6ca-b952-492d-ad71-083813d6f146+5:2391:x1874741481829760:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893309.477057:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af98d6ca-b952-492d-ad71-083813d6f146+5:2391:x1874741481829760:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 33us (3291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893309.477065:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 11 00000100:00100000:1.0:1787893309.477083:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 12 00000100:00100000:1.0:1787893309.477092:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3f229414-7dd1-4cf5-a739-e3375b9be1a7+5:2391:x1874741481830272:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893309.477119:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3f229414-7dd1-4cf5-a739-e3375b9be1a7+5:2391:x1874741481830272:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 28us (3292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893309.477126:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 12 00000100:00080000:1.0:1787893309.477172:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787893309.477180:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787893309.477183:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787893309.477190:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787893309.940442:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787893310.134675:0:19518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3f229414-7dd1-4cf5-a739-e3375b9be1a7 00000100:00100000:0.0:1787893310.641717:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493446272:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787893310.641781:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893310.641832:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787893310.641839:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493446144:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787893310.641861:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893310.641886:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493446400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787893310.641908:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893310.641938:0:19991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493446272 00000100:00100000:0.0:1787893310.641945:0:19991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493446272 00000100:00100000:0.0:1787893310.641984:0:19991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493446144 00000100:00100000:0.0:1787893310.641988:0:19991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493446144 00000100:00100000:0.0:1787893310.641998:0:19991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493446400 00000100:00100000:0.0:1787893310.642001:0:19991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493446400 00000100:00100000:0.0:1787893310.642017:0:19991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787893310.642026:0:19991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493446272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787893310.642054:0:19991:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787893310.642095:0:19991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493446272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893310.642109:0:19991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787893310.642125:0:19991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787893310.642131:0:19991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493446144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787893310.642146:0:19991:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787893310.642174:0:19991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493446144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893310.642180:0:19991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787893310.642191:0:19991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787893310.642197:0:19991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493446400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787893310.642205:0:19991:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787893310.642231:0:19991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493446400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893310.642237:0:19991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1787893310.642258:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787893310.642261:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787893310.642288:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493446400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787893310.642334:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493446144:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787893310.642345:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493446272:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787893310.642448:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c778b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493446528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787893310.642482:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893310.642590:0:19991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493446528 00000100:00100000:0.0:1787893310.642594:0:19991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493446528 00000100:00100000:0.0:1787893310.644456:0:19991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787893310.644471:0:19991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493446528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787893310.644505:0:19991:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787893310.644573:0:19991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493446528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (2089us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893310.644585:0:19991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787893310.644638:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c778b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493446528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787893310.647688:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d29faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493446656:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787893310.647756:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893310.647819:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493446656 00000100:00100000:3.0:1787893310.647827:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493446656 00000100:00100000:3.0:1787893310.647892:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787893310.647903:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493446656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787893310.647931:0:18203:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787893310.647974:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493446656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893310.647981:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787893310.648033:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d29faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493446656:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787893310.648866:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493447168:0@lo:400:kworker.0 00000100:00100000:3.0:1787893310.648904:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893310.648925:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493447680:0@lo:400:kworker.0 00000100:00100000:3.0:1787893310.648950:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893310.648970:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787893310.648976:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13b37fca-0eda-4b14-a6ef-4a378c945d17:3632:1874741493446784:0@lo:400:kworker.0 00000100:00100000:3.0:1787893310.648999:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893310.649023:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493447296:0@lo:400:kworker.0 00000100:00100000:3.0:1787893310.649044:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893310.649060:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493447808:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787893310.649083:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893310.649124:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493447168 00000100:00100000:3.0:1787893310.649129:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493447168 00000100:00100000:3.0:1787893310.649166:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493447680 00000100:00100000:3.0:1787893310.649169:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493447680 00000100:00080000:2.0:1787893310.650604:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787893310.650625:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493447808 00000100:00100000:2.0:1787893310.650632:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493447808 00000100:00100000:2.0:1787893310.650686:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787893310.650696:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493447808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787893310.650730:0:17188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787893310.650793:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493447808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (1709us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893310.650800:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787893310.650822:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493447296 00000100:00100000:2.0:1787893310.650825:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493447296 00000100:00100000:2.0:1787893310.650844:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787893310.650851:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493447168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893310.650883:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493447168:12345-0@lo:400:kworker.0 Request processed in 33us (1979us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893310.650889:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787893310.650901:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787893310.650907:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493447296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893310.650934:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493447296:12345-0@lo:400:kworker.0 Request processed in 27us (1889us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893310.650939:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787893310.650973:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493447296:0@lo:400:kworker.0 00000100:00100000:2.0:1787893310.650987:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493447808:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787893310.650997:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493447168:0@lo:400:kworker.0 00000100:00080000:2.0:1787893310.651034:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787893310.651037:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787893310.653253:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493446784 00000100:00100000:2.0:1787893310.653266:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493446784 00000100:00100000:2.0:1787893310.653323:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787893310.653334:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:3632:x1874741493446784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893310.653431:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:3632:x1874741493446784:12345-0@lo:400:kworker.0 Request processed in 100us (4430us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893310.653438:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787893310.653783:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13b37fca-0eda-4b14-a6ef-4a378c945d17:3632:1874741493446784:0@lo:400:kworker.0 00000100:00100000:2.0:1787893310.654060:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493446912:0@lo:400:kworker.0 00000100:00100000:2.0:1787893310.654096:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893310.654107:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787893310.654115:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493447424:0@lo:400:kworker.0 00000100:00100000:3.0:1787893310.654128:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493447680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893310.654133:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893310.654146:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787893310.654152:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493447040:0@lo:400:kworker.0 00000100:00100000:3.0:1787893310.654169:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493447680:12345-0@lo:400:kworker.0 Request processed in 56us (5218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893310.654174:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893310.654176:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787893310.654186:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493446912 00000100:00100000:2.0:1787893310.654189:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1874741493447552:0@lo:400:kworker.0 00000100:00100000:3.0:1787893310.654190:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493446912 00000100:00100000:2.0:1787893310.654207:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893310.654216:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493447424 00000100:00100000:3.0:1787893310.654219:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493447424 00000100:00100000:2.0:1787893310.654224:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493447552 00000100:00100000:2.0:1787893310.654227:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493447552 00010000:00080000:0.0:1787893310.654767:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb7e300 x1874741493447680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893310.654781:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493447680:0@lo:400:kworker.0 00000100:00080000:1.0:1787893310.654868:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787893310.655583:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787893310.655588:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787893310.655593:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493446912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893310.655595:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874741493447552:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787893310.656477:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787893310.656540:0:17185:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787893310.656551:0:17185:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1787893310.656570:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493447040 00000100:00100000:1.0:1787893310.656576:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493447040 00000100:00100000:1.0:1787893310.656610:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787893310.656618:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493447040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893310.658465:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874741493447552:12345-0@lo:400:kworker.0 Request processed in 2861us (4248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893310.658479:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787893310.658522:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787893310.658539:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493447424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893310.669274:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493446912:12345-0@lo:400:kworker.0 Request processed in 13676us (15170us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893310.669289:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787893310.669602:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493447424:12345-0@lo:400:kworker.0 Request processed in 11066us (15465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893310.669611:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787893310.679165:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493447040:12345-0@lo:400:kworker.0 Request processed in 22537us (24979us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893310.679180:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787893310.679541:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493447040:0@lo:400:kworker.0 00000100:00100000:2.0:1787893310.679559:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1874741493447552:0@lo:400:kworker.0 00000100:00100000:2.0:1787893310.679570:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493446912:0@lo:400:kworker.0 00010000:00080000:2.0:1787893310.679584:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb7e680 x1874741493447424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893310.679595:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493447424:0@lo:400:kworker.0 00010000:00010000:0.0:1787893310.964737:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787893311.717089:0:20227:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffdc3b8260 20000000:00000080:1.0:1787893311.717106:0:20227:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fc9fa3f6c00 uarg=0000000000000000 20000000:01000000:1.0:1787893311.717145:0:20227:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787893311.717150:0:20227:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787893311.717155:0:20227:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787893311.719384:0:20228:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1787893311.719970:0:20227:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787893311.735141:0:20227:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787893311.735184:0:20227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fc9edb30800/0x9232577658cf229c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893311.735205:0:20227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9dd69d000/0x9232577658cf1f31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf1f2a expref: 23 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893311.735213:0:20227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9c4153c00/0x9232577658cf1f3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf1f38 expref: 23 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893311.735219:0:20227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9dd69da00/0x9232577658cf1f7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf1f77 expref: 23 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893311.735226:0:20227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9c147d400/0x9232577658cf20e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf20dc expref: 23 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893311.735235:0:20227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc8c67e1c00/0x9232577658cf222c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fab46 expref: 12 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893311.735243:0:20227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc8c67e0400/0x9232577658cf226b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fabb6 expref: 12 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893311.735271:0:20227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fc9edb30800/0x9232577658cf229c lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893311.735317:0:20227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc8c67e0400/0x9232577658cf226b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fabb6 expref: 12 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893311.735333:0:20227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc8c67e0400/0x9232577658cf226b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fabb6 expref: 12 pid: 17177 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893311.735359:0:20227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20227:1874741493447936:192.168.202.35@tcp:104: 00010000:00010000:0.0:1787893311.735464:0:20227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc8c67e1c00/0x9232577658cf222c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fab46 expref: 12 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893311.735473:0:20227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc8c67e1c00/0x9232577658cf222c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fab46 expref: 12 pid: 17178 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893311.735482:0:20227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20227:1874741493448064:192.168.202.35@tcp:104: 00010000:00010000:0.0:1787893311.736651:0:20227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9c147d400/0x9232577658cf20e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf20dc expref: 23 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893311.736664:0:20227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc9c147d400/0x9232577658cf20e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf20dc expref: 23 pid: 17177 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893311.736676:0:20227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20227:1874741493448192:0@lo:104: 00000100:00100000:0.0:1787893311.736718:0:20227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787893311.737534:0:20227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9dd69da00/0x9232577658cf1f7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf1f77 expref: 23 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893311.737561:0:20227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc9dd69da00/0x9232577658cf1f7e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf1f77 expref: 23 pid: 17175 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893311.737571:0:20227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20227:1874741493448320:0@lo:104: 00000100:00100000:0.0:1787893311.737606:0:20227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893311.744824:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893311.745088:0:17169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481830528 00000100:00100000:2.0:1787893311.745098:0:17169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481830528 00010000:00010000:2.0:1787893311.745136:0:17169:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc8c67e0400/0x9232577658cf226b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fabb6 expref: 13 pid: 17177 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893311.745170:0:17169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 9 00000100:00100000:2.0:1787893311.745180:0:17169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf022523-db7f-4c9e-a3ea-97d11e9985e2+13:2391:x1874741481830528:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787893311.745194:0:17169:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893311.745200:0:17169:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc8c67e0400/0x9232577658cf226b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fabb6 expref: 13 pid: 17177 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893311.745211:0:17169:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc8c67e0400/0x9232577658cf226b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fabb6 expref: 13 pid: 17177 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893311.745230:0:17169:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893311.745292:0:17169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf022523-db7f-4c9e-a3ea-97d11e9985e2+13:2391:x1874741481830528:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 113us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893311.745300:0:17169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 9 00010000:00010000:0.0:1787893311.748066:0:20227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9c4153c00/0x9232577658cf1f3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf1f38 expref: 23 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893311.748083:0:20227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc9c4153c00/0x9232577658cf1f3f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf1f38 expref: 23 pid: 17178 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893311.748099:0:20227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20227:1874741493448448:0@lo:104: 00000100:00100000:0.0:1787893311.748151:0:20227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893311.749558:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493448192 00000100:00100000:3.0:1787893311.749569:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493448192 00000100:00100000:3.0:1787893311.749623:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493448320 00000100:00100000:3.0:1787893311.749626:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493448320 00000100:00100000:3.0:1787893311.749642:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787893311.749651:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13b37fca-0eda-4b14-a6ef-4a378c945d17+4:20227:x1874741493448192:12345-0@lo:104: 00010000:00010000:3.0:1787893311.749666:0:17167:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6a00/0x9232577658cf20dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf20e3 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893311.749738:0:17167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787893311.749743:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13b37fca-0eda-4b14-a6ef-4a378c945d17+4:20227:x1874741493448192:12345-0@lo:104: Request processed in 95us (13026us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893311.749750:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787893311.749766:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787893311.749775:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c778b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13b37fca-0eda-4b14-a6ef-4a378c945d17+3:20227:x1874741493448320:12345-0@lo:104: 00010000:00010000:3.0:1787893311.749782:0:17167:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9c4152800/0x9232577658cf1f77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf1f7e expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893311.749909:0:17167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787893311.749914:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c778b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13b37fca-0eda-4b14-a6ef-4a378c945d17+3:20227:x1874741493448320:12345-0@lo:104: Request processed in 143us (12313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893311.749920:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1787893311.749937:0:19536:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787893311.749943:0:19536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6a00/0x9232577658cf20dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf20e3 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893311.749965:0:19536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c84f6a00 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:3.0:1787893311.749969:0:19536:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6a00/0x9232577658cf20dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf20e3 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893311.749978:0:19536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6a00/0x9232577658cf20dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf20e3 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787893311.749986:0:19536:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6a00/0x9232577658cf20dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf20e3 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787893311.749991:0:19536:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787893311.750021:0:19536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6a00/0x9232577658cf20dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf20e3 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893311.750028:0:19536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787893311.750048:0:19536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6a00/0x9232577658cf20dc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf20e3 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893311.750054:0:19536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6a00/0x9232577658cf20dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf20e3 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893311.750067:0:19536:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787893311.750069:0:19536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9c4152800/0x9232577658cf1f77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf1f7e expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893311.750075:0:19536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c4152800 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:3.0:1787893311.750079:0:19536:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c4152800/0x9232577658cf1f77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf1f7e expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893311.750095:0:19536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9c4152800/0x9232577658cf1f77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf1f7e expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787893311.750101:0:19536:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c4152800/0x9232577658cf1f77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf1f7e expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787893311.750105:0:19536:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787893311.750116:0:19536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9c4152800/0x9232577658cf1f77 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf1f7e expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893311.750121:0:19536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787893311.750126:0:19536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9c4152800/0x9232577658cf1f77 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf1f7e expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893311.750132:0:19536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9c4152800/0x9232577658cf1f77 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf1f7e expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893311.750141:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893311.750142:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893311.750143:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893311.750155:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13b37fca-0eda-4b14-a6ef-4a378c945d17:3631:1874741493448704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787893311.750184:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893311.750214:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787893311.750219:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13b37fca-0eda-4b14-a6ef-4a378c945d17:3631:1874741493448576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787893311.750237:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893311.750564:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493448704 00000100:00100000:3.0:1787893311.750569:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493448704 00010000:00010000:3.0:1787893311.750595:0:17168:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9dd69da00/0x9232577658cf1f7e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf1f77 expref: 24 pid: 17175 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893311.750624:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493448576 00000100:00100000:3.0:1787893311.750628:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493448576 00010000:00010000:3.0:1787893311.750640:0:17168:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9c147d400/0x9232577658cf20e3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf20dc expref: 25 pid: 17177 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893311.750651:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787893311.750657:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13b37fca-0eda-4b14-a6ef-4a378c945d17+25:3631:x1874741493448704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787893311.750667:0:17168:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893311.750672:0:17168:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9dd69da00/0x9232577658cf1f7e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf1f77 expref: 25 pid: 17175 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893311.750681:0:17168:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9dd69da00/0x9232577658cf1f7e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf1f77 expref: 25 pid: 17175 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893311.750696:0:17168:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893311.750724:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13b37fca-0eda-4b14-a6ef-4a378c945d17+25:3631:x1874741493448704:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893311.750730:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787893311.750742:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787893311.750749:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:3631:x1874741493448576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787893311.750755:0:17168:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893311.750759:0:17168:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9c147d400/0x9232577658cf20e3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf20dc expref: 24 pid: 17177 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893311.750766:0:17168:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9c147d400/0x9232577658cf20e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf20dc expref: 24 pid: 17177 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893311.750774:0:17168:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893311.750867:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:3631:x1874741493448576:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893311.750874:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787893311.750909:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13b37fca-0eda-4b14-a6ef-4a378c945d17:3631:1874741493448576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787893311.750919:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13b37fca-0eda-4b14-a6ef-4a378c945d17:3631:1874741493448704:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787893311.751058:0:20227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9dd69d000/0x9232577658cf1f31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf1f2a expref: 23 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893311.751070:0:20227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc9dd69d000/0x9232577658cf1f31 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf1f2a expref: 23 pid: 17178 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893311.751080:0:20227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20227:1874741493448832:0@lo:104: 00000100:00100000:0.0:1787893311.751103:0:20227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893311.751113:0:20227:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7686a80 going to sleep for 11 seconds 00010000:00010000:0.0:1787893311.751128:0:20227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c67e0400/0x9232577658cf226b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fabb6 expref: 12 pid: 17177 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893311.751139:0:20227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20227:1874741493447936:192.168.202.35@tcp:104: 00000100:00100000:0.0:1787893311.751149:0:20227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20227:1874741493448064:192.168.202.35@tcp:104: 00010000:00010000:0.0:1787893311.751169:0:20227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9c147d400/0x9232577658cf20e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf20dc expref: 23 pid: 17177 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893311.751179:0:20227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20227:1874741493448192:0@lo:104: 00010000:00010000:0.0:1787893311.751187:0:20227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9dd69da00/0x9232577658cf1f7e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf1f77 expref: 22 pid: 17175 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893311.751197:0:20227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20227:1874741493448320:0@lo:104: 00000100:00100000:1.0:1787893311.751286:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00010000:00010000:1.0:1787893311.751327:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893311.751403:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481830656 00000100:00100000:0.0:1787893311.751408:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481830656 00010000:00010000:0.0:1787893311.751427:0:17168:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc8c67e1c00/0x9232577658cf222c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fab46 expref: 12 pid: 17178 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893311.751442:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 12 00000100:00100000:0.0:1787893311.751449:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf022523-db7f-4c9e-a3ea-97d11e9985e2+12:2390:x1874741481830656:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893311.751468:0:17168:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893311.751474:0:17168:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc8c67e1c00/0x9232577658cf222c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fab46 expref: 12 pid: 17178 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893311.751484:0:17168:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc8c67e1c00/0x9232577658cf222c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fab46 expref: 12 pid: 17178 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893311.751538:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c67e1c00/0x9232577658cf222c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fab46 expref: 12 pid: 17178 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893311.751546:0:17168:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893311.751583:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf022523-db7f-4c9e-a3ea-97d11e9985e2+11:2390:x1874741481830656:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 135us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893311.751589:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 12 00000100:00100000:3.0:1787893311.752322:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493448448 00000100:00100000:3.0:1787893311.752330:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493448448 00000100:00100000:3.0:1787893311.752369:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493448832 00000100:00100000:3.0:1787893311.752373:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493448832 00000100:00100000:3.0:1787893311.752385:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787893311.752392:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13b37fca-0eda-4b14-a6ef-4a378c945d17+4:20227:x1874741493448448:12345-0@lo:104: 00010000:00010000:3.0:1787893311.752403:0:17167:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153e00/0x9232577658cf1f38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf1f3f expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893311.752467:0:17167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787893311.752472:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13b37fca-0eda-4b14-a6ef-4a378c945d17+4:20227:x1874741493448448:12345-0@lo:104: Request processed in 82us (4322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893311.752478:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787893311.752519:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787893311.752528:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13b37fca-0eda-4b14-a6ef-4a378c945d17+3:20227:x1874741493448832:12345-0@lo:104: 00010000:00010000:3.0:1787893311.752535:0:17167:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153a00/0x9232577658cf1f2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf1f31 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893311.752566:0:17167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787893311.752571:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13b37fca-0eda-4b14-a6ef-4a378c945d17+3:20227:x1874741493448832:12345-0@lo:104: Request processed in 47us (1467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893311.752577:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1787893311.752601:0:17172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787893311.752607:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153e00/0x9232577658cf1f38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf1f3f expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893311.752614:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c4153e00 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:3.0:1787893311.752618:0:17172:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153e00/0x9232577658cf1f38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf1f3f expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893311.752626:0:17172:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153e00/0x9232577658cf1f38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf1f3f expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787893311.752632:0:17172:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153e00/0x9232577658cf1f38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf1f3f expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787893311.752638:0:17172:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787893311.752681:0:17172:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153e00/0x9232577658cf1f38 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf1f3f expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893311.752687:0:17172:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787893311.752708:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153e00/0x9232577658cf1f38 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf1f3f expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893311.752714:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153e00/0x9232577658cf1f38 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf1f3f expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893311.752725:0:17172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787893311.752728:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153a00/0x9232577658cf1f2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf1f31 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893311.752733:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c4153a00 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:3.0:1787893311.752736:0:17172:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153a00/0x9232577658cf1f2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf1f31 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893311.752748:0:17172:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153a00/0x9232577658cf1f2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf1f31 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787893311.752754:0:17172:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153a00/0x9232577658cf1f2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf1f31 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787893311.752759:0:17172:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787893311.752773:0:17172:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153a00/0x9232577658cf1f2a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf1f31 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893311.752779:0:17172:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787893311.752785:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153a00/0x9232577658cf1f2a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf1f31 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893311.752791:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153a00/0x9232577658cf1f2a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf1f31 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893311.752819:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893311.752821:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893311.752822:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893311.752834:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13b37fca-0eda-4b14-a6ef-4a378c945d17:3632:1874741493448960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787893311.752865:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893311.752893:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787893311.752898:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13b37fca-0eda-4b14-a6ef-4a378c945d17:3632:1874741493449088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787893311.752919:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787893311.752939:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893311.752947:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493448960 00000100:00100000:3.0:1787893311.752951:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493448960 00010000:00010000:3.0:1787893311.752975:0:17168:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9c4153c00/0x9232577658cf1f3f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf1f38 expref: 22 pid: 17178 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893311.752989:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493449088 00000100:00100000:3.0:1787893311.752992:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493449088 00010000:00010000:3.0:1787893311.753003:0:17168:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9dd69d000/0x9232577658cf1f31 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf1f2a expref: 23 pid: 17178 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893311.753014:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787893311.753021:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c702d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13b37fca-0eda-4b14-a6ef-4a378c945d17+23:3632:x1874741493448960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787893311.753030:0:17168:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893311.753034:0:17168:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9c4153c00/0x9232577658cf1f3f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf1f38 expref: 23 pid: 17178 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893311.753044:0:17168:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9c4153c00/0x9232577658cf1f3f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf1f38 expref: 23 pid: 17178 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893311.753059:0:17168:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893311.753085:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c702d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13b37fca-0eda-4b14-a6ef-4a378c945d17+23:3632:x1874741493448960:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893311.753090:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787893311.753128:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787893311.753136:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13b37fca-0eda-4b14-a6ef-4a378c945d17+22:3632:x1874741493449088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787893311.753142:0:17168:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893311.753146:0:17168:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9dd69d000/0x9232577658cf1f31 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf1f2a expref: 22 pid: 17178 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893311.753153:0:17168:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9dd69d000/0x9232577658cf1f31 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf1f2a expref: 22 pid: 17178 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893311.753174:0:17168:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fc9edb30800/0x9232577658cf229c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893311.753182:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9edb30800/0x9232577658cf229c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893311.753195:0:17168:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc9edb30800/0x9232577658cf229c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893311.753201:0:17168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc9edb30800/0x9232577658cf229c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893311.753207:0:17168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fc9edb30800/0x9232577658cf229c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893311.753214:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fc9edb30800/0x9232577658cf229c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893311.753219:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30800 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:3.0:1787893311.753223:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fc9edb30800/0x9232577658cf229c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893311.753229:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fc9edb30800/0x9232577658cf229c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893311.753236:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fc9edb30800/0x9232577658cf229c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893311.753246:0:17168:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893311.753270:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13b37fca-0eda-4b14-a6ef-4a378c945d17+22:3632:x1874741493449088:12345-0@lo:103:ldlm_bl.0 Request processed in 135us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893311.753284:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787893311.753313:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13b37fca-0eda-4b14-a6ef-4a378c945d17:3632:1874741493449088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787893311.753322:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13b37fca-0eda-4b14-a6ef-4a378c945d17:3632:1874741493448960:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787893311.753868:0:20227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9c4153c00/0x9232577658cf1f3f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf1f38 expref: 21 pid: 17178 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893311.753881:0:20227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20227:1874741493448448:0@lo:104: 00010000:00010000:0.0:1787893311.753892:0:20227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9dd69d000/0x9232577658cf1f31 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf1f2a expref: 20 pid: 17178 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893311.753900:0:20227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20227:1874741493448832:0@lo:104: 00010000:00010000:0.0:1787893311.753931:0:20227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fc9edb30800/0x9232577658cf229c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893311.753940:0:20227:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fc9edb30800/0x9232577658cf229c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893311.753946:0:20227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fc9edb30800/0x9232577658cf229c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893311.753951:0:20227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9edb30800/0x9232577658cf229c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787893311.795218:0:17937:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787893311.994272:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893313.019274:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893313.316360:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893313.316440:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481830784 00000100:00100000:0.0:1787893313.316458:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481830784 00000100:00100000:0.0:1787893313.316535:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 147 00000100:00100000:0.0:1787893313.316547:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf022523-db7f-4c9e-a3ea-97d11e9985e2+11:14930:x1874741481830784:12345-192.168.202.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787893313.316564:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893313.316585:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9edb31a00/0x9232577658cf22a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fabee expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893313.316629:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9edb31a00/0x9232577658cf22a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fabee expref: 12 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893313.316640:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9edb31a00/0x9232577658cf22a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fabee expref: 12 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893313.316649:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb31a00, rc 0) 00000100:00100000:0.0:1787893313.316703:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf022523-db7f-4c9e-a3ea-97d11e9985e2+12:14930:x1874741481830784:12345-192.168.202.35@tcp:101:ll_cfg_requeue.0 Request processed in 159us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893313.316711:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 147 00000100:00100000:0.0:1787893313.327473:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893313.327528:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481830912 00000100:00100000:0.0:1787893313.327538:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481830912 00000100:00100000:0.0:1787893313.327584:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 148 00000100:00100000:0.0:1787893313.327594:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf022523-db7f-4c9e-a3ea-97d11e9985e2+12:14930:x1874741481830912:12345-192.168.202.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787893313.327737:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf022523-db7f-4c9e-a3ea-97d11e9985e2+12:14930:x1874741481830912:12345-192.168.202.35@tcp:501:ll_cfg_requeue.0 Request processed in 144us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893313.327745:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 148 00000100:00100000:0.0:1787893313.335934:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893313.335972:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481831040 00000100:00100000:0.0:1787893313.335981:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481831040 00000100:00100000:0.0:1787893313.336035:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 149 00000100:00100000:0.0:1787893313.336045:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf022523-db7f-4c9e-a3ea-97d11e9985e2+12:14930:x1874741481831040:12345-192.168.202.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787893313.336187:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf022523-db7f-4c9e-a3ea-97d11e9985e2+12:14930:x1874741481831040:12345-192.168.202.35@tcp:503:ll_cfg_requeue.0 Request processed in 142us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893313.336203:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 149 00000100:00100000:2.0:1787893313.354362:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893313.354592:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481831168 00000100:00100000:3.0:1787893313.354602:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481831168 00000100:00100000:3.0:1787893313.354664:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 150 00000100:00100000:3.0:1787893313.354675:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf022523-db7f-4c9e-a3ea-97d11e9985e2+12:14930:x1874741481831168:12345-192.168.202.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787893313.354693:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893313.354709:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c7c7ee00/0x9232577658cf22aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fabf5 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893313.354737:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c7c7ee00/0x9232577658cf22aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fabf5 expref: 13 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893313.354748:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c7c7ee00/0x9232577658cf22aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fabf5 expref: 13 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893313.354758:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7ee00, rc 0) 00000100:00100000:3.0:1787893313.354816:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf022523-db7f-4c9e-a3ea-97d11e9985e2+13:14930:x1874741481831168:12345-192.168.202.35@tcp:101:ll_cfg_requeue.0 Request processed in 143us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893313.354824:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 150 00000100:00100000:2.0:1787893313.357593:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893313.357758:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481831296 00000100:00100000:3.0:1787893313.357768:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481831296 00000100:00100000:3.0:1787893313.357843:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 151 00000100:00100000:3.0:1787893313.357856:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c5fed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf022523-db7f-4c9e-a3ea-97d11e9985e2+13:14930:x1874741481831296:12345-192.168.202.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787893313.358006:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c5fed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf022523-db7f-4c9e-a3ea-97d11e9985e2+13:14930:x1874741481831296:12345-192.168.202.35@tcp:501:ll_cfg_requeue.0 Request processed in 154us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893313.358015:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 151 00000100:00100000:0.0:1787893313.367026:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893313.367098:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481831424 00000100:00100000:2.0:1787893313.367108:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481831424 00000100:00100000:2.0:1787893313.367167:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 152 00000100:00100000:2.0:1787893313.367179:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf022523-db7f-4c9e-a3ea-97d11e9985e2+13:14930:x1874741481831424:12345-192.168.202.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787893313.367338:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf022523-db7f-4c9e-a3ea-97d11e9985e2+13:14930:x1874741481831424:12345-192.168.202.35@tcp:503:ll_cfg_requeue.0 Request processed in 151us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893313.367347:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 152 10000000:01000000:0.0:1787893313.462715:0:17180:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787893313.462722:0:17180:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc8c64bb800 from 13 10000000:01000000:0.0:1787893313.462729:0:17180:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787893313.462789:0:17180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30200/0x9232577658cf22b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893313.462800:0:17180:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30200/0x9232577658cf22b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893313.462812:0:17180:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30200/0x9232577658cf22b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893313.462838:0:17180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493449216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787893313.462908:0:17180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893313.462950:0:17180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7699c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787893313.462972:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493449216 00000100:00100000:0.0:1787893313.462979:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493449216 00000100:00100000:0.0:1787893313.463025:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787893313.463034:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+20:17180:x1874741493449216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787893313.463049:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893313.463060:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9edb30e00/0x9232577658cf22b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf22b1 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893313.463084:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9edb30e00/0x9232577658cf22b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf22b1 expref: 21 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893313.463095:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9edb30e00/0x9232577658cf22b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf22b1 expref: 21 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893313.463116:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb30e00, rc 0) 00000100:00100000:0.0:1787893313.463153:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+21:17180:x1874741493449216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893313.463160:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787893313.463220:0:17180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493449216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787893313.463235:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30200/0x9232577658cf22b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf22b8 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893313.463244:0:17180:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30200/0x9232577658cf22b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf22b8 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893313.463302:0:17180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493449344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787893313.463335:0:17180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893313.463350:0:17180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d8c5d180 going to sleep for 11 seconds 00000100:00100000:0.0:1787893313.463362:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493449344 00000100:00100000:0.0:1787893313.463366:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493449344 00000100:00100000:0.0:1787893313.463387:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787893313.463393:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+21:17180:x1874741493449344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787893313.463635:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+21:17180:x1874741493449344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 241us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893313.463642:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787893313.463669:0:17180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493449344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787893313.463693:0:17180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493449472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787893313.463727:0:17180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893313.463747:0:17180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d8c5d180 going to sleep for 11 seconds 00000100:00100000:0.0:1787893313.463759:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493449472 00000100:00100000:0.0:1787893313.463763:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493449472 00000100:00100000:0.0:1787893313.463841:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787893313.463850:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+21:17180:x1874741493449472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787893313.463917:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+21:17180:x1874741493449472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893313.463924:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787893313.463960:0:17180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493449472:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787893313.466289:0:20295:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787893313.468263:0:17180:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787893313.468298:0:17180:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787893313.468311:0:17180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30200/0x9232577658cf22b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf22b8 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893313.468323:0:17180:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30200/0x9232577658cf22b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf22b8 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893313.468344:0:17180:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787893313.468347:0:17180:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc8c8410800 from 13 10000000:01000000:2.0:1787893313.468350:0:17180:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787893313.468393:0:17180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e0200/0x9232577658cf22bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893313.468402:0:17180:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e0200/0x9232577658cf22bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893313.468434:0:17180:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e0200/0x9232577658cf22bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893313.468469:0:17180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7e07b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493449600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787893313.468568:0:17180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893313.468606:0:17180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e5f7e240 going to sleep for 11 seconds 00000100:00100000:0.0:1787893313.468968:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493449600 00000100:00100000:0.0:1787893313.468976:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493449600 00000100:00100000:0.0:1787893313.469027:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787893313.469037:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+21:17180:x1874741493449600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787893313.469050:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893313.469061:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9edb31400/0x9232577658cf22c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf22bf expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893313.469083:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9edb31400/0x9232577658cf22c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf22bf expref: 22 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893313.469093:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9edb31400/0x9232577658cf22c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf22bf expref: 22 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893313.469101:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb31400, rc 0) 00000100:00100000:0.0:1787893313.469147:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+22:17180:x1874741493449600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893313.469153:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787893313.469270:0:17180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7e07b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493449600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787893313.469286:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e0200/0x9232577658cf22bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf22c6 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893313.469294:0:17180:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e0200/0x9232577658cf22bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf22c6 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893313.469380:0:17180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7d48000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493449728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787893313.469416:0:17180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893313.477420:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493449728 00000100:00100000:0.0:1787893313.477433:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493449728 00000100:00100000:0.0:1787893313.477709:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787893313.477721:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+22:17180:x1874741493449728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787893313.478438:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+22:17180:x1874741493449728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 717us (9018us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893313.478453:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787893313.478548:0:17180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57000 going to sleep for 11 seconds 00000100:00100000:1.0:1787893313.478574:0:17180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7d48000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493449728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787893313.478623:0:17180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7d48000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493449856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787893313.478674:0:17180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893313.479170:0:17180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57000 going to sleep for 11 seconds 00000100:00100000:2.0:1787893313.482981:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493449856 00000100:00100000:2.0:1787893313.482996:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493449856 00000100:00100000:2.0:1787893313.483064:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787893313.483084:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+22:17180:x1874741493449856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787893313.483245:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+22:17180:x1874741493449856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 172us (4570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893313.483254:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787893313.483324:0:17180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7d48000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493449856:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787893313.490911:0:20296:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787893313.491128:0:17180:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787893313.491162:0:17180:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787893313.491173:0:17180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e0200/0x9232577658cf22bf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf22c6 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893313.491183:0:17180:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e0200/0x9232577658cf22bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf22c6 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787893313.491194:0:17180:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787893313.491197:0:17180:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc9ffb45000 from 13 10000000:01000000:0.0:1787893313.491200:0:17180:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787893313.491234:0:17180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf22cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893313.491241:0:17180:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf22cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893313.491251:0:17180:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf22cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893313.491273:0:17180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493449984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787893313.491345:0:17180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893313.491398:0:17180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d8c5d540 going to sleep for 11 seconds 00000100:00100000:2.0:1787893313.492215:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493449984 00000100:00100000:2.0:1787893313.492225:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493449984 00000100:00100000:2.0:1787893313.492275:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787893313.492284:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+22:17180:x1874741493449984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787893313.492298:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893313.492311:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c67e1200/0x9232577658cf22d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf22cd expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893313.492342:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c67e1200/0x9232577658cf22d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf22cd expref: 23 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893313.492365:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c67e1200/0x9232577658cf22d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf22cd expref: 23 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893313.492373:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c67e1200, rc 0) 00000100:00100000:2.0:1787893313.492427:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+23:17180:x1874741493449984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893313.492433:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787893313.492648:0:17180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493449984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787893313.492663:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf22cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf22d4 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893313.492672:0:17180:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf22cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf22d4 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893313.492730:0:17180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7e06300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493450112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787893313.492757:0:17180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893313.492879:0:17180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e5f7e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787893313.493233:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493450112 00000100:00100000:3.0:1787893313.493239:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493450112 00000100:00100000:3.0:1787893313.500899:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787893313.500933:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+23:17180:x1874741493450112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787893313.501133:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+23:17180:x1874741493450112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 221us (8374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893313.501142:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787893313.511904:0:17180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7e06300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493450112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787893313.511971:0:17180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493450240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787893313.512045:0:17180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893313.512132:0:17180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c108e480 going to sleep for 11 seconds 00000100:00100000:0.0:1787893313.516646:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493450240 00000100:00100000:0.0:1787893313.516661:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493450240 00000100:00100000:0.0:1787893313.516727:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787893313.516737:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+23:17180:x1874741493450240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787893313.517086:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+23:17180:x1874741493450240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 350us (5040us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893313.517095:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787893313.518468:0:17180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493450240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787893313.520232:0:20297:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787893313.532912:0:17180:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787893313.532955:0:17180:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787893313.532968:0:17180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf22cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf22d4 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893313.532980:0:17180:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf22cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf22d4 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893313.532993:0:17180:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787893313.532995:0:17180:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc9d0f72800 from 13 10000000:01000000:2.0:1787893313.533015:0:17180:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787893313.533055:0:17180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1600/0x9232577658cf22db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893313.533062:0:17180:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1600/0x9232577658cf22db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893313.533072:0:17180:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1600/0x9232577658cf22db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893313.533096:0:17180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7e06680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493450368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787893313.533164:0:17180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893313.533200:0:17180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e5f7e240 going to sleep for 11 seconds 00000100:00100000:1.0:1787893313.533334:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493450368 00000100:00100000:1.0:1787893313.533341:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493450368 00000100:00100000:1.0:1787893313.533389:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787893313.533398:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+23:17180:x1874741493450368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787893313.533410:0:17177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893313.533422:0:17177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9fe540600/0x9232577658cf22e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf22db expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893313.533453:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9fe540600/0x9232577658cf22e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf22db expref: 24 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893313.533464:0:17177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9fe540600/0x9232577658cf22e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf22db expref: 24 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893313.533473:0:17177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe540600, rc 0) 00000100:00100000:1.0:1787893313.533545:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:17180:x1874741493450368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893313.533552:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787893313.533672:0:17180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7e06680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493450368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787893313.533685:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1600/0x9232577658cf22db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf22e2 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893313.533695:0:17180:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1600/0x9232577658cf22db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf22e2 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893313.533749:0:17180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493450496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787893313.533774:0:17180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893313.533806:0:17180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d8c5df00 going to sleep for 11 seconds 00000100:00100000:1.0:1787893313.534768:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493450496 00000100:00100000:1.0:1787893313.534775:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493450496 00000100:00100000:1.0:1787893313.534831:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787893313.534840:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:17180:x1874741493450496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787893313.534968:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:17180:x1874741493450496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893313.534975:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787893313.535116:0:17180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493450496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787893313.535148:0:17180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493450624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787893313.535187:0:17180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893313.535217:0:17180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d8c5df00 going to sleep for 11 seconds 00000100:00100000:0.0:1787893313.535232:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493450624 00000100:00100000:0.0:1787893313.535236:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493450624 00000100:00100000:0.0:1787893313.535254:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787893313.535260:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:17180:x1874741493450624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787893313.535348:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:17180:x1874741493450624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893313.535355:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787893313.535393:0:17180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13b37fca-0eda-4b14-a6ef-4a378c945d17:17180:1874741493450624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787893313.536251:0:20298:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787893313.536308:0:17180:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787893313.536323:0:17180:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787893313.536342:0:17180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1600/0x9232577658cf22db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf22e2 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893313.536352:0:17180:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1600/0x9232577658cf22db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf22e2 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893314.043758:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893314.606609:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893314.606657:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893314.606697:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893314.606737:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893314.606755:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893314.606786:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893314.606819:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893314.606839:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893314.606862:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893314.606888:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481832064 00000100:00100000:1.0:1787893314.606897:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481832064 00000100:00100000:1.0:1787893314.606946:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481832576 00000100:00100000:1.0:1787893314.606949:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481832576 00000100:00100000:1.0:1787893314.606963:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481831936 00000100:00100000:1.0:1787893314.606965:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481831936 00000100:00100000:1.0:1787893314.606974:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481832448 00000100:00100000:1.0:1787893314.606977:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481832448 00000100:00100000:1.0:1787893314.606990:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 13 00000100:00100000:1.0:1787893314.606999:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af98d6ca-b952-492d-ad71-083813d6f146+5:2393:x1874741481832064:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893314.607061:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af98d6ca-b952-492d-ad71-083813d6f146+5:2393:x1874741481832064:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 63us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893314.607068:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 13 00000100:00100000:1.0:1787893314.607084:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 14 00000100:00100000:1.0:1787893314.607091:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3f229414-7dd1-4cf5-a739-e3375b9be1a7+5:2393:x1874741481832576:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893314.607130:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3f229414-7dd1-4cf5-a739-e3375b9be1a7+5:2393:x1874741481832576:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 39us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893314.607136:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 14 00000100:00100000:1.0:1787893314.607148:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 15 00000100:00100000:1.0:1787893314.607153:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af98d6ca-b952-492d-ad71-083813d6f146+5:2393:x1874741481831936:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893314.607175:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af98d6ca-b952-492d-ad71-083813d6f146+5:2393:x1874741481831936:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 22us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893314.607182:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 15 00000100:00100000:1.0:1787893314.607192:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 16 00000100:00100000:1.0:1787893314.607198:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3f229414-7dd1-4cf5-a739-e3375b9be1a7+5:2393:x1874741481832448:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893314.607219:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3f229414-7dd1-4cf5-a739-e3375b9be1a7+5:2393:x1874741481832448:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 22us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893314.607224:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 16 00000100:00100000:1.0:1787893314.607240:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481831808 00000100:00100000:1.0:1787893314.607243:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481831808 00000100:00100000:1.0:1787893314.607263:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481832320 00000100:00100000:1.0:1787893314.607266:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481832320 00000100:00100000:1.0:1787893314.607275:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481831680 00000100:00100000:1.0:1787893314.607292:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481831680 00000100:00100000:1.0:1787893314.607305:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481832192 00000100:00100000:1.0:1787893314.607307:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481832192 00000100:00100000:1.0:1787893314.607329:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 52 00000100:00100000:1.0:1787893314.607337:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af98d6ca-b952-492d-ad71-083813d6f146+5:2393:x1874741481831808:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893314.607364:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af98d6ca-b952-492d-ad71-083813d6f146+5:2393:x1874741481831808:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 28us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893314.607380:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 52 00000100:00100000:1.0:1787893314.607393:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 53 00000100:00100000:1.0:1787893314.607399:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3f229414-7dd1-4cf5-a739-e3375b9be1a7+5:2393:x1874741481832320:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893314.607421:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3f229414-7dd1-4cf5-a739-e3375b9be1a7+5:2393:x1874741481832320:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 22us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893314.607427:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 53 00000100:00100000:1.0:1787893314.607437:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 54 00000100:00100000:1.0:1787893314.607443:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af98d6ca-b952-492d-ad71-083813d6f146+6:2393:x1874741481831680:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893314.607466:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af98d6ca-b952-492d-ad71-083813d6f146+6:2393:x1874741481831680:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 23us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893314.607472:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 54 00000100:00100000:1.0:1787893314.607482:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 55 00000100:00100000:1.0:1787893314.607529:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3f229414-7dd1-4cf5-a739-e3375b9be1a7+6:2393:x1874741481832192:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893314.607556:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3f229414-7dd1-4cf5-a739-e3375b9be1a7+6:2393:x1874741481832192:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 68us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893314.607563:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 55 00000100:00080000:1.0:1787893314.607589:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787893314.607593:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787893314.607596:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787893314.607598:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787893314.608331:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481831552 00000100:00100000:0.0:1787893314.608338:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481831552 00000100:00100000:0.0:1787893314.608383:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 165 00000100:00100000:0.0:1787893314.608392:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf022523-db7f-4c9e-a3ea-97d11e9985e2+13:2393:x1874741481831552:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893314.608421:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf022523-db7f-4c9e-a3ea-97d11e9985e2+13:2393:x1874741481831552:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 31us (1822us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893314.608427:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 165 00010000:00010000:0.0:1787893315.057755:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893315.761740:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787893315.761761:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493450752:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787893315.761831:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893315.762284:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493451264:0@lo:400:kworker.0 00000100:00100000:2.0:1787893315.762325:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893315.762361:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493451776:0@lo:400:kworker.0 00000100:00100000:2.0:1787893315.762385:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893315.762399:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493452288:0@lo:400:kworker.0 00000100:00100000:2.0:1787893315.762421:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893315.762436:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1787893315.762440:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493450880:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787893315.762457:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893315.762472:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493451392:0@lo:400:kworker.0 00000100:00100000:2.0:1787893315.762506:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893315.762519:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493451904:0@lo:400:kworker.0 00000100:00100000:2.0:1787893315.762537:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893315.762548:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1874741493452416:0@lo:400:kworker.0 00000100:00100000:2.0:1787893315.762579:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893315.762605:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493450880 00000100:00100000:2.0:1787893315.762612:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493450880 00000100:00100000:2.0:1787893315.762656:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787893315.762677:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493450880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787893315.762701:0:18706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787893315.762746:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493450880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893315.762752:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787893315.762789:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493450880:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787893315.763644:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493450752 00000100:00100000:0.0:1787893315.763652:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493450752 00000100:00100000:0.0:1787893315.763719:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493451264 00000100:00100000:0.0:1787893315.763723:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493451264 00000100:00100000:0.0:1787893315.763739:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787893315.763755:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493450752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787893315.763782:0:17188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787893315.763824:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493450752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (1993us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893315.763830:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787893315.763844:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787893315.763852:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493451264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893315.763889:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493451264:12345-0@lo:400:kworker.0 Request processed in 39us (1564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893315.763895:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787893315.763930:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493451264:0@lo:400:kworker.0 00000100:00100000:1.0:1787893315.764374:0:19239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493451776 00000100:00100000:1.0:1787893315.764378:0:19239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493451776 00000100:00100000:1.0:1787893315.764405:0:19239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493451392 00000100:00100000:1.0:1787893315.764408:0:19239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493451392 00000100:00100000:1.0:1787893315.764422:0:19239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493451904 00000100:00100000:1.0:1787893315.764430:0:19239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493451904 00000100:00100000:1.0:1787893315.764448:0:19239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787893315.764455:0:19239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493451776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893315.764536:0:19239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493451776:12345-0@lo:400:kworker.0 Request processed in 82us (2150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893315.764543:0:19239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787893315.764556:0:19239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787893315.764562:0:19239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493451392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893315.764588:0:19239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493451392:12345-0@lo:400:kworker.0 Request processed in 27us (2099us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893315.764593:0:19239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787893315.764603:0:19239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787893315.764608:0:19239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493451904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893315.764634:0:19239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493451904:12345-0@lo:400:kworker.0 Request processed in 26us (2096us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893315.764640:0:19239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787893315.764670:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493452288 00000100:00100000:1.0:1787893315.764673:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493452288 00000100:00100000:1.0:1787893315.764697:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493452416 00000100:00100000:1.0:1787893315.764699:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493452416 00000100:00100000:1.0:1787893315.764731:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787893315.764738:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493452288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893315.764766:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493452288:12345-0@lo:400:kworker.0 Request processed in 29us (2343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893315.764772:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787893315.764782:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787893315.764788:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874741493452416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893315.764821:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874741493452416:12345-0@lo:400:kworker.0 Request processed in 33us (2241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893315.764827:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1787893315.764850:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787893315.764854:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787893315.764857:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787893315.764858:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787893315.765235:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493452800:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787893315.765468:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893315.765533:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493451392:0@lo:400:kworker.0 00000100:00100000:0.0:1787893315.765545:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493451904:0@lo:400:kworker.0 00000100:00100000:0.0:1787893315.765555:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1874741493452416:0@lo:400:kworker.0 00000100:00100000:0.0:1787893315.765566:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493451776:0@lo:400:kworker.0 00010000:00080000:0.0:1787893315.765577:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7525f80 x1874741493452288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893315.765587:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493452288:0@lo:400:kworker.0 00000100:00100000:3.0:1787893315.765797:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493451008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787893315.765839:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893315.765864:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493451520:0@lo:400:kworker.0 00000100:00100000:3.0:1787893315.765884:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893315.765898:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493452032:0@lo:400:kworker.0 00000100:00100000:3.0:1787893315.765931:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893315.765946:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493452544:0@lo:400:kworker.0 00000100:00100000:3.0:1787893315.765965:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893315.765981:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1787893315.765987:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13b37fca-0eda-4b14-a6ef-4a378c945d17:3632:1874741493451136:0@lo:400:kworker.0 00000100:00100000:3.0:1787893315.766010:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893315.766035:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493451648:0@lo:400:kworker.0 00000100:00100000:3.0:1787893315.766056:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893315.766070:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7525c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493452160:0@lo:400:kworker.0 00000100:00100000:3.0:1787893315.766088:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893315.766100:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7e07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493452672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787893315.766116:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893315.766147:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493452032 00000100:00100000:3.0:1787893315.766152:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493452032 00000100:00100000:3.0:1787893315.766192:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493452544 00000100:00100000:3.0:1787893315.766194:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493452544 00000100:00100000:3.0:1787893315.766216:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493451648 00000100:00100000:3.0:1787893315.766218:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493451648 00000100:00100000:3.0:1787893315.766228:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493452160 00000100:00100000:3.0:1787893315.766231:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493452160 00000100:00100000:3.0:1787893315.766246:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787893315.766253:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493452032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893315.767555:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787893315.767572:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493452928:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787893315.767629:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893315.767681:0:19991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493451008 00000100:00100000:0.0:1787893315.767686:0:19991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493451008 00000100:00100000:0.0:1787893315.767730:0:19991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493452672 00000100:00100000:0.0:1787893315.767734:0:19991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493452672 00000100:00100000:0.0:1787893315.767746:0:19991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493452928 00000100:00100000:0.0:1787893315.767748:0:19991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493452928 00000100:00100000:0.0:1787893315.767759:0:19991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787893315.767767:0:19991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493451008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787893315.767792:0:19991:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787893315.767834:0:19991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493451008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (1995us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893315.767841:0:19991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787893315.767856:0:19991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787893315.767862:0:19991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493452672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787893315.767870:0:19991:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787893315.767894:0:19991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493452672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 33us (1777us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893315.767899:0:19991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787893315.767910:0:19991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787893315.767916:0:19991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493452928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787893315.767923:0:19991:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787893315.767947:0:19991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493452928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 32us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893315.767953:0:19991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787893315.767988:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493452928:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787893315.768039:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493451520 00000100:00100000:0.0:1787893315.768043:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493451520 00000100:00100000:0.0:1787893315.768066:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787893315.768072:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493451520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893315.768103:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493451520:12345-0@lo:400:kworker.0 Request processed in 31us (2218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893315.768109:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787893315.768140:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493450752:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787893315.768187:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7e07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493452672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787893315.768200:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493451008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787893315.768209:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493451520:0@lo:400:kworker.0 00000100:00100000:1.0:1787893315.768329:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493451136 00000100:00100000:1.0:1787893315.768335:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493451136 00000100:00100000:1.0:1787893315.768368:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787893315.768375:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:3632:x1874741493451136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893315.768414:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:3632:x1874741493451136:12345-0@lo:400:kworker.0 Request processed in 39us (2402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893315.768420:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787893315.768466:0:19990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787893315.768475:0:19990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493452544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893315.768533:0:19990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493452544:12345-0@lo:400:kworker.0 Request processed in 61us (2568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893315.768539:0:19990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787893315.768554:0:19990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787893315.768559:0:19990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493451648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893315.768585:0:19990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493451648:12345-0@lo:400:kworker.0 Request processed in 27us (2530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893315.768591:0:19990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787893315.768601:0:19990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787893315.768606:0:19990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493452160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893315.768643:0:19990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493452160:12345-0@lo:400:kworker.0 Request processed in 36us (2554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893315.768649:0:19990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1787893315.768666:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787893315.768670:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787893315.768673:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787893315.768696:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13b37fca-0eda-4b14-a6ef-4a378c945d17:3632:1874741493451136:0@lo:400:kworker.0 00000100:00100000:1.0:1787893315.768706:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493451648:0@lo:400:kworker.0 00000100:00100000:1.0:1787893315.768716:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7525c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493452160:0@lo:400:kworker.0 00010000:00080000:1.0:1787893315.768726:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7525500 x1874741493452544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893315.768737:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493452544:0@lo:400:kworker.0 00000100:00100000:3.0:1787893315.768841:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493452032:12345-0@lo:400:kworker.0 Request processed in 2588us (2908us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893315.768848:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787893315.769770:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493452800 00000100:00100000:2.0:1787893315.769778:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493452800 00000100:00100000:2.0:1787893315.769830:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787893315.769838:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493452800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787893315.769864:0:17188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787893315.769910:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493452800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (4443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893315.769915:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787893315.769951:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493452800:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787893315.770218:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493452032:0@lo:400:kworker.0 00010000:00010000:0.0:1787893316.081731:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893316.505807:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893316.505910:0:19990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481832704 00000100:00100000:1.0:1787893316.505920:0:19990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481832704 00000100:00100000:1.0:1787893316.506003:0:19990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 23 00000100:00100000:1.0:1787893316.506014:0:19990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af98d6ca-b952-492d-ad71-083813d6f146+6:15597:x1874741481832704:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787893316.506037:0:19990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893316.506061:0:19990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf22e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fabfc expref: -99 pid: 19990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.506122:0:19990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf22f0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.506135:0:19990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf22f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.506162:0:19990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf22f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.506178:0:19990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf22f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.506185:0:19990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf22f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.506192:0:19990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf22f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.506281:0:19990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf22fe lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.506289:0:19990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf22fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.506296:0:19990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf22fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893316.506353:0:19990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787893316.506356:0:19990:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787893316.506390:0:19990:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf22fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.506400:0:19990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf22f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.506407:0:19990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf22f0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.506422:0:19990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf22f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.506427:0:19990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893316.506431:0:19990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf22f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.506439:0:19990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf22f0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19990 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787893316.506691:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787893316.506755:0:19990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9e6fad400) 00010000:00010000:1.0:1787893316.506758:0:19990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893316.506763:0:19990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf22f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.506770:0:19990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf22f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.506783:0:19990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf22f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.506789:0:19990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf22f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.506794:0:19990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf22f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.506800:0:19990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893316.506803:0:19990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf22f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.506819:0:19990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf22f7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.506827:0:19990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9fc9c690b800) 00010000:00010000:1.0:1787893316.506829:0:19990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893316.506831:0:19990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf22f7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.506836:0:19990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf22f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.506869:0:19990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf22e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fabfc expref: 8 pid: 19990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.506882:0:19990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf22fe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fabfc expref: 7 pid: 19990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.506889:0:19990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fc9c690b300) 00010000:00010000:1.0:1787893316.506891:0:19990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787893316.506893:0:19990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe540c00, rc 0) 00000100:00100000:1.0:1787893316.507054:0:19990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af98d6ca-b952-492d-ad71-083813d6f146+7:15597:x1874741481832704:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 1041us (1256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893316.507062:0:19990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 23 00000100:00100000:3.0:1787893316.530871:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893316.531092:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481832832 00000100:00100000:2.0:1787893316.531106:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481832832 00000100:00100000:2.0:1787893316.531365:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 5 00000100:00100000:2.0:1787893316.531378:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:af98d6ca-b952-492d-ad71-083813d6f146+7:15597:x1874741481832832:12345-192.168.202.35@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787893316.531551:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:af98d6ca-b952-492d-ad71-083813d6f146+7:15597:x1874741481832832:12345-192.168.202.35@tcp:900:lhsmtool_posix.0 Request processed in 175us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893316.531579:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 5 00000100:00100000:2.0:1787893316.550820:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893316.550990:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481833088 00000100:00100000:1.0:1787893316.551006:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481833088 00000100:00100000:1.0:1787893316.551105:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 24 00000100:00100000:1.0:1787893316.551117:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af98d6ca-b952-492d-ad71-083813d6f146+7:15597:x1874741481833088:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787893316.551167:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893316.551343:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf2305 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fac03 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.551557:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf230c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.551576:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf230c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.551588:0:17184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf230c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.551606:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf2313 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.551614:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf2313 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.551622:0:17184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf2313 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.552174:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf231a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.552185:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf231a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.552312:0:17184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf231a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893316.552327:0:17184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1787893316.552645:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf230c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.552654:0:17184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf230c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.552661:0:17184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf230c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.552668:0:17184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893316.552673:0:17184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf230c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.552682:0:17184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf230c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.552697:0:17184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fc9c690b300) 00010000:00010000:1.0:1787893316.552700:0:17184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893316.552706:0:17184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf230c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.552712:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf230c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.552728:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf2313 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.552734:0:17184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf2313 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.552739:0:17184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf2313 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.552753:0:17184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893316.554522:0:17184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf2313 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.554538:0:17184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf2313 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.554559:0:17184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9fc9c690b800) 00010000:00010000:1.0:1787893316.554563:0:17184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893316.554568:0:17184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf2313 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.554577:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf2313 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.560099:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf2305 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac03 expref: 10 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.560129:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf231a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac03 expref: 9 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.560138:0:17184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fc9c690b400) 00010000:00010000:1.0:1787893316.560141:0:17184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893316.560144:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe541600, rc 0) 00000100:00100000:1.0:1787893316.560237:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af98d6ca-b952-492d-ad71-083813d6f146+9:15597:x1874741481833088:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 9121us (9431us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787893316.560247:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 24 00000100:00100000:3.0:1787893316.565923:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893316.566050:0:20187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481833216 00000100:00100000:2.0:1787893316.566065:0:20187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481833216 00000100:00100000:2.0:1787893316.570892:0:20187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 25 00000100:00100000:2.0:1787893316.570917:0:20187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:af98d6ca-b952-492d-ad71-083813d6f146+9:15597:x1874741481833216:12345-192.168.202.35@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787893316.571034:0:20187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:af98d6ca-b952-492d-ad71-083813d6f146+9:15597:x1874741481833216:12345-192.168.202.35@tcp:59:lhsmtool_posix.0 Request processed in 129us (5131us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893316.571042:0:20187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 25 00000100:00100000:0.0:1787893316.575258:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893316.575406:0:19990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481833344 00000100:00100000:1.0:1787893316.576977:0:19990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481833344 00000100:00100000:1.0:1787893316.577059:0:19990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 26 00000100:00100000:1.0:1787893316.577071:0:19990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af98d6ca-b952-492d-ad71-083813d6f146+5:15597:x1874741481833344:12345-192.168.202.35@tcp:59:lhsmtool_posix.0 00000100:00080000:2.0:1787893316.577265:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1787893316.578946:0:19990:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1834us 00000040:00080000:2.0:1787893316.595082:0:17220:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787893316.606209:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893316.606543:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481833472 00000100:00100000:0.0:1787893316.606562:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481833472 00000100:00100000:0.0:1787893316.606645:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 27 00000100:00100000:0.0:1787893316.606657:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af98d6ca-b952-492d-ad71-083813d6f146+9:15603:x1874741481833472:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787893316.606684:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893316.606715:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31800/0x9232577658cf2328 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fac0a expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.606798:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf232f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.606814:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf232f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.606846:0:17184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf232f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.606863:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf2336 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.606871:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf2336 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.606878:0:17184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf2336 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.606932:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf232f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.606939:0:17184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf232f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.606947:0:17184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf232f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.606953:0:17184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893316.606959:0:17184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf232f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.606967:0:17184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf232f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.606981:0:17184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9e6fad400) 00010000:00010000:0.0:1787893316.606985:0:17184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893316.606991:0:17184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf232f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.607002:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf232f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.607016:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf2336 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.607023:0:17184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf2336 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.607029:0:17184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf2336 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.607034:0:17184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893316.607038:0:17184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf2336 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.607045:0:17184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf2336 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.607052:0:17184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fc8c7515000) 00010000:00010000:0.0:1787893316.607055:0:17184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893316.607058:0:17184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf2336 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.607063:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf2336 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.607103:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31800/0x9232577658cf2328 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac0a expref: 10 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.607126:0:17184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9e6fad400) 00010000:00010000:0.0:1787893316.607128:0:17184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893316.607132:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31800/0x9232577658cf2328 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac0a expref: 10 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.607142:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb31800, rc 0) 00000100:00100000:0.0:1787893316.607229:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af98d6ca-b952-492d-ad71-083813d6f146+9:15603:x1874741481833472:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 574us (1030us total) trans 0 rc 301/301 00000100:00100000:0.0:1787893316.607238:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 27 00000100:00100000:2.0:1787893316.626075:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893316.635727:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481833600 00000100:00100000:0.0:1787893316.635751:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481833600 00000100:00100000:0.0:1787893316.635859:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 0 00000100:00100000:0.0:1787893316.635871:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:af98d6ca-b952-492d-ad71-083813d6f146+9:15603:x1874741481833600:12345-192.168.202.35@tcp:700:lfs.0 00000100:00100000:0.0:1787893316.635990:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:af98d6ca-b952-492d-ad71-083813d6f146+9:15603:x1874741481833600:12345-192.168.202.35@tcp:700:lfs.0 Request processed in 121us (9933us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893316.635998:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 0 00000100:00100000:3.0:1787893316.641891:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893316.642185:0:20187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481833856 00000100:00100000:1.0:1787893316.642200:0:20187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481833856 00000100:00100000:1.0:1787893316.642289:0:20187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 28 00000100:00100000:1.0:1787893316.642310:0:20187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:af98d6ca-b952-492d-ad71-083813d6f146+9:15603:x1874741481833856:12345-192.168.202.35@tcp:36:lfs.0 00010000:00010000:1.0:1787893316.642386:0:20187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893316.642432:0:20187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f200/0x9232577658cf2256 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fab77 expref: 9 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.642455:0:20187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9e6fad400) 00010000:00010000:1.0:1787893316.642461:0:20187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787893316.642559:0:20187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf233d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.642574:0:20187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0e00/0x9232577658cf2295 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fabe7 expref: 5 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.642583:0:20187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf233d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.642620:0:20187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0e00/0x9232577658cf2295 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fabe7 expref: 5 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.642633:0:20187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0e00/0x9232577658cf2295 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fabe7 expref: 5 pid: 17184 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893316.642673:0:20187:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbde300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20187:1874741493453056:192.168.202.35@tcp:104: 00000100:00100000:1.0:1787893316.642792:0:20187:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7686300 going to sleep for 11 seconds 00000100:00100000:2.0:1787893316.654184:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893316.654372:0:20187:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbde300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20187:1874741493453056:192.168.202.35@tcp:104: 00000100:00100000:0.0:1787893316.654411:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481833984 00010000:00010000:1.0:1787893316.654412:0:20187:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf233d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893316.654433:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481833984 00010000:00010000:0.0:1787893316.654533:0:17168:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0e00/0x9232577658cf2295 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fabe7 expref: 6 pid: 17184 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893316.654582:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 15 00000100:00100000:0.0:1787893316.654596:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f229414-7dd1-4cf5-a739-e3375b9be1a7+6:2391:x1874741481833984:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893316.654613:0:17168:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893316.654621:0:17168:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0e00/0x9232577658cf2295 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fabe7 expref: 6 pid: 17184 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.654653:0:17168:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0e00/0x9232577658cf2295 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fabe7 expref: 6 pid: 17184 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.654680:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0e00/0x9232577658cf2295 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fabe7 expref: 6 pid: 17184 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.654698:0:17168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9e6fad400) 00010000:00010000:0.0:1787893316.654703:0:17168:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf233d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.654714:0:17168:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf233d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.654722:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf233d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.654754:0:17168:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893316.654783:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f229414-7dd1-4cf5-a739-e3375b9be1a7+5:2391:x1874741481833984:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 192us (617us total) trans 0 rc 0/0 00010000:00010000:1.0:1787893316.654789:0:20187:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf233d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893316.654793:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 15 00010000:00010000:1.0:1787893316.654803:0:20187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf233d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.654843:0:20187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf2344 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.654855:0:20187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf2344 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.654870:0:20187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf2344 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893316.654947:0:19990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af98d6ca-b952-492d-ad71-083813d6f146+5:15597:x1874741481833344:12345-192.168.202.35@tcp:59:lhsmtool_posix.0 Request processed in 77878us (79704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893316.654958:0:19990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 26 00000100:00080000:2.0:1787893316.655017:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787893316.659014:0:20187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf234b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.659040:0:20187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf234b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.659053:0:20187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf234b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787893316.659091:0:20187:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000009a5f201 reply state 00000000e0330949 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf234b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.659106:0:20187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf234b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.659115:0:20187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fc9c690bc00) 00010000:00010000:1.0:1787893316.659118:0:20187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787893316.659123:0:20187:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787893316.659128:0:20187:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787893316.659137:0:20187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf233d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.659145:0:20187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf233d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.659151:0:20187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf233d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.659158:0:20187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893316.659162:0:20187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf233d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.659169:0:20187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf233d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.659180:0:20187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9e6fad400) 00010000:00010000:1.0:1787893316.659183:0:20187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893316.659186:0:20187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf233d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.659203:0:20187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf233d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787893316.659226:0:20187:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000009a5f201 reply state 00000000e0330949 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf2344 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.659235:0:20187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf2344 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.659242:0:20187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fc9c690b800) 00010000:00010000:1.0:1787893316.659244:0:20187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787893316.659246:0:20187:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1787893316.660269:0:20187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:af98d6ca-b952-492d-ad71-083813d6f146+10:15603:x1874741481833856:12345-192.168.202.35@tcp:36:lfs.0 Request processed in 17957us (18380us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787893316.660286:0:20187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 28 00000100:00100000:0.0:1787893316.809259:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893316.812179:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481834112 00000100:00100000:2.0:1787893316.812199:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481834112 00000100:00100000:2.0:1787893316.812282:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 29 00000100:00100000:2.0:1787893316.812307:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af98d6ca-b952-492d-ad71-083813d6f146+10:15612:x1874741481834112:12345-192.168.202.35@tcp:101:lctl.0 00010000:00010000:2.0:1787893316.812342:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893316.812373:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0600/0x9232577658cf2352 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fac11 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893316.812470:0:17185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1e00/0x9232577658cf2359 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893316.812484:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1e00/0x9232577658cf2359 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893316.812518:0:17185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1e00/0x9232577658cf2359 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893316.812568:0:17185:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787893316.812572:0:17185:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787893316.812612:0:17185:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1e00/0x9232577658cf2359 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893316.812634:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0600/0x9232577658cf2352 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac11 expref: 12 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893316.812668:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1e00/0x9232577658cf2359 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac11 expref: 11 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893316.812679:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9e5e7c600) 00010000:00010000:2.0:1787893316.812682:0:17185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787893316.812686:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c67e1e00, rc 0) 00000100:00100000:2.0:1787893316.812790:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af98d6ca-b952-492d-ad71-083813d6f146+11:15612:x1874741481834112:12345-192.168.202.35@tcp:101:lctl.0 Request processed in 496us (3595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893316.812799:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 29 00000100:00100000:2.0:1787893316.841809:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893316.842037:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481834240 00000100:00100000:3.0:1787893316.842051:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481834240 00000100:00100000:3.0:1787893316.842189:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 30 00000100:00100000:3.0:1787893316.842204:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3f229414-7dd1-4cf5-a739-e3375b9be1a7+5:15613:x1874741481834240:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:3.0:1787893316.842231:0:17183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893316.842261:0:17183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf2360 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fac18 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893316.842386:0:17183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf2367 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893316.842402:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf2367 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893316.842415:0:17183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf2367 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893316.842469:0:17183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787893316.842473:0:17183:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787893316.842542:0:17183:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf2367 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893316.842572:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf2360 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac18 expref: 7 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893316.842593:0:17183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf2367 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac18 expref: 6 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893316.842621:0:17183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9e5e7c600) 00010000:00010000:3.0:1787893316.842625:0:17183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787893316.842629:0:17183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7e600, rc 0) 00000100:00100000:3.0:1787893316.842972:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3f229414-7dd1-4cf5-a739-e3375b9be1a7+6:15613:x1874741481834240:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 771us (1175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893316.842982:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 30 00000100:00100000:2.0:1787893316.852344:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893316.852615:0:20187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481834368 00000100:00100000:0.0:1787893316.852630:0:20187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481834368 00000100:00100000:0.0:1787893316.852710:0:20187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 31 00000100:00100000:0.0:1787893316.852723:0:20187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3f229414-7dd1-4cf5-a739-e3375b9be1a7+6:15613:x1874741481834368:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787893316.852750:0:20187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893316.852787:0:20187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf236e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fac1f expref: -99 pid: 20187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.852883:0:20187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf2375 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.852900:0:20187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf2375 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.852912:0:20187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf2375 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.852923:0:20187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf237c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.852930:0:20187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf237c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.852936:0:20187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf237c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.853036:0:20187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf2383 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.853045:0:20187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf2383 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.853052:0:20187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf2383 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893316.853103:0:20187:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787893316.853108:0:20187:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787893316.853136:0:20187:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf2383 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.853162:0:20187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf2375 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.853168:0:20187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf2375 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.853176:0:20187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf2375 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.853182:0:20187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893316.853186:0:20187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf2375 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.853195:0:20187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf2375 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.853210:0:20187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9e5e7c600) 00010000:00010000:0.0:1787893316.853214:0:20187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893316.853219:0:20187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf2375 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.853226:0:20187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31000/0x9232577658cf2375 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.853240:0:20187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf237c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.853246:0:20187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf237c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.853251:0:20187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf237c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.853264:0:20187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893316.853267:0:20187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf237c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.853274:0:20187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf237c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.853305:0:20187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fc9c690b800) 00010000:00010000:0.0:1787893316.853308:0:20187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893316.853310:0:20187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf237c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.853317:0:20187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf237c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.853351:0:20187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf236e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac1f expref: 8 pid: 20187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.853367:0:20187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf2383 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac1f expref: 7 pid: 20187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.853374:0:20187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fc9c690bc00) 00010000:00010000:0.0:1787893316.853377:0:20187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787893316.853380:0:20187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb30800, rc 0) 00000100:00100000:0.0:1787893316.854354:0:20187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3f229414-7dd1-4cf5-a739-e3375b9be1a7+7:15613:x1874741481834368:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 1625us (2016us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893316.854366:0:20187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 31 00000100:00100000:0.0:1787893316.858770:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893316.859115:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481834496 00000100:00100000:1.0:1787893316.859130:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481834496 00000100:00100000:1.0:1787893316.859248:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 6 00000100:00100000:1.0:1787893316.859262:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3f229414-7dd1-4cf5-a739-e3375b9be1a7+5:15613:x1874741481834496:12345-192.168.202.35@tcp:900:lfs.0 00000100:00100000:1.0:1787893316.859389:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3f229414-7dd1-4cf5-a739-e3375b9be1a7+5:15613:x1874741481834496:12345-192.168.202.35@tcp:900:lfs.0 Request processed in 130us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893316.859397:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 6 00000100:00080000:2.0:1787893316.859614:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787893316.863939:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893316.865620:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481834752 00000100:00100000:0.0:1787893316.865642:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481834752 00000100:00100000:0.0:1787893316.865745:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 32 00000100:00100000:0.0:1787893316.865759:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3f229414-7dd1-4cf5-a739-e3375b9be1a7+7:15613:x1874741481834752:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787893316.865797:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893316.865826:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf238a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fac26 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893316.865968:0:17184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787893316.866122:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf238a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac26 expref: 9 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.866141:0:17184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9e5e7c600) 00010000:00010000:0.0:1787893316.866144:0:17184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787893316.866151:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf238a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac26 expref: 9 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.866169:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb31c00, rc 0) 00000100:00100000:0.0:1787893316.866281:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3f229414-7dd1-4cf5-a739-e3375b9be1a7+8:15613:x1874741481834752:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 526us (2358us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1787893316.866290:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 32 00000100:00100000:3.0:1787893316.870947:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893316.871076:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481835008 00000100:00100000:0.0:1787893316.871090:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481835008 00000100:00100000:0.0:1787893316.871174:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 33 00000100:00100000:0.0:1787893316.871187:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3f229414-7dd1-4cf5-a739-e3375b9be1a7+8:15613:x1874741481835008:12345-192.168.202.35@tcp:36:lfs.0 00010000:00010000:0.0:1787893316.871451:0:17183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893316.871608:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf2383 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac1f expref: 8 pid: 20187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.871655:0:17183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fc9c690bc00) 00010000:00010000:0.0:1787893316.871662:0:17183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787893316.878603:0:17183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541000/0x9232577658cf2398 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.878639:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541000/0x9232577658cf2398 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.878656:0:17183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541000/0x9232577658cf2398 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787893316.880194:0:17183:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000977998a0 reply state 00000000b1a606c7 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541000/0x9232577658cf2398 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.880711:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541000/0x9232577658cf2398 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893316.880722:0:17183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fc9c690bc00) 00010000:00010000:1.0:1787893316.880725:0:17183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1787893316.880729:0:17183:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787893316.880744:0:17183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787893316.881329:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3f229414-7dd1-4cf5-a739-e3375b9be1a7+9:15613:x1874741481835008:12345-192.168.202.35@tcp:36:lfs.0 Request processed in 10137us (10391us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787893316.881341:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 33 00000040:00080000:3.0:1787893316.914413:0:17937:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787893316.933126:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893316.936332:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481835264 00000100:00100000:2.0:1787893316.936353:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481835264 00000100:00100000:2.0:1787893316.936717:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 2 00000100:00100000:2.0:1787893316.936731:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3f229414-7dd1-4cf5-a739-e3375b9be1a7+9:15613:x1874741481835264:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:2.0:1787893316.937614:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3f229414-7dd1-4cf5-a739-e3375b9be1a7+10:15613:x1874741481835264:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 883us (4499us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787893316.937625:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 2 00000100:00100000:2.0:1787893316.946093:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893316.946360:0:20187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481835520 00000100:00100000:0.0:1787893316.946374:0:20187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481835520 00000100:00100000:0.0:1787893316.946560:0:20187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 34 00000100:00100000:0.0:1787893316.946573:0:20187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3f229414-7dd1-4cf5-a739-e3375b9be1a7+10:15613:x1874741481835520:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787893316.946604:0:20187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893316.946630:0:20187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf239f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fac2d expref: -99 pid: 20187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.946731:0:20187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf23a6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.946761:0:20187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf23a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.946790:0:20187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf23a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.946804:0:20187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf23ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.946812:0:20187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf23ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.946819:0:20187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf23ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893316.946951:0:20187:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787893316.947318:0:20187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf23a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.947327:0:20187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf23a6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.947335:0:20187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf23a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.947344:0:20187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893316.947349:0:20187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf23a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.947357:0:20187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf23a6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.947371:0:20187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9e5e7c600) 00010000:00010000:0.0:1787893316.947374:0:20187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893316.947379:0:20187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf23a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.947385:0:20187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31c00/0x9232577658cf23a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.947400:0:20187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf23ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.947464:0:20187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf23ad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.947470:0:20187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf23ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.947487:0:20187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893316.947536:0:20187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf23ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.947544:0:20187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf23ad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.947555:0:20187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fc9c690b800) 00010000:00010000:0.0:1787893316.947558:0:20187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893316.947561:0:20187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf23ad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.947568:0:20187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf23ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.947614:0:20187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf239f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac2d expref: 12 pid: 20187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.947625:0:20187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9e5e7c600) 00010000:00010000:0.0:1787893316.947627:0:20187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787893316.947630:0:20187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf239f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac2d expref: 12 pid: 20187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893316.947640:0:20187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb30800, rc 0) 00000100:00100000:0.0:1787893316.947731:0:20187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3f229414-7dd1-4cf5-a739-e3375b9be1a7+11:15613:x1874741481835520:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 1159us (1653us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1787893316.947741:0:20187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 34 00000100:00100000:3.0:1787893316.954617:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893316.956717:0:19990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481835648 00000100:00100000:2.0:1787893316.956735:0:19990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481835648 00000100:00100000:2.0:1787893316.956841:0:19990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 35 00000100:00100000:2.0:1787893316.956855:0:19990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3f229414-7dd1-4cf5-a739-e3375b9be1a7+11:15613:x1874741481835648:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:2.0:1787893316.956888:0:19990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893316.956917:0:19990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0e00/0x9232577658cf23bb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fac34 expref: -99 pid: 19990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893316.957055:0:19990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf23c2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893316.957068:0:19990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf23c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893316.957080:0:19990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf23c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893316.957103:0:19990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787893316.957105:0:19990:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787893316.957124:0:19990:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf23c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893316.957168:0:19990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0e00/0x9232577658cf23bb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac34 expref: 13 pid: 19990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893316.957185:0:19990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf23c2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac34 expref: 12 pid: 19990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893316.957193:0:19990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fc9c690bc00) 00010000:00010000:2.0:1787893316.957195:0:19990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787893316.957198:0:19990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c67e0400, rc 0) 00000100:00100000:2.0:1787893316.957393:0:19990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3f229414-7dd1-4cf5-a739-e3375b9be1a7+12:15613:x1874741481835648:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 541us (2792us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893316.957399:0:19990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 35 00000100:00100000:3.0:1787893316.969141:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893316.969337:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481835776 00000100:00100000:1.0:1787893316.969351:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481835776 00000100:00100000:1.0:1787893316.969440:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 3 00000100:00100000:1.0:1787893316.969454:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3f229414-7dd1-4cf5-a739-e3375b9be1a7+12:15613:x1874741481835776:12345-192.168.202.35@tcp:37:lfs.0 00000100:00100000:0.0:1787893316.975351:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3f229414-7dd1-4cf5-a739-e3375b9be1a7+12:15613:x1874741481835776:12345-192.168.202.35@tcp:37:lfs.0 Request processed in 5883us (6208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893316.975381:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 3 00000100:00100000:3.0:1787893316.984600:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893316.984698:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481836032 00000100:00100000:2.0:1787893316.984711:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481836032 00000100:00100000:2.0:1787893316.984794:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 4 00000100:00100000:2.0:1787893316.984807:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7c51850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3f229414-7dd1-4cf5-a739-e3375b9be1a7+12:15613:x1874741481836032:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:2.0:1787893316.985654:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7c51850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3f229414-7dd1-4cf5-a739-e3375b9be1a7+13:15613:x1874741481836032:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 846us (1065us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787893316.985664:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 4 00000100:00100000:3.0:1787893317.100201:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893317.100353:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481836160 00000100:00100000:1.0:1787893317.100366:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481836160 00000100:00100000:1.0:1787893317.100584:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 36 00000100:00100000:1.0:1787893317.100597:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af98d6ca-b952-492d-ad71-083813d6f146+11:15619:x1874741481836160:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:1.0:1787893317.100625:0:17183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893317.100727:0:17183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541800/0x9232577658cf23c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fac3b expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893317.100822:0:17183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf23d0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893317.100863:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf23d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893317.100876:0:17183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf23d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893317.100892:0:17183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6a00/0x9232577658cf23d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893317.100900:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6a00/0x9232577658cf23d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893317.100907:0:17183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6a00/0x9232577658cf23d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893317.101005:0:17183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7600/0x9232577658cf23de lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893317.101016:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7600/0x9232577658cf23de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893317.101023:0:17183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7600/0x9232577658cf23de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893317.101066:0:17183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787893317.101070:0:17183:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787893317.101118:0:17183:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7600/0x9232577658cf23de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893317.101133:0:17183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf23d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893317.101151:0:17183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf23d0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893317.101158:0:17183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf23d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893317.101165:0:17183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893317.101170:0:17183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf23d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893317.101179:0:17183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf23d0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893317.101194:0:17183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9e5e7c600) 00010000:00010000:1.0:1787893317.101197:0:17183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893317.101202:0:17183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf23d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893317.101208:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf23d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893317.101225:0:17183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6a00/0x9232577658cf23d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893317.101231:0:17183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6a00/0x9232577658cf23d7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893317.101237:0:17183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6a00/0x9232577658cf23d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893317.101243:0:17183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c84f6a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893317.101252:0:17183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6a00/0x9232577658cf23d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893317.101259:0:17183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6a00/0x9232577658cf23d7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893317.101267:0:17183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fc9c690b800) 00010000:00010000:1.0:1787893317.101270:0:17183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893317.101273:0:17183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6a00/0x9232577658cf23d7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893317.101280:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6a00/0x9232577658cf23d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893317.101323:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541800/0x9232577658cf23c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac3b expref: 13 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893317.101340:0:17183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7600/0x9232577658cf23de lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac3b expref: 12 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893317.101348:0:17183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fc9c690bc00) 00010000:00010000:1.0:1787893317.101351:0:17183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787893317.101354:0:17183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c84f7600, rc 0) 00000100:00100000:1.0:1787893317.103568:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af98d6ca-b952-492d-ad71-083813d6f146+12:15619:x1874741481836160:12345-192.168.202.35@tcp:101:bash.0 Request processed in 2956us (3365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893317.103583:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 36 00010000:00010000:0.0:1787893317.105910:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893317.111868:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893317.111995:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481836288 00000100:00100000:2.0:1787893317.112011:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481836288 00000100:00100000:2.0:1787893317.112090:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 7 00000100:00100000:2.0:1787893317.112104:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:af98d6ca-b952-492d-ad71-083813d6f146+5:15619:x1874741481836288:12345-192.168.202.35@tcp:900:bash.0 00000100:00100000:2.0:1787893317.112216:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:af98d6ca-b952-492d-ad71-083813d6f146+5:15619:x1874741481836288:12345-192.168.202.35@tcp:900:bash.0 Request processed in 115us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893317.112246:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 7 00000100:00100000:2.0:1787893317.118276:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893317.119106:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481836544 00000100:00100000:3.0:1787893317.119122:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481836544 00000100:00100000:3.0:1787893317.120131:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 37 00000100:00100000:3.0:1787893317.120159:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af98d6ca-b952-492d-ad71-083813d6f146+12:15619:x1874741481836544:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:3.0:1787893317.120198:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893317.120227:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf23e5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fac42 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893317.121571:0:17185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf23ec lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893317.121931:0:17185:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf23c2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac34 expref: 12 pid: 19990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893317.122536:0:17185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf23ec lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893317.122612:0:17185:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf23c2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac34 expref: 12 pid: 19990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893317.123066:0:17185:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf23c2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac34 expref: 12 pid: 19990 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893317.123090:0:17185:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7cd6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17185:1874741493453184:192.168.202.35@tcp:104: 00000100:00100000:3.0:1787893317.123373:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c7486e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787893317.136239:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893317.138369:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481836672 00000100:00100000:0.0:1787893317.138390:0:17170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481836672 00010000:00010000:0.0:1787893317.138477:0:17170:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf23c2 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac34 expref: 13 pid: 19990 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893317.138574:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 16 00000100:00100000:0.0:1787893317.138585:0:17170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3f229414-7dd1-4cf5-a739-e3375b9be1a7+13:2390:x1874741481836672:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893317.139489:0:17170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893317.140088:0:17170:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf23c2 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac34 expref: 13 pid: 19990 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893317.140110:0:17170:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf23c2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac34 expref: 13 pid: 19990 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893317.140142:0:17170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fc9c690bc00) 00010000:00010000:0.0:1787893317.140148:0:17170:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf23ec lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893317.140160:0:17170:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf23ec lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893317.140168:0:17170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf23ec lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893317.141045:0:17170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893317.141148:0:17170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3f229414-7dd1-4cf5-a739-e3375b9be1a7+13:2390:x1874741481836672:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 2558us (4918us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893317.141179:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 16 00010000:00010000:2.0:1787893317.144503:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf23c2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac34 expref: 12 pid: 19990 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893317.144537:0:17185:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7cd6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17185:1874741493453184:192.168.202.35@tcp:104: 00010000:00010000:2.0:1787893317.144585:0:17185:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf23ec lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893317.144597:0:17185:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf23ec lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893317.144604:0:17185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf23ec lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893317.144643:0:17185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1c00/0x9232577658cf23f3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893317.144659:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1c00/0x9232577658cf23f3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893317.144670:0:17185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1c00/0x9232577658cf23f3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893317.146609:0:17185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0c00/0x9232577658cf23fa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893317.146638:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0c00/0x9232577658cf23fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893317.146680:0:17185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0c00/0x9232577658cf23fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893317.146698:0:17185:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787893317.146748:0:17185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf23ec lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893317.146756:0:17185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf23ec lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893317.146764:0:17185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf23ec lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893317.146772:0:17185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7ea00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893317.146778:0:17185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf23ec lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893317.146786:0:17185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf23ec lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893317.146802:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fc9c690bc00) 00010000:00010000:2.0:1787893317.146806:0:17185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893317.146811:0:17185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf23ec lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893317.146817:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7ea00/0x9232577658cf23ec lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787893317.146836:0:17185:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000313cf4ea reply state 00000000d61c6e4d transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1c00/0x9232577658cf23f3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893317.146864:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1c00/0x9232577658cf23f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893317.146870:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9fc9e5e7c300) 00010000:00010000:2.0:1787893317.146872:0:17185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787893317.146876:0:17185:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787893317.146928:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e800/0x9232577658cf23e5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac42 expref: 15 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893317.146943:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0c00/0x9232577658cf23fa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac42 expref: 14 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893317.146950:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc9e5e7cb00) 00010000:00010000:2.0:1787893317.146953:0:17185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1787893317.146955:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c67e0c00, rc 0) 00000100:00100000:2.0:1787893317.147846:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af98d6ca-b952-492d-ad71-083813d6f146+15:15619:x1874741481836544:12345-192.168.202.35@tcp:101:bash.0 Request processed in 27688us (29571us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787893317.147858:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 37 00000100:00100000:3.0:1787893317.174364:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893317.175550:0:20187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481836800 00000100:00100000:0.0:1787893317.175570:0:20187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481836800 00000100:00100000:0.0:1787893317.175675:0:20187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 38 00000100:00100000:0.0:1787893317.175688:0:20187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:af98d6ca-b952-492d-ad71-083813d6f146+15:15619:x1874741481836800:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:0.0:1787893317.175722:0:20187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893317.175749:0:20187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf2408 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fac49 expref: -99 pid: 20187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893317.175838:0:20187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf240f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893317.175870:0:20187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf240f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893317.175884:0:20187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf240f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893317.175952:0:20187:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787893317.175957:0:20187:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787893317.175983:0:20187:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf240f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893317.175996:0:20187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf240f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893317.176026:0:20187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30800/0x9232577658cf2408 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac49 expref: 17 pid: 20187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893317.176048:0:20187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf240f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac49 expref: 16 pid: 20187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893317.176087:0:20187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc9e5e7cb00) 00010000:00010000:0.0:1787893317.176091:0:20187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787893317.176096:0:20187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb31e00, rc 0) 00000100:00100000:0.0:1787893317.176198:0:20187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:af98d6ca-b952-492d-ad71-083813d6f146+16:15619:x1874741481836800:12345-192.168.202.35@tcp:101:bash.0 Request processed in 512us (1848us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893317.176206:0:20187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 38 00000100:00100000:1.0:1787893317.181644:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893317.181754:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481837056 00000100:00100000:2.0:1787893317.181768:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481837056 00000100:00100000:2.0:1787893317.181842:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 5 00000100:00100000:2.0:1787893317.181855:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af98d6ca-b952-492d-ad71-083813d6f146+16:15619:x1874741481837056:12345-192.168.202.35@tcp:35:bash.0 00000100:00100000:2.0:1787893317.182274:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af98d6ca-b952-492d-ad71-083813d6f146+17:15619:x1874741481837056:12345-192.168.202.35@tcp:35:bash.0 Request processed in 420us (644us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1787893317.182284:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 5 00000100:00100000:2.0:1787893317.331878:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893317.332114:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481837312 00000100:00100000:1.0:1787893317.332128:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481837312 00000100:00100000:1.0:1787893317.332213:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 39 00000100:00100000:1.0:1787893317.332225:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af98d6ca-b952-492d-ad71-083813d6f146+17:15629:x1874741481837312:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:1.0:1787893317.332259:0:17183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893317.332285:0:17183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6000/0x9232577658cf2416 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fac50 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893317.332476:0:17183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787893317.332960:0:17183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6000/0x9232577658cf2416 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac50 expref: 19 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893317.332978:0:17183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9e5e7c600) 00010000:00010000:1.0:1787893317.332982:0:17183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787893317.332988:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6000/0x9232577658cf2416 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac50 expref: 19 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893317.333006:0:17183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c84f6000, rc 0) 00000100:00100000:1.0:1787893317.334436:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af98d6ca-b952-492d-ad71-083813d6f146+18:15629:x1874741481837312:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 2201us (2560us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1787893317.334449:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 39 00000100:00100000:3.0:1787893317.344885:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893317.344998:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481837568 00000100:00100000:2.0:1787893317.345011:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481837568 00000100:00100000:2.0:1787893317.345157:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 6 00000100:00100000:2.0:1787893317.345170:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af98d6ca-b952-492d-ad71-083813d6f146+18:15629:x1874741481837568:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:2.0:1787893317.345547:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af98d6ca-b952-492d-ad71-083813d6f146+19:15629:x1874741481837568:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 378us (675us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1787893317.345556:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 6 00000100:00100000:3.0:1787893317.465707:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893317.466026:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481837824 00000100:00100000:2.0:1787893317.466041:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481837824 00000100:00100000:2.0:1787893317.466175:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 40 00000100:00100000:2.0:1787893317.466186:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af98d6ca-b952-492d-ad71-083813d6f146+19:15632:x1874741481837824:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:2.0:1787893317.466217:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893317.466243:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf2424 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fac57 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893317.466390:0:17185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1800/0x9232577658cf242b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893317.466415:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1800/0x9232577658cf242b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893317.466429:0:17185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1800/0x9232577658cf242b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893317.466442:0:17185:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787893317.467473:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf2424 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac57 expref: 22 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893317.467599:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1800/0x9232577658cf242b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac57 expref: 21 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893317.467769:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc9e5e7cb00) 00010000:00010000:2.0:1787893317.467772:0:17185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787893317.467776:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c67e1800, rc 0) 00000100:00100000:2.0:1787893317.468078:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af98d6ca-b952-492d-ad71-083813d6f146+21:15632:x1874741481837824:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 1891us (2384us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1787893317.468088:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 40 00000100:00100000:3.0:1787893317.474555:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893317.474611:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893317.474683:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481837952 00000100:00100000:1.0:1787893317.474695:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481837952 00000100:00100000:1.0:1787893317.474777:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 0 00000100:00100000:1.0:1787893317.474789:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af98d6ca-b952-492d-ad71-083813d6f146+21:2391:x1874741481837952:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893317.474807:0:17168:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893317.474838:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1800/0x9232577658cf242b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac57 expref: 21 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893317.474884:0:17168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc9e5e7cb00) 00010000:00010000:1.0:1787893317.474890:0:17168:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893317.474951:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af98d6ca-b952-492d-ad71-083813d6f146+20:2391:x1874741481837952:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 164us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893317.474959:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 0 00000100:00100000:0.0:1787893317.482830:0:20187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481838080 00000100:00100000:0.0:1787893317.482852:0:20187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481838080 00000100:00100000:2.0:1787893317.483075:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 41 00000100:00100000:2.0:1787893317.483093:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af98d6ca-b952-492d-ad71-083813d6f146+20:15632:x1874741481838080:12345-192.168.202.35@tcp:54:lfs.0 00010000:00010000:2.0:1787893317.483192:0:17185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0800/0x9232577658cf2439 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893317.483211:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0800/0x9232577658cf2439 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893317.483224:0:17185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0800/0x9232577658cf2439 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893317.483267:0:17185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0800/0x9232577658cf2439 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893317.483274:0:17185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0800/0x9232577658cf2439 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893317.483281:0:17185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0800/0x9232577658cf2439 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893317.483287:0:17185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e0800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893317.483305:0:17185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0800/0x9232577658cf2439 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893317.483330:0:17185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0800/0x9232577658cf2439 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893317.483345:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc9e5e7cb00) 00010000:00010000:2.0:1787893317.483348:0:17185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787893317.483353:0:17185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0800/0x9232577658cf2439 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893317.483359:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0800/0x9232577658cf2439 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893317.483467:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af98d6ca-b952-492d-ad71-083813d6f146+20:15632:x1874741481838080:12345-192.168.202.35@tcp:54:lfs.0 Request processed in 381us (8854us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893317.483475:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 41 00000100:00100000:1.0:1787893317.490393:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893317.490453:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481838336 00000100:00100000:1.0:1787893317.490465:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481838336 00000100:00100000:1.0:1787893317.490550:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 7 00000100:00100000:1.0:1787893317.490560:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af98d6ca-b952-492d-ad71-083813d6f146+20:15632:x1874741481838336:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:1.0:1787893317.491099:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af98d6ca-b952-492d-ad71-083813d6f146+21:15632:x1874741481838336:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 537us (719us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1787893317.491107:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 7 00000100:00100000:3.0:1787893318.107636:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893318.108094:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481838592 00000100:00100000:1.0:1787893318.108109:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481838592 00000100:00100000:1.0:1787893318.108261:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 42 00000100:00100000:1.0:1787893318.108274:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af98d6ca-b952-492d-ad71-083813d6f146+21:15663:x1874741481838592:12345-192.168.202.35@tcp:101:cat.0 00010000:00010000:1.0:1787893318.108316:0:17183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893318.108345:0:17183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6000/0x9232577658cf2440 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fac5e expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893318.108480:0:17183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7e00/0x9232577658cf2447 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893318.108551:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7e00/0x9232577658cf2447 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893318.108582:0:17183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7e00/0x9232577658cf2447 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893318.108611:0:17183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787893318.108800:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6000/0x9232577658cf2440 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac5e expref: 24 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893318.108821:0:17183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7e00/0x9232577658cf2447 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac5e expref: 23 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893318.108831:0:17183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc9e5e7cb00) 00010000:00010000:1.0:1787893318.108834:0:17183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787893318.108838:0:17183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c84f7e00, rc 0) 00000100:00100000:1.0:1787893318.108914:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af98d6ca-b952-492d-ad71-083813d6f146+23:15663:x1874741481838592:12345-192.168.202.35@tcp:101:cat.0 Request processed in 644us (1294us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1787893318.108922:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 42 00000100:00080000:2.0:1787893318.108999:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787893318.119249:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893318.119315:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893318.119395:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481838848 00000100:00100000:3.0:1787893318.119408:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481838848 00000100:00100000:3.0:1787893318.119516:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 8 00000100:00100000:3.0:1787893318.120083:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af98d6ca-b952-492d-ad71-083813d6f146+23:15663:x1874741481838848:12345-192.168.202.35@tcp:35:cat.0 00000100:00100000:3.0:1787893318.120630:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af98d6ca-b952-492d-ad71-083813d6f146+24:15663:x1874741481838848:12345-192.168.202.35@tcp:35:cat.0 Request processed in 561us (1393us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1787893318.120712:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481838976 00000100:00100000:0.0:1787893318.120727:0:17170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481838976 00000100:00100000:0.0:1787893318.120804:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 1 00000100:00100000:0.0:1787893318.120813:0:17170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af98d6ca-b952-492d-ad71-083813d6f146+25:2392:x1874741481838976:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893318.120826:0:17170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893318.120859:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7e00/0x9232577658cf2447 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac5e expref: 25 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.120890:0:17170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc9e5e7cb00) 00010000:00010000:0.0:1787893318.120896:0:17170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893318.120927:0:17170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af98d6ca-b952-492d-ad71-083813d6f146+24:2392:x1874741481838976:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 116us (1611us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893318.120934:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 1 00000100:00100000:3.0:1787893318.125035:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 8 00010000:00010000:0.0:1787893318.134111:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893318.207010:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893318.207319:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481839232 00000100:00100000:2.0:1787893318.207333:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481839232 00000100:00100000:2.0:1787893318.207420:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 43 00000100:00100000:2.0:1787893318.207432:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af98d6ca-b952-492d-ad71-083813d6f146+23:15669:x1874741481839232:12345-192.168.202.35@tcp:101:dd.0 00010000:00010000:2.0:1787893318.207463:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893318.207548:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf2455 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fac65 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.207702:0:17185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf245c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.207720:0:17185:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0c00/0x9232577658cf23fa lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac42 expref: 24 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.207849:0:17185:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf240f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac49 expref: 24 pid: 20187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.207859:0:17185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf245c lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.207908:0:17185:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf240f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac49 expref: 24 pid: 20187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.207926:0:17185:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf240f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac49 expref: 24 pid: 20187 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893318.207944:0:17185:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe349880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17185:1874741493453312:192.168.202.35@tcp:104: 00010000:00010000:2.0:1787893318.208069:0:17185:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0c00/0x9232577658cf23fa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac42 expref: 24 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.208079:0:17185:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0c00/0x9232577658cf23fa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac42 expref: 24 pid: 17185 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893318.208088:0:17185:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17185:1874741493453440:192.168.202.35@tcp:104: 00000100:00100000:2.0:1787893318.208113:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e5f7ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1787893318.212090:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893318.212197:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893318.212298:0:17185:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe349880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17185:1874741493453312:192.168.202.35@tcp:104: 00000100:00100000:3.0:1787893318.212314:0:17185:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17185:1874741493453440:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787893318.212349:0:17185:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf245c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893318.213054:0:17169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481839360 00000100:00100000:1.0:1787893318.213068:0:17169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481839360 00010000:00010000:1.0:1787893318.213124:0:17169:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf240f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac49 expref: 25 pid: 20187 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893318.213200:0:17169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481839488 00000100:00100000:1.0:1787893318.213205:0:17169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481839488 00010000:00010000:1.0:1787893318.213223:0:17169:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0c00/0x9232577658cf23fa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac42 expref: 26 pid: 17185 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893318.213261:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 17 00000100:00100000:0.0:1787893318.213276:0:17170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af98d6ca-b952-492d-ad71-083813d6f146+26:2390:x1874741481839360:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893318.213304:0:17170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893318.213328:0:17170:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf240f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac49 expref: 26 pid: 20187 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.213340:0:17170:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf240f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac49 expref: 26 pid: 20187 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.213369:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb31e00/0x9232577658cf240f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac49 expref: 26 pid: 20187 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.213387:0:17170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc9e5e7cb00) 00010000:00010000:0.0:1787893318.213392:0:17170:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf245c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.213410:0:17170:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf245c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.213416:0:17170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893318.213483:0:17170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af98d6ca-b952-492d-ad71-083813d6f146+25:2390:x1874741481839360:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 212us (1411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893318.213520:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 17 00000100:00100000:0.0:1787893318.213542:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 18 00000100:00100000:0.0:1787893318.213548:0:17170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c39d2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af98d6ca-b952-492d-ad71-083813d6f146+24:2390:x1874741481839488:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893318.213555:0:17170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893318.213560:0:17170:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0c00/0x9232577658cf23fa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac42 expref: 24 pid: 17185 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.213569:0:17170:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0c00/0x9232577658cf23fa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac42 expref: 24 pid: 17185 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.213589:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0c00/0x9232577658cf23fa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac42 expref: 24 pid: 17185 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.213598:0:17170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc9e5e7cb00) 00010000:00010000:0.0:1787893318.213601:0:17170:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf245c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.213609:0:17170:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf245c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.213617:0:17170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf245c lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.213651:0:17170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893318.213672:0:17170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c39d2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af98d6ca-b952-492d-ad71-083813d6f146+23:2390:x1874741481839488:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 124us (1474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893318.213679:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 18 00010000:00010000:3.0:1787893318.213906:0:17185:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf245c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.213915:0:17185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf245c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893318.213937:0:17185:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787893318.214141:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf2455 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac65 expref: 24 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.214157:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf245c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac65 expref: 23 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.214165:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc9e5e7cb00) 00010000:00010000:3.0:1787893318.214167:0:17185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787893318.214170:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c67e1000, rc 0) 00000100:00100000:3.0:1787893318.214204:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af98d6ca-b952-492d-ad71-083813d6f146+23:15669:x1874741481839232:12345-192.168.202.35@tcp:101:dd.0 Request processed in 6775us (7209us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1787893318.214211:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 43 00000100:00100000:3.0:1787893318.217253:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893318.217343:0:20187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481839616 00000100:00100000:3.0:1787893318.217355:0:20187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481839616 00000100:00100000:3.0:1787893318.217472:0:20187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 44 00000100:00100000:3.0:1787893318.217485:0:20187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:af98d6ca-b952-492d-ad71-083813d6f146+23:15669:x1874741481839616:12345-192.168.202.35@tcp:101:dd.0 00010000:00010000:3.0:1787893318.217540:0:20187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893318.217566:0:20187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf246a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fac6c expref: -99 pid: 20187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.217608:0:20187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf2471 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.217623:0:20187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf2471 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.217636:0:20187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf2471 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.217792:0:20187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf246a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac6c expref: 25 pid: 20187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.217814:0:20187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf2471 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac6c expref: 24 pid: 20187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.217823:0:20187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc9e5e7cb00) 00010000:00010000:3.0:1787893318.217826:0:20187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787893318.217831:0:20187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7f400, rc 0) 00000100:00100000:3.0:1787893318.217904:0:20187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:af98d6ca-b952-492d-ad71-083813d6f146+24:15669:x1874741481839616:12345-192.168.202.35@tcp:101:dd.0 Request processed in 423us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893318.217912:0:20187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 44 00000100:00100000:3.0:1787893318.220917:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893318.221261:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481839872 00000100:00100000:2.0:1787893318.221274:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481839872 00000100:00100000:2.0:1787893318.221355:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 45 00000100:00100000:2.0:1787893318.221380:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af98d6ca-b952-492d-ad71-083813d6f146+24:15669:x1874741481839872:12345-192.168.202.35@tcp:36:dd.0 00010000:00010000:2.0:1787893318.222126:0:17183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0a00/0x9232577658cf2478 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.222149:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0a00/0x9232577658cf2478 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.222163:0:17183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0a00/0x9232577658cf2478 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787893318.222220:0:17183:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1787893318.222246:0:17183:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003d578127 reply state 00000000e51f459e transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0a00/0x9232577658cf2478 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.222259:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0a00/0x9232577658cf2478 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.222267:0:17183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc9e5e7cb00) 00010000:00010000:2.0:1787893318.222270:0:17183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787893318.222274:0:17183:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787893318.222583:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af98d6ca-b952-492d-ad71-083813d6f146+27:15669:x1874741481839872:12345-192.168.202.35@tcp:36:dd.0 Request processed in 1202us (1676us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1787893318.222593:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 45 00000020:00080000:2.0:1787893318.222599:0:17183:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787893318.225326:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893318.227878:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481840000 00000100:00100000:1.0:1787893318.227900:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481840000 00000100:00100000:1.0:1787893318.228136:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 46 00000100:00100000:1.0:1787893318.228150:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af98d6ca-b952-492d-ad71-083813d6f146+27:15669:x1874741481840000:12345-192.168.202.35@tcp:101:dd.0 00010000:00010000:1.0:1787893318.228184:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893318.228214:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6000/0x9232577658cf247f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fac73 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893318.228303:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6000/0x9232577658cf247f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac73 expref: 28 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893318.228322:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6000/0x9232577658cf247f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac73 expref: 28 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893318.228347:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc9e5e7cb00) 00010000:00010000:1.0:1787893318.228351:0:17185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787893318.228357:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c84f6000, rc 0) 00000100:00100000:1.0:1787893318.228555:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af98d6ca-b952-492d-ad71-083813d6f146+28:15669:x1874741481840000:12345-192.168.202.35@tcp:101:dd.0 Request processed in 407us (3242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893318.228563:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 46 00000100:00100000:0.0:1787893318.238831:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893318.238983:0:17169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481840256 00000100:00100000:1.0:1787893318.238997:0:17169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481840256 00000100:00100000:1.0:1787893318.239079:0:17169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 2 00000100:00100000:1.0:1787893318.239090:0:17169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7524a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af98d6ca-b952-492d-ad71-083813d6f146+28:15669:x1874741481840256:12345-192.168.202.35@tcp:103:dd.0 00010000:00010000:1.0:1787893318.239109:0:17169:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893318.239140:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6000/0x9232577658cf247f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac73 expref: 28 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893318.239162:0:17169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc9e5e7cb00) 00010000:00010000:1.0:1787893318.239185:0:17169:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893318.239251:0:17169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7524a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af98d6ca-b952-492d-ad71-083813d6f146+27:15669:x1874741481840256:12345-192.168.202.35@tcp:103:dd.0 Request processed in 163us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893318.239259:0:17169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 2 00000100:00100000:0.0:1787893318.241954:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893318.242082:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481840384 00000100:00100000:3.0:1787893318.242095:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481840384 00000100:00100000:3.0:1787893318.242176:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 47 00000100:00100000:3.0:1787893318.242187:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af98d6ca-b952-492d-ad71-083813d6f146+27:15669:x1874741481840384:12345-192.168.202.35@tcp:58:dd.0 00010000:00010000:3.0:1787893318.242332:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fe00/0x9232577658cf2486 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.242352:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fe00/0x9232577658cf2486 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.242363:0:17184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fe00/0x9232577658cf2486 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787893318.244051:0:17184:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787893318.244088:0:17184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1787893318.244222:0:17184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1787893318.244426:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af98d6ca-b952-492d-ad71-083813d6f146+27:15669:x1874741481840384:12345-192.168.202.35@tcp:58:dd.0 Request processed in 2234us (2478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893318.244438:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 47 00000100:00100000:0.0:1787893318.249165:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893318.249275:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481840512 00000100:00100000:2.0:1787893318.249296:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481840512 00000100:00100000:2.0:1787893318.249368:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 48 00000100:00100000:2.0:1787893318.249379:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af98d6ca-b952-492d-ad71-083813d6f146+27:15669:x1874741481840512:12345-192.168.202.35@tcp:101:dd.0 00010000:00010000:2.0:1787893318.249526:0:17183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893318.249625:0:17183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0c00/0x9232577658cf248d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fac7a expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.249716:0:17183:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fe00/0x9232577658cf2486 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.249729:0:17183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0c00/0x9232577658cf248d lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac7a expref: 28 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.249814:0:17183:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fe00/0x9232577658cf2486 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.249832:0:17183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0c00/0x9232577658cf248d lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac7a expref: 28 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.249848:0:17183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc9e5e7cb00) 00010000:00010000:2.0:1787893318.249851:0:17183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787893318.249855:0:17183:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0c00/0x9232577658cf248d lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac7a expref: 28 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.249863:0:17183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c67e0c00, rc 0) 00000100:00100000:2.0:1787893318.249969:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af98d6ca-b952-492d-ad71-083813d6f146+28:15669:x1874741481840512:12345-192.168.202.35@tcp:101:dd.0 Request processed in 592us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893318.249977:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 48 00000040:00080000:2.0:1787893318.642382:0:17220:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787893318.642404:0:17220:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787893318.642442:0:17220:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787893318.642455:0:17220:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787893318.642803:0:17220:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9c700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17220:1874741493453568:192.168.202.35@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787893318.642973:0:17220:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e5f7ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1787893318.661947:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893318.662059:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481840640 00000100:00100000:1.0:1787893318.662073:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481840640 00000100:00100000:1.0:1787893318.662157:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 49 00000100:00100000:1.0:1787893318.662170:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af98d6ca-b952-492d-ad71-083813d6f146+29:15670:x1874741481840640:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787893318.662213:0:17185:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787893318.662383:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af98d6ca-b952-492d-ad71-083813d6f146+29:15670:x1874741481840640:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 Request processed in 215us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893318.662391:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 49 00000100:00100000:2.0:1787893318.663163:0:17220:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9c700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17220:1874741493453568:192.168.202.35@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787893318.669637:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893318.669941:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481840768 00000100:00100000:3.0:1787893318.669955:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481840768 00000100:00100000:3.0:1787893318.670052:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 50 00000100:00100000:3.0:1787893318.670065:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af98d6ca-b952-492d-ad71-083813d6f146+28:15670:x1874741481840768:12345-192.168.202.35@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787893318.670164:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf2494 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.670185:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf2494 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.670200:0:17184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf2494 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.670234:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf249b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.670242:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf249b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.670248:0:17184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf249b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.670276:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf24a2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.670298:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf24a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.670305:0:17184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf24a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893318.670374:0:17184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787893318.670380:0:17184:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787893318.670403:0:17184:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf24a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.670415:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf2494 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.670422:0:17184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf2494 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.670429:0:17184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf2494 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.670445:0:17184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7e400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893318.670461:0:17184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf2494 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.670470:0:17184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf2494 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.670486:0:17184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fc9c690b400) 00010000:00010000:3.0:1787893318.670518:0:17184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893318.670524:0:17184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf2494 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.670530:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf2494 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.670547:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf249b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.670553:0:17184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf249b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.670559:0:17184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf249b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.670564:0:17184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7e000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893318.670567:0:17184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf249b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.670573:0:17184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf249b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.670593:0:17184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9fc9cab65900) 00010000:00010000:3.0:1787893318.670596:0:17184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893318.670599:0:17184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf249b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.670604:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf249b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.670622:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf24a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.670629:0:17184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf24a2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.670635:0:17184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf24a2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.670640:0:17184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7fa00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893318.670643:0:17184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf24a2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.670649:0:17184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf24a2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.670656:0:17184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc9e5e7cb00) 00010000:00010000:3.0:1787893318.670669:0:17184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893318.670672:0:17184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf24a2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.670677:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf24a2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893318.671043:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af98d6ca-b952-492d-ad71-083813d6f146+28:15670:x1874741481840768:12345-192.168.202.35@tcp:34:lhsmtool_posix.0 Request processed in 978us (1419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893318.671053:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 50 00000100:00100000:0.0:1787893318.675050:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893318.675165:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481841024 00000100:00100000:2.0:1787893318.675179:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481841024 00000100:00100000:2.0:1787893318.675264:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 51 00000100:00100000:2.0:1787893318.675276:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af98d6ca-b952-492d-ad71-083813d6f146+28:15670:x1874741481841024:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787893318.675314:0:17183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893318.675341:0:17183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf24a9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fac81 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.675534:0:17183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0800/0x9232577658cf24b0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.675552:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0800/0x9232577658cf24b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.675565:0:17183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0800/0x9232577658cf24b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893318.675578:0:17183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787893318.675851:0:17183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0800/0x9232577658cf24b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.675860:0:17183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0800/0x9232577658cf24b0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.675869:0:17183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0800/0x9232577658cf24b0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.675876:0:17183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e0800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893318.675882:0:17183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0800/0x9232577658cf24b0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.675910:0:17183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0800/0x9232577658cf24b0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.675928:0:17183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc9e5e7cb00) 00010000:00010000:2.0:1787893318.675932:0:17183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787893318.675938:0:17183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0800/0x9232577658cf24b0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.675945:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0800/0x9232577658cf24b0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.676006:0:17183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf24a9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac81 expref: 30 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.676017:0:17183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fc9c690b400) 00010000:00010000:2.0:1787893318.676020:0:17183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787893318.676024:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf24a9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac81 expref: 30 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.676035:0:17183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c67e0400, rc 0) 00000100:00100000:2.0:1787893318.676106:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af98d6ca-b952-492d-ad71-083813d6f146+29:15670:x1874741481841024:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 833us (1073us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1787893318.676114:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 51 00000100:00100000:0.0:1787893318.680202:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893318.680324:0:19990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481841152 00000100:00100000:3.0:1787893318.680338:0:19990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481841152 00000100:00100000:3.0:1787893318.680452:0:19990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 52 00000100:00100000:3.0:1787893318.680466:0:19990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af98d6ca-b952-492d-ad71-083813d6f146+29:15670:x1874741481841152:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787893318.683002:0:19990:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787893318.683212:0:19990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af98d6ca-b952-492d-ad71-083813d6f146+29:15670:x1874741481841152:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 Request processed in 2743us (3017us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893318.683224:0:19990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 52 00000100:00100000:0.0:1787893318.689565:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893318.689919:0:20187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481841408 00000100:00100000:2.0:1787893318.689933:0:20187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481841408 00000100:00100000:2.0:1787893318.690004:0:20187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 53 00000100:00100000:2.0:1787893318.690016:0:20187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:af98d6ca-b952-492d-ad71-083813d6f146+29:15670:x1874741481841408:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787893318.690066:0:20187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893318.690094:0:20187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf24be lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fac88 expref: -99 pid: 20187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787893318.691195:0:20187:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =27 00000004:00080000:2.0:1787893318.691207:0:20187:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+27 in llog 00000004:00080000:2.0:1787893318.691237:0:20187:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:2.0:1787893318.691464:0:20187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0800/0x9232577658cf24c5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.691481:0:20187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0800/0x9232577658cf24c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.691530:0:20187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0800/0x9232577658cf24c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.692117:0:20187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf24be lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac88 expref: 32 pid: 20187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.692150:0:20187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0800/0x9232577658cf24c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac88 expref: 31 pid: 20187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.692162:0:20187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fc9e5e7cf00) 00010000:00010000:2.0:1787893318.692165:0:20187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787893318.692170:0:20187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c67e0800, rc 0) 00000100:00100000:2.0:1787893318.692267:0:20187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:af98d6ca-b952-492d-ad71-083813d6f146+31:15670:x1874741481841408:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 2251us (2717us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1787893318.692286:0:20187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 53 00000100:00100000:0.0:1787893318.710103:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893318.710229:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481841664 00000100:00100000:3.0:1787893318.710242:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481841664 00000100:00100000:3.0:1787893318.710341:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 54 00000100:00100000:3.0:1787893318.710354:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af98d6ca-b952-492d-ad71-083813d6f146+31:15670:x1874741481841664:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787893318.710437:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893318.710471:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0800/0x9232577658cf24c5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac88 expref: 31 pid: 20187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.710538:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fc9e5e7cf00) 00010000:00010000:3.0:1787893318.710551:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787893318.710580:0:17185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf24d3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.710596:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf24d3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.710638:0:17185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf24d3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.710656:0:17185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf24da lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x2ae156b7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.710874:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf24da lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2ae156b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.710882:0:17185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf24da lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2ae156b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.710948:0:17185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf24d3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.710955:0:17185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf24d3 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.710961:0:17185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf24d3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.710967:0:17185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7fa00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893318.710972:0:17185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf24d3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.710979:0:17185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf24d3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.710988:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fc9c690bc00) 00010000:00010000:3.0:1787893318.710991:0:17185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893318.710995:0:17185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf24d3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.711008:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf24d3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.711020:0:17185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf24da lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2ae156b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.711025:0:17185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf24da lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2ae156b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.711031:0:17185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf24da lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2ae156b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.711036:0:17185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7e000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893318.711039:0:17185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf24da lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2ae156b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.711044:0:17185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf24da lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2ae156b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.711051:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x2ae156b7 (ffff9fc9cab65900) 00010000:00010000:3.0:1787893318.711054:0:17185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893318.711057:0:17185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf24da lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x2ae156b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.711062:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf24da lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x2ae156b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893318.711166:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af98d6ca-b952-492d-ad71-083813d6f146+30:15670:x1874741481841664:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 Request processed in 813us (1075us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787893318.711174:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 54 00000100:00100000:1.0:1787893318.718702:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893318.718871:0:19990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481841792 00000100:00100000:3.0:1787893318.718884:0:19990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481841792 00000100:00100000:3.0:1787893318.718979:0:19990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 55 00000100:00100000:3.0:1787893318.718993:0:19990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af98d6ca-b952-492d-ad71-083813d6f146+30:15670:x1874741481841792:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787893318.719023:0:19990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893318.719051:0:19990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf24e1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fac8f expref: -99 pid: 19990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.719095:0:19990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf24e8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.719112:0:19990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf24e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.719124:0:19990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf24e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.719271:0:19990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf24e1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac8f expref: 32 pid: 19990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.719304:0:19990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf24e8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac8f expref: 31 pid: 19990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.719314:0:19990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fc9cab65900) 00010000:00010000:3.0:1787893318.719318:0:19990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787893318.719322:0:19990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7fa00, rc 0) 00000100:00100000:3.0:1787893318.719405:0:19990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af98d6ca-b952-492d-ad71-083813d6f146+31:15670:x1874741481841792:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 416us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893318.719412:0:19990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 55 00000100:00100000:1.0:1787893318.727579:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893318.727881:0:20187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481842048 00000100:00100000:2.0:1787893318.727914:0:20187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481842048 00000100:00100000:2.0:1787893318.727986:0:20187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 56 00000100:00100000:2.0:1787893318.727997:0:20187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:af98d6ca-b952-492d-ad71-083813d6f146+31:15670:x1874741481842048:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787893318.728104:0:20187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf24ef lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.728124:0:20187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf24ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.728137:0:20187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf24ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787893318.728369:0:20187:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1787893318.728378:0:20187:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 562549886557ns, next at 563549884062ns, rc = 0 00000004:00010000:2.0:1787893318.728435:0:20187:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006b8e1d18 reply state 00000000af604ff6 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf24ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.728449:0:20187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf24ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.728457:0:20187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fc9cab65900) 00010000:00010000:2.0:1787893318.728460:0:20187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787893318.728463:0:20187:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787893318.728605:0:20187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:af98d6ca-b952-492d-ad71-083813d6f146+33:15670:x1874741481842048:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 Request processed in 609us (1042us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1787893318.728613:0:20187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 56 00000100:00100000:1.0:1787893318.738111:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893318.738306:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481842176 00000100:00100000:0.0:1787893318.738322:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481842176 00000100:00100000:0.0:1787893318.738420:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 57 00000100:00100000:0.0:1787893318.738431:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af98d6ca-b952-492d-ad71-083813d6f146+33:15670:x1874741481842176:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787893318.738462:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893318.738487:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf24f6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fac96 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.738622:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf24f6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac96 expref: 34 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.738640:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf24f6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac96 expref: 34 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.738673:0:17184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fc9cab65900) 00010000:00010000:0.0:1787893318.738676:0:17184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787893318.738680:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb30600, rc 0) 00000100:00100000:0.0:1787893318.738902:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af98d6ca-b952-492d-ad71-083813d6f146+34:15670:x1874741481842176:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 471us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893318.738909:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 57 00000100:00100000:0.0:1787893318.742425:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893318.742531:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481842304 00000100:00100000:1.0:1787893318.742544:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481842304 00000100:00100000:1.0:1787893318.742636:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 21 00000100:00100000:1.0:1787893318.742650:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7525180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af98d6ca-b952-492d-ad71-083813d6f146+5:2390:x1874741481842304:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787893318.743321:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7525180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af98d6ca-b952-492d-ad71-083813d6f146+6:2390:x1874741481842304:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 Request processed in 669us (902us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1787893318.743330:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 21 00000100:00080000:2.0:1787893318.743547:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787893318.749607:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893318.749944:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481842560 00000100:00100000:0.0:1787893318.749959:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481842560 00000100:00100000:0.0:1787893318.750035:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 9 00000100:00100000:0.0:1787893318.750047:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af98d6ca-b952-492d-ad71-083813d6f146+34:15670:x1874741481842560:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787893318.750360:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af98d6ca-b952-492d-ad71-083813d6f146+35:15670:x1874741481842560:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 Request processed in 314us (766us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1787893318.750370:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 9 00000100:00100000:2.0:1787893318.759477:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893318.759709:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481842816 00000100:00100000:1.0:1787893318.759725:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481842816 00000100:00100000:1.0:1787893318.759809:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 58 00000100:00100000:1.0:1787893318.759821:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af98d6ca-b952-492d-ad71-083813d6f146+35:15670:x1874741481842816:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787893318.760467:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af98d6ca-b952-492d-ad71-083813d6f146+35:15670:x1874741481842816:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 Request processed in 644us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893318.760478:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 58 00000100:00100000:1.0:1787893318.763455:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893318.763751:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481842944 00000100:00100000:3.0:1787893318.763764:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481842944 00000100:00100000:3.0:1787893318.763846:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 59 00000100:00100000:3.0:1787893318.763859:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af98d6ca-b952-492d-ad71-083813d6f146+35:15670:x1874741481842944:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787893318.763886:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893318.763913:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf24fd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fac9d expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.764002:0:17185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf2504 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.764020:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf2504 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.764033:0:17185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf2504 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893318.764701:0:17185:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787893318.768725:0:17185:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf2504 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.768840:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e000/0x9232577658cf24fd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac9d expref: 37 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.768868:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf2504 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac9d expref: 36 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.768880:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fc9cab65900) 00010000:00010000:2.0:1787893318.768883:0:17185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787893318.768887:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7e400, rc 0) 00000100:00100000:2.0:1787893318.768997:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af98d6ca-b952-492d-ad71-083813d6f146+36:15670:x1874741481842944:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 5138us (5553us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893318.769008:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 59 00000100:00100000:1.0:1787893318.774043:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893318.774133:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481843072 00000100:00100000:2.0:1787893318.774145:0:18702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481843072 00000100:00100000:2.0:1787893318.774257:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 22 00000100:00100000:2.0:1787893318.774270:0:18702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af98d6ca-b952-492d-ad71-083813d6f146+6:2391:x1874741481843072:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787893318.774313:0:18702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893318.774342:0:18702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f39d8850/0x9232577658cf250b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62faca4 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787893318.774377:0:18702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a911646, blocks: 0x0 00010000:00010000:2.0:1787893318.774404:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1787893318.774410:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893318.774421:0:18702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f39d8850/0x9232577658cf250b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faca4 expref: 7 pid: 18702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.774471:0:18702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f39d8850/0x9232577658cf250b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faca4 expref: 7 pid: 18702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.774537:0:18702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c67e0e00, rc 0) 00000100:00100000:2.0:1787893318.774618:0:18702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af98d6ca-b952-492d-ad71-083813d6f146+7:2391:x1874741481843072:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 350us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893318.774626:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 22 00000100:00100000:3.0:1787893318.776971:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893318.779437:0:19990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481843328 00000100:00100000:0.0:1787893318.779460:0:19990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481843328 00000100:00100000:0.0:1787893318.779582:0:19990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 60 00000100:00100000:0.0:1787893318.779596:0:19990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af98d6ca-b952-492d-ad71-083813d6f146+36:15670:x1874741481843328:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787893318.779754:0:19990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af98d6ca-b952-492d-ad71-083813d6f146+36:15670:x1874741481843328:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 Request processed in 161us (2794us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893318.779763:0:19990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 60 00000100:00100000:0.0:1787893318.782848:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893318.782953:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481843456 00000100:00100000:2.0:1787893318.782966:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481843456 00000100:00100000:2.0:1787893318.783041:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 61 00000100:00100000:2.0:1787893318.783054:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af98d6ca-b952-492d-ad71-083813d6f146+36:15670:x1874741481843456:12345-192.168.202.35@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787893318.788007:0:17163:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:3.0:1787893318.788037:0:17163:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:3.0:1787893318.788110:0:17163:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:0.0:1787893318.788313:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf2344 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.788328:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf2344 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.788337:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf2344 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.788345:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893318.788351:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf2344 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.788360:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf2344 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.788383:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fc9c690b800) 00010000:00010000:0.0:1787893318.788387:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893318.788412:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf2344 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.788419:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf2344 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.788447:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf234b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.788455:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf234b lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.788462:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf234b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.788468:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893318.788471:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf234b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.788477:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf234b lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.788486:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fc9c690bc00) 00010000:00010000:0.0:1787893318.788489:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893318.788538:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf234b lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.788544:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf234b lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.788561:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1c00/0x9232577658cf23f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.788578:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1c00/0x9232577658cf23f3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.788584:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1c00/0x9232577658cf23f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.788590:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e1c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893318.788593:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1c00/0x9232577658cf23f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.788598:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1c00/0x9232577658cf23f3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.788607:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9fc9e5e7c300) 00010000:00010000:0.0:1787893318.788610:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893318.788613:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1c00/0x9232577658cf23f3 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.788619:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1c00/0x9232577658cf23f3 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.788636:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0a00/0x9232577658cf2478 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.788642:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0a00/0x9232577658cf2478 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.788649:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0a00/0x9232577658cf2478 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.788655:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e0a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893318.788664:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0a00/0x9232577658cf2478 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.788671:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0a00/0x9232577658cf2478 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.788680:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc9e5e7cb00) 00010000:00010000:0.0:1787893318.788683:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893318.788685:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0a00/0x9232577658cf2478 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.788691:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0a00/0x9232577658cf2478 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.788703:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf24ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.788710:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf24ef lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.788716:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf24ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.788721:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e0400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893318.788724:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf24ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.788731:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf24ef lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.788750:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fc9cab65900) 00010000:00010000:0.0:1787893318.788753:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787893318.788762:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf24ef lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.788769:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf24ef lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.788916:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541000/0x9232577658cf2398 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.788925:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541000/0x9232577658cf2398 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.788931:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541000/0x9232577658cf2398 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.788937:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe541000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893318.788940:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541000/0x9232577658cf2398 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.788947:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541000/0x9232577658cf2398 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.788969:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fc9c690bc00) 00010000:00010000:2.0:1787893318.788971:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1787893318.788974:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541000/0x9232577658cf2398 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.788980:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541000/0x9232577658cf2398 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893318.789169:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af98d6ca-b952-492d-ad71-083813d6f146+15:15670:x1874741481843456:12345-192.168.202.35@tcp:44:lhsmtool_posix.0 Request processed in 6110us (6327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893318.789181:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 61 00000100:00100000:3.0:1787893318.789432:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787893318.789453:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493453696:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787893318.789561:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893318.789691:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493453696 00000100:00100000:1.0:1787893318.789702:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493453696 00000100:00100000:1.0:1787893318.789780:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787893318.789791:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f3975850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493453696:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787893318.789949:0:18703:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787893318.789953:0:18703:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1787893318.789956:0:18703:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787893318.789958:0:18703:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1787893318 -> 1787893318 00002000:00010000:1.0:1787893318.789961:0:18703:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787893318.790001:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f3975850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3633:x1874741493453696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 213us (441us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787893318.790009:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1787893318.790290:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1787893318.790329:0:3633:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fc9ffbdc000/2, rc 0, transno 8589934596 00000100:00100000:3.0:1787893318.790337:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493453696:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787893318.794763:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893318.794908:0:19239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481843584 00000100:00100000:1.0:1787893318.794921:0:19239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481843584 00000100:00100000:1.0:1787893318.794991:0:19239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 24 00000100:00100000:1.0:1787893318.795003:0:19239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af98d6ca-b952-492d-ad71-083813d6f146+7:2390:x1874741481843584:12345-192.168.202.35@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787893318.795155:0:19239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af98d6ca-b952-492d-ad71-083813d6f146+7:2390:x1874741481843584:12345-192.168.202.35@tcp:16:lhsmtool_posix.0 Request processed in 153us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893318.795163:0:19239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 24 00000100:00100000:0.0:1787893318.806988:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893318.807197:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481843840 00000100:00100000:2.0:1787893318.807211:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481843840 00000100:00100000:2.0:1787893318.807298:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 62 00000100:00100000:2.0:1787893318.807311:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af98d6ca-b952-492d-ad71-083813d6f146+15:15670:x1874741481843840:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787893318.807384:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893318.807420:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf2504 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac9d expref: 15 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.807444:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fc9cab65900) 00010000:00010000:2.0:1787893318.807450:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787893318.807544:0:17185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0600/0x9232577658cf2512 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.807560:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0600/0x9232577658cf2512 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.807572:0:17185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0600/0x9232577658cf2512 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787893318.807758:0:17185:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005eedcdb6 reply state 00000000a1c41719 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0600/0x9232577658cf2512 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.807772:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0600/0x9232577658cf2512 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.807778:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fc9cab65900) 00010000:00010000:2.0:1787893318.807781:0:17185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787893318.807783:0:17185:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787893318.807908:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af98d6ca-b952-492d-ad71-083813d6f146+16:15670:x1874741481843840:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 Request processed in 599us (936us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1787893318.807917:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 62 00000100:00100000:0.0:1787893318.812605:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893318.812714:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481843968 00000100:00100000:1.0:1787893318.812728:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481843968 00000100:00100000:1.0:1787893318.812808:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 25 00000100:00100000:1.0:1787893318.812827:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7525180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af98d6ca-b952-492d-ad71-083813d6f146+7:15670:x1874741481843968:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787893318.812852:0:18703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893318.812891:0:18703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b38fb54/0x9232577658cf2519 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62facab expref: -99 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893318.812934:0:18703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f39d8850/0x9232577658cf250b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faca4 expref: 8 pid: 18702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893318.812943:0:18703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893318.812948:0:18703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893318.812953:0:18703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b38fb54/0x9232577658cf2519 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62facab expref: 8 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893318.812996:0:18703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f39d8850/0x9232577658cf250b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faca4 expref: 8 pid: 18702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893318.813012:0:18703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f39d8850/0x9232577658cf250b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faca4 expref: 8 pid: 18702 timeout: 662 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893318.813029:0:18703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18703:1874741493453824:192.168.202.35@tcp:104: 00000100:00100000:1.0:1787893318.813144:0:18703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c76863c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787893318.816131:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893318.818381:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481844096 00000100:00100000:2.0:1787893318.818401:0:17170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481844096 00010000:00010000:2.0:1787893318.818470:0:17170:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f39d8850/0x9232577658cf250b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faca4 expref: 9 pid: 18702 timeout: 662 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893318.818573:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 19 00000100:00100000:2.0:1787893318.818587:0:17170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af98d6ca-b952-492d-ad71-083813d6f146+9:2391:x1874741481844096:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787893318.818605:0:17170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893318.818634:0:17170:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f39d8850/0x9232577658cf250b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faca4 expref: 9 pid: 18702 timeout: 662 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.818652:0:17170:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f39d8850/0x9232577658cf250b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faca4 expref: 9 pid: 18702 timeout: 662 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.818713:0:17170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893318.818719:0:17170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893318.818728:0:17170:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005b38fb54/0x9232577658cf2519 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62facab expref: 9 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.818740:0:17170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b38fb54/0x9232577658cf2519 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62facab expref: 9 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.818790:0:17170:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005b38fb54/0x9232577658cf2519 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62facab expref: 9 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893318.818809:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:17170:1874741493453952:192.168.202.35@tcp:105: 00000100:00100000:2.0:1787893318.819170:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e5f7e540 going to sleep for 11 seconds 00010000:00010000:0.0:1787893318.820466:0:18703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f39d8850/0x9232577658cf250b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faca4 expref: 9 pid: 18702 timeout: 662 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893318.820512:0:18703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18703:1874741493453824:192.168.202.35@tcp:104: 00010000:00010000:0.0:1787893318.820546:0:18703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005b38fb54/0x9232577658cf2519 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62facab expref: 8 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.821037:0:18703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c84f6000, rc 0) 00000100:00100000:0.0:1787893318.821191:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7525180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af98d6ca-b952-492d-ad71-083813d6f146+8:15670:x1874741481843968:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 8364us (8597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893318.821201:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 25 00000100:00100000:3.0:1787893318.829155:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893318.829299:0:19239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481844224 00000100:00100000:1.0:1787893318.829313:0:19239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481844224 00000100:00100000:1.0:1787893318.829394:0:19239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 26 00000100:00100000:1.0:1787893318.829406:0:19239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af98d6ca-b952-492d-ad71-083813d6f146+8:2391:x1874741481844224:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787893318.829647:0:19239:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787893318.829651:0:19239:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1787893318 00002000:00010000:1.0:1787893318.829662:0:19239:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1787893317 00002000:00010000:1.0:1787893318.829664:0:19239:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1787893318 -> 1787893318 00002000:00010000:1.0:1787893318.829668:0:19239:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787893318.829742:0:19239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af98d6ca-b952-492d-ad71-083813d6f146+9:2391:x1874741481844224:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 Request processed in 337us (601us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1787893318.829751:0:19239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 26 00000100:00100000:2.0:1787893318.830119:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:17170:1874741493453952:192.168.202.35@tcp:105: 00010000:00010000:2.0:1787893318.830148:0:17170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893318.830226:0:17170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af98d6ca-b952-492d-ad71-083813d6f146+8:2391:x1874741481844096:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 11641us (14108us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893318.830236:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 19 00000100:00100000:1.0:1787893318.838836:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893318.839070:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481844352 00000100:00100000:0.0:1787893318.839086:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481844352 00000100:00100000:0.0:1787893318.839166:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 27 00000100:00100000:0.0:1787893318.839179:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af98d6ca-b952-492d-ad71-083813d6f146+8:2391:x1874741481844352:12345-192.168.202.35@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787893318.839241:0:18704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000136cf3a3/0x9232577658cf2520 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.839302:0:18704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005b38fb54/0x9232577658cf2519 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62facab expref: 8 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.839312:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787893318.839318:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787893318.839324:0:18704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000136cf3a3/0x9232577658cf2520 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.839370:0:18704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005b38fb54/0x9232577658cf2519 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62facab expref: 8 pid: 18703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.839386:0:18704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005b38fb54/0x9232577658cf2519 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62facab expref: 8 pid: 18703 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893318.839404:0:18704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:18704:1874741493454080:192.168.202.35@tcp:104: 00000100:00100000:0.0:1787893318.839529:0:18704:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d8c5d300 going to sleep for 11 seconds 00000100:00100000:0.0:1787893318.841626:0:18704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:18704:1874741493454080:192.168.202.35@tcp:104: 00010000:00010000:0.0:1787893318.841660:0:18704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000136cf3a3/0x9232577658cf2520 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893318.842353:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893318.842422:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481844480 00000100:00100000:2.0:1787893318.842430:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481844480 00010000:00010000:2.0:1787893318.842478:0:17168:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005b38fb54/0x9232577658cf2519 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62facab expref: 9 pid: 18703 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893318.842549:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 20 00000100:00100000:2.0:1787893318.842578:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af98d6ca-b952-492d-ad71-083813d6f146+9:2391:x1874741481844480:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787893318.842596:0:17168:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893318.842626:0:17168:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005b38fb54/0x9232577658cf2519 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62facab expref: 9 pid: 18703 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.842641:0:17168:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005b38fb54/0x9232577658cf2519 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62facab expref: 9 pid: 18703 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.842670:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b38fb54/0x9232577658cf2519 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62facab expref: 9 pid: 18703 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.842688:0:17168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787893318.842693:0:17168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787893318.842699:0:17168:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000136cf3a3/0x9232577658cf2520 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.842711:0:17168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000136cf3a3/0x9232577658cf2520 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.842747:0:17168:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893318.842816:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af98d6ca-b952-492d-ad71-083813d6f146+8:2391:x1874741481844480:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 241us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893318.842825:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 20 00010000:00010000:0.0:1787893318.842944:0:18704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000136cf3a3/0x9232577658cf2520 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.842954:0:18704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000136cf3a3/0x9232577658cf2520 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.842985:0:18704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000136cf3a3/0x9232577658cf2520 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.842993:0:18704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000136cf3a3/0x9232577658cf2520 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.843001:0:18704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000136cf3a3/0x9232577658cf2520 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.843009:0:18704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31c00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893318.843014:0:18704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000136cf3a3/0x9232577658cf2520 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.843023:0:18704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000136cf3a3/0x9232577658cf2520 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.843037:0:18704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000136cf3a3/0x9232577658cf2520 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893318.843045:0:18704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000136cf3a3/0x9232577658cf2520 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893318.843113:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af98d6ca-b952-492d-ad71-083813d6f146+7:2391:x1874741481844352:12345-192.168.202.35@tcp:1:lhsmtool_posix.0 Request processed in 3937us (4293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893318.843131:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 27 00000100:00100000:1.0:1787893318.846014:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893318.846092:0:20187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481844736 00000100:00100000:3.0:1787893318.846104:0:20187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481844736 00000100:00100000:3.0:1787893318.846185:0:20187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 63 00000100:00100000:3.0:1787893318.846196:0:20187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:af98d6ca-b952-492d-ad71-083813d6f146+16:15670:x1874741481844736:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787893318.846308:0:20187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf2527 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.846327:0:20187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf2471 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac6c expref: 16 pid: 20187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.846337:0:20187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf2527 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.846377:0:20187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf2471 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac6c expref: 16 pid: 20187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.846392:0:20187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf2471 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac6c expref: 16 pid: 20187 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893318.846409:0:20187:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7cd7480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20187:1874741493454208:192.168.202.35@tcp:104: 00000100:00100000:3.0:1787893318.846544:0:20187:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c7486300 going to sleep for 11 seconds 00000100:00100000:0.0:1787893318.848699:0:20187:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7cd7480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20187:1874741493454208:192.168.202.35@tcp:104: 00010000:00010000:0.0:1787893318.848746:0:20187:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf2527 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893318.849080:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893318.849144:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481844864 00000100:00100000:2.0:1787893318.849152:0:17170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481844864 00010000:00010000:2.0:1787893318.849198:0:17170:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf2471 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac6c expref: 17 pid: 20187 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893318.849259:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 21 00000100:00100000:2.0:1787893318.849270:0:17170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af98d6ca-b952-492d-ad71-083813d6f146+17:2390:x1874741481844864:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787893318.849297:0:17170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893318.849306:0:17170:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf2471 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac6c expref: 17 pid: 20187 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.849318:0:17170:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf2471 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac6c expref: 17 pid: 20187 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.849344:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7f400/0x9232577658cf2471 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac6c expref: 17 pid: 20187 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.849361:0:17170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc9e5e7cb00) 00010000:00010000:2.0:1787893318.849368:0:17170:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0c00/0x9232577658cf248d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac7a expref: 16 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.849378:0:17170:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf2527 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.849387:0:17170:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf2527 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.849395:0:17170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf2527 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.849418:0:17170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893318.849480:0:17170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af98d6ca-b952-492d-ad71-083813d6f146+16:2390:x1874741481844864:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 212us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893318.849525:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 21 00010000:00010000:3.0:1787893318.849925:0:20187:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf2527 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.849935:0:20187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf2527 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.850208:0:20187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf252e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.850232:0:20187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf24f6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac96 expref: 16 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.850241:0:20187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf252e lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.850274:0:20187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf24f6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac96 expref: 16 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.850300:0:20187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf24f6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac96 expref: 16 pid: 17184 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893318.850317:0:20187:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7cd4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20187:1874741493454336:192.168.202.35@tcp:104: 00000100:00100000:3.0:1787893318.850434:0:20187:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c7486d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787893318.871569:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893318.871757:0:20187:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7cd4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20187:1874741493454336:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787893318.871811:0:20187:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf252e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893318.871949:0:17169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481844992 00000100:00100000:2.0:1787893318.871959:0:17169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481844992 00010000:00010000:2.0:1787893318.872006:0:17169:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf24f6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac96 expref: 17 pid: 17184 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893318.872052:0:17169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 22 00000100:00100000:2.0:1787893318.872061:0:17169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af98d6ca-b952-492d-ad71-083813d6f146+17:2391:x1874741481844992:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787893318.872081:0:17169:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893318.872089:0:17169:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf24f6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac96 expref: 17 pid: 17184 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.872101:0:17169:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf24f6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac96 expref: 17 pid: 17184 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.872129:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9edb30600/0x9232577658cf24f6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac96 expref: 17 pid: 17184 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.872148:0:17169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fc9cab65900) 00010000:00010000:2.0:1787893318.872153:0:17169:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf252e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.872165:0:17169:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf252e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.872174:0:17169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf252e lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.872229:0:17169:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893318.872312:0:17169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af98d6ca-b952-492d-ad71-083813d6f146+16:2391:x1874741481844992:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 251us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893318.872320:0:17169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 22 00010000:00010000:3.0:1787893318.872387:0:20187:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf252e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.872395:0:20187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf252e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787893318.872583:0:20187:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:3.0:1787893318.872728:0:20187:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1787893318.872770:0:20187:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:3.0:1787893318.872869:0:20187:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7cd4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:20187:1874741493454464:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787893318.872956:0:20187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893318.872994:0:20187:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c7486540 going to sleep for 11 seconds 00000100:00100000:2.0:1787893318.873146:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493454464 00000100:00100000:2.0:1787893318.873153:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493454464 00000100:00100000:2.0:1787893318.873201:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787893318.873211:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:20187:x1874741493454464:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787893318.873317:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:20187:x1874741493454464:12345-0@lo:1000:mdt00_004.0 Request processed in 107us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893318.873325:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787893318.873680:0:20187:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7cd4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:20187:1874741493454464:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1787893318.873869:0:20187:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1787893318.873940:0:20187:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7cd4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:20187:1874741493454592:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787893318.873977:0:20187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893318.874009:0:20187:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c7486840 going to sleep for 11 seconds 00000100:00100000:1.0:1787893318.874094:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493454592 00000100:00100000:1.0:1787893318.874100:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493454592 00000100:00100000:1.0:1787893318.874139:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787893318.874149:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:20187:x1874741493454592:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787893318.874295:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:20187:x1874741493454592:12345-0@lo:1000:mdt00_004.0 Request processed in 147us (318us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1787893318.874304:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787893318.874434:0:20187:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7cd4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:20187:1874741493454592:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1787893318.874473:0:20187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf252e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.874483:0:20187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf252e lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.874739:0:20187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf252e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.874747:0:20187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7e200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893318.874753:0:20187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf252e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.874762:0:20187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf252e lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.874780:0:20187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fc9cab65900) 00010000:00010000:3.0:1787893318.874783:0:20187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787893318.874788:0:20187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf252e lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.874795:0:20187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf252e lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.874863:0:20187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fe00/0x9232577658cf2486 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.874870:0:20187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fe00/0x9232577658cf2486 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.874877:0:20187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fe00/0x9232577658cf2486 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.874882:0:20187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7fe00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893318.874885:0:20187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fe00/0x9232577658cf2486 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.874891:0:20187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fe00/0x9232577658cf2486 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.874900:0:20187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc9e5e7cb00) 00010000:00010000:3.0:1787893318.874902:0:20187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787893318.874910:0:20187:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0c00/0x9232577658cf248d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac7a expref: 19 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.874923:0:20187:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0c00/0x9232577658cf248d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac7a expref: 19 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.874933:0:20187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0c00/0x9232577658cf248d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac7a expref: 19 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.879024:0:20187:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0c00/0x9232577658cf248d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac7a expref: 19 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893318.879058:0:20187:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20187:1874741493454720:192.168.202.35@tcp:105: 00000100:00100000:2.0:1787893318.879223:0:20187:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e5f7e540 going to sleep for 11 seconds 00000100:00100000:2.0:1787893318.890862:0:20187:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20187:1874741493454720:192.168.202.35@tcp:105: 00010000:00010000:2.0:1787893318.890905:0:20187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fe00/0x9232577658cf2486 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.890918:0:20187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fe00/0x9232577658cf2486 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.890966:0:20187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf2535 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.890982:0:20187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf2535 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.891014:0:20187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf2535 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.891027:0:20187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf2535 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.891034:0:20187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf2535 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.891042:0:20187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf2535 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.891048:0:20187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e0400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893318.891053:0:20187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf2535 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.891061:0:20187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf2535 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.891074:0:20187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc9e5e7cb00) 00010000:00010000:2.0:1787893318.891078:0:20187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893318.891082:0:20187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf2535 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.891088:0:20187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf2535 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.891100:0:20187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf2527 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.891106:0:20187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf2527 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.891118:0:20187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf2527 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.891123:0:20187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7e400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893318.891127:0:20187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf2527 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.891133:0:20187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf2527 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.891142:0:20187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc9e5e7cb00) 00010000:00010000:2.0:1787893318.891144:0:20187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787893318.891147:0:20187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf2527 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.891153:0:20187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e400/0x9232577658cf2527 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20187 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893318.891508:0:20187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:af98d6ca-b952-492d-ad71-083813d6f146+19:15670:x1874741481844736:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 Request processed in 45292us (45484us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1787893318.891521:0:20187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 63 00000020:00080000:2.0:1787893318.891529:0:20187:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787893318.894896:0:17220:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787893318.894910:0:17220:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787893318.894944:0:17220:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787893318.894952:0:17220:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787893318.904800:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893318.904956:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481845248 00000100:00100000:3.0:1787893318.904972:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481845248 00000100:00100000:3.0:1787893318.905070:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 10 00000100:00100000:3.0:1787893318.905086:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7c51050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af98d6ca-b952-492d-ad71-083813d6f146+19:15670:x1874741481845248:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787893318.905478:0:17187:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787893318.905587:0:17187:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1787893318.905632:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf253c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.905653:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf253c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.905667:0:17187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf253c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.905676:0:17187:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf253c lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.905684:0:17187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf253c lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.905690:0:17187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf253c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893318.905712:0:17187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787893318.906376:0:17172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893318.906386:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf253c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893318.906409:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7e200 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:1.0:1787893318.906413:0:17172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf253c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893318.906422:0:17172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf253c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893318.906457:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fc9cab65900) 00010000:00010000:1.0:1787893318.906461:0:17172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787893318.906467:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf253c lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893318.906473:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e200/0x9232577658cf253c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893318.906944:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7c51050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af98d6ca-b952-492d-ad71-083813d6f146+21:15670:x1874741481845248:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 Request processed in 1857us (2153us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1787893318.906957:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 10 00000020:00080000:3.0:1787893318.906965:0:17187:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787893318.907154:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893318.907157:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893318.907159:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893318.907256:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893318.907883:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481845376 00000100:00100000:1.0:1787893318.907895:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481845376 00000100:00100000:1.0:1787893318.907948:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 11 00000100:00100000:1.0:1787893318.907958:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af98d6ca-b952-492d-ad71-083813d6f146+21:15669:x1874741481845376:12345-192.168.202.35@tcp:49:dd.0 00000100:00100000:1.0:1787893318.908089:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af98d6ca-b952-492d-ad71-083813d6f146+21:15669:x1874741481845376:12345-192.168.202.35@tcp:49:dd.0 Request processed in 131us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893318.908097:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 11 00000100:00100000:0.0:1787893318.910142:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893318.910238:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481845504 00000100:00100000:2.0:1787893318.910250:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481845504 00000100:00100000:2.0:1787893318.910375:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 64 00000100:00100000:2.0:1787893318.910389:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af98d6ca-b952-492d-ad71-083813d6f146+21:15669:x1874741481845504:12345-192.168.202.35@tcp:101:dd.0 00010000:00010000:2.0:1787893318.910430:0:17183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893318.910456:0:17183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf2543 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62facb2 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.910549:0:17183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0a00/0x9232577658cf254a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.910567:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0a00/0x9232577658cf254a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.910593:0:17183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0a00/0x9232577658cf254a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.910746:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0400/0x9232577658cf2543 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62facb2 expref: 23 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.910768:0:17183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0a00/0x9232577658cf254a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62facb2 expref: 22 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893318.910778:0:17183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc9e5e7cb00) 00010000:00010000:2.0:1787893318.910781:0:17183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787893318.910786:0:17183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c67e0a00, rc 0) 00000100:00100000:2.0:1787893318.910867:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af98d6ca-b952-492d-ad71-083813d6f146+22:15669:x1874741481845504:12345-192.168.202.35@tcp:101:dd.0 Request processed in 481us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893318.910875:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 64 00000100:00100000:0.0:1787893319.145527:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893319.145580:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893319.146049:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481845760 00000100:00100000:1.0:1787893319.146063:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481845760 00000100:00100000:1.0:1787893319.146195:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481845632 00000100:00100000:1.0:1787893319.146199:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481845632 00000100:00100000:1.0:1787893319.146226:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 0 00000100:00100000:1.0:1787893319.146239:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:af98d6ca-b952-492d-ad71-083813d6f146+8:2392:x1874741481845760:12345-192.168.202.35@tcp:4:dd.0 00002000:00010000:1.0:1787893319.146317:0:18709:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a911646, atime: 0x6a911645, ctime: 0x6a911646, blocks: 0x0 00010000:00010000:1.0:1787893319.146328:0:18709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b38fb54/0x9232577658cf2551 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893319.146372:0:18709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1787893319.146377:0:18709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893319.146385:0:18709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b38fb54/0x9232577658cf2551 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893319.146412:0:18709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b38fb54/0x9232577658cf2551 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893319.156179:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787893319.257228:0:19518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:3.0:1787893319.257249:0:19518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:2.0:1787893319.258519:0:18709:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:2.0:1787893319.258531:0:18709:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1787893318 -> 1787893319 00002000:00010000:2.0:1787893319.258535:0:18709:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1787893318 -> 1787893319 00002000:00010000:2.0:1787893319.258537:0:18709:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:2.0:1787893319.258569:0:18709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b38fb54/0x9232577658cf2551 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893319.258615:0:18709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b38fb54/0x9232577658cf2551 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893319.258626:0:18709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b38fb54/0x9232577658cf2551 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893319.258636:0:18709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c84f6000 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787893319.258642:0:18709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b38fb54/0x9232577658cf2551 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893319.258651:0:18709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b38fb54/0x9232577658cf2551 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893319.258679:0:18709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b38fb54/0x9232577658cf2551 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893319.258687:0:18709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b38fb54/0x9232577658cf2551 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893319.258914:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:af98d6ca-b952-492d-ad71-083813d6f146+6:2392:x1874741481845760:12345-192.168.202.35@tcp:4:dd.0 Request processed in 112668us (113429us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787893319.258933:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 0 00000100:00100000:2.0:1787893319.258984:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 1 00000100:00100000:2.0:1787893319.258998:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:af98d6ca-b952-492d-ad71-083813d6f146+5:2392:x1874741481845632:12345-192.168.202.35@tcp:4:dd.0 00002000:00010000:2.0:1787893319.259064:0:18709:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 7654321, mtime: 0x6a911647, atime: 0x6a911645, ctime: 0x6a911647, blocks: 0x1a68 00010000:00010000:2.0:1787893319.259082:0:18709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e368ce9/0x9232577658cf2558 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893319.259095:0:18709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=563s v=(0 0) 00010000:00010000:2.0:1787893319.259101:0:18709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893319.259108:0:18709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e368ce9/0x9232577658cf2558 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893319.259122:0:18709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e368ce9/0x9232577658cf2558 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787893319.386031:0:19518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:2.0:1787893319.386403:0:18709:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:2.0:1787893319.386424:0:18709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e368ce9/0x9232577658cf2558 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893319.386437:0:18709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e368ce9/0x9232577658cf2558 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893319.386445:0:18709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e368ce9/0x9232577658cf2558 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893319.386453:0:18709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e0400 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787893319.386458:0:18709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e368ce9/0x9232577658cf2558 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893319.386466:0:18709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e368ce9/0x9232577658cf2558 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893319.386548:0:18709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e368ce9/0x9232577658cf2558 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893319.386557:0:18709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e368ce9/0x9232577658cf2558 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893319.386662:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:af98d6ca-b952-492d-ad71-083813d6f146+5:2392:x1874741481845632:12345-192.168.202.35@tcp:4:dd.0 Request processed in 127663us (241075us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787893319.386673:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 1 00000100:00100000:1.0:1787893319.711173:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893319.711219:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893319.711251:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893319.711295:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893319.711323:0:19239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481846656 00000100:00100000:1.0:1787893319.711332:0:19239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481846656 00000100:00100000:1.0:1787893319.711401:0:19239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 21 00000100:00100000:1.0:1787893319.711412:0:19239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3f229414-7dd1-4cf5-a739-e3375b9be1a7+5:2391:x1874741481846656:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893319.711483:0:19239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3f229414-7dd1-4cf5-a739-e3375b9be1a7+5:2391:x1874741481846656:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 73us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893319.711775:0:19990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481846144 00000100:00100000:0.0:1787893319.711780:0:19990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481846144 00000100:00100000:0.0:1787893319.711811:0:19990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481846400 00000100:00100000:0.0:1787893319.711813:0:19990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481846400 00000100:00100000:0.0:1787893319.711836:0:19990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 62 00000100:00100000:0.0:1787893319.711844:0:19990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af98d6ca-b952-492d-ad71-083813d6f146+5:2391:x1874741481846144:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893319.711876:0:19990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af98d6ca-b952-492d-ad71-083813d6f146+5:2391:x1874741481846144:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 34us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893319.711883:0:19990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 62 00000100:00100000:0.0:1787893319.711903:0:19990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 63 00000100:00100000:0.0:1787893319.711912:0:19990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3f229414-7dd1-4cf5-a739-e3375b9be1a7+6:2391:x1874741481846400:12345-192.168.202.35@tcp:400:kworker.0 00000100:00080000:3.0:1787893319.711938:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787893319.711944:0:19990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3f229414-7dd1-4cf5-a739-e3375b9be1a7+6:2391:x1874741481846400:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 32us (691us total) trans 0 rc 0/0 00000100:00080000:3.0:1787893319.711945:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787893319.711949:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787893319.711956:0:19990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 63 00000100:00100000:3.0:1787893319.712003:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893319.712042:0:19239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 21 00000100:00100000:1.0:1787893319.712083:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481846016 00000100:00100000:3.0:1787893319.712084:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893319.712090:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481846016 00000100:00100000:1.0:1787893319.712111:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481846272 00000100:00100000:1.0:1787893319.712115:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481846272 00000100:00100000:3.0:1787893319.712128:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893319.712154:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 22 00000100:00100000:1.0:1787893319.712163:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af98d6ca-b952-492d-ad71-083813d6f146+5:2391:x1874741481846272:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893319.712202:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af98d6ca-b952-492d-ad71-083813d6f146+5:2391:x1874741481846272:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 40us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893319.712209:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 22 00000100:00080000:1.0:1787893319.712224:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787893319.712242:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481846528 00000100:00100000:1.0:1787893319.712246:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481846528 00000100:00080000:1.0:1787893319.712261:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787893319.712293:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 64 00000100:00100000:1.0:1787893319.712300:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af98d6ca-b952-492d-ad71-083813d6f146+22:2391:x1874741481846016:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893319.712339:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af98d6ca-b952-492d-ad71-083813d6f146+22:2391:x1874741481846016:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 39us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893319.712347:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 64 00000100:00100000:0.0:1787893319.712357:0:19990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 65 00000100:00100000:0.0:1787893319.712368:0:19990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3f229414-7dd1-4cf5-a739-e3375b9be1a7+5:2391:x1874741481846528:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893319.712396:0:19990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3f229414-7dd1-4cf5-a739-e3375b9be1a7+5:2391:x1874741481846528:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 31us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893319.712403:0:19990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 65 00000100:00100000:3.0:1787893319.712629:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893319.712643:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481845888 00000100:00100000:2.0:1787893319.712652:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481845888 00000100:00100000:2.0:1787893319.712707:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 167 00000100:00100000:2.0:1787893319.712718:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9f6c6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf022523-db7f-4c9e-a3ea-97d11e9985e2+13:2391:x1874741481845888:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893319.712759:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9f6c6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf022523-db7f-4c9e-a3ea-97d11e9985e2+13:2391:x1874741481845888:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 44us (1597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893319.712766:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 167 00000100:00100000:0.0:1787893319.724078:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481846784 00000100:00100000:0.0:1787893319.724094:0:18702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481846784 00000100:00100000:0.0:1787893319.724202:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 23 00000100:00100000:0.0:1787893319.724214:0:18702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3f229414-7dd1-4cf5-a739-e3375b9be1a7+5:2391:x1874741481846784:12345-192.168.202.35@tcp:400:kworker.0 00000100:00080000:1.0:1787893319.724345:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787893319.726871:0:18702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3f229414-7dd1-4cf5-a739-e3375b9be1a7+5:2391:x1874741481846784:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 2648us (14231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893319.726884:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 23 00010000:00010000:0.0:1787893320.177843:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893320.881913:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493454848:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787893320.881998:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893320.882063:0:19991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493454848 00000100:00100000:1.0:1787893320.882071:0:19991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493454848 00000100:00100000:1.0:1787893320.882125:0:19991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787893320.882135:0:19991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493454848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787893320.882177:0:19991:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1787893320.882221:0:19991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493454848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893320.882228:0:19991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1787893320.882250:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787893320.882296:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493454848:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787893320.882398:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787893320.882408:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7e04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493454976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787893320.882438:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893320.882624:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787893320.882634:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493455104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787893320.882664:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893320.882730:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493455232:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787893320.882754:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893320.882781:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493454976 00000100:00100000:2.0:1787893320.882784:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493454976 00000100:00100000:2.0:1787893320.882809:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493455104 00000100:00100000:2.0:1787893320.882812:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493455104 00000100:00100000:2.0:1787893320.882841:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493455232 00000100:00100000:2.0:1787893320.882844:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493455232 00000100:00100000:2.0:1787893320.882857:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787893320.882864:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493454976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787893320.882875:0:18706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1787893320.882902:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493454976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893320.882909:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787893320.882921:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787893320.882939:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493455104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787893320.882956:0:18706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787893320.882986:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493455104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893320.882992:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787893320.883003:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787893320.883009:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493455232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787893320.883019:0:18706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787893320.883045:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493455232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893320.883052:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1787893320.883065:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787893320.883068:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787893320.883081:0:3631:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:2.0:1787893320.883086:0:3631:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fc9ffbdc000, transno 8589934596 00000004:00080000:2.0:1787893320.883097:0:3631:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:2.0:1787893320.883116:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7e04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493454976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787893320.883229:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493455232:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787893320.883276:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493455104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787893320.884399:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493455744:0@lo:400:kworker.0 00000100:00100000:1.0:1787893320.884451:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893320.884482:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493456256:0@lo:400:kworker.0 00000100:00100000:1.0:1787893320.884529:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893320.884550:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787893320.884555:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7e04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493455360:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787893320.884577:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893320.884593:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493455872:0@lo:400:kworker.0 00000100:00100000:1.0:1787893320.884613:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893320.884628:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe349c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493456384:0@lo:400:kworker.0 00000100:00100000:1.0:1787893320.884645:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893320.884678:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493456256 00000100:00100000:1.0:1787893320.884683:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493456256 00000100:00100000:3.0:1787893320.884904:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493455744 00000100:00100000:3.0:1787893320.884908:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493455744 00000100:00100000:3.0:1787893320.884961:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493455360 00000100:00100000:3.0:1787893320.884965:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493455360 00000100:00100000:3.0:1787893320.884979:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787893320.884987:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3632:x1874741493455744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893320.885038:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3632:x1874741493455744:12345-0@lo:400:kworker.0 Request processed in 51us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893320.885043:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787893320.885059:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787893320.885067:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493455360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787893320.885089:0:17188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787893320.885116:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493455360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 52us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893320.885121:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787893320.885236:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7cd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493455488:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787893320.885278:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893320.885302:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493456000:0@lo:400:kworker.0 00000100:00100000:0.0:1787893320.885321:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893320.885330:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe349880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1874741493456512:0@lo:400:kworker.0 00000100:00100000:0.0:1787893320.885348:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893320.885363:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787893320.885368:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7cd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13b37fca-0eda-4b14-a6ef-4a378c945d17:3630:1874741493455616:0@lo:400:kworker.0 00000100:00100000:0.0:1787893320.885459:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893320.885513:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874741493456128:0@lo:400:kworker.0 00000100:00100000:0.0:1787893320.885536:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893320.885547:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8469500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1874741493456640:0@lo:400:kworker.0 00000100:00100000:0.0:1787893320.885566:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893320.885587:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493455616 00000100:00100000:0.0:1787893320.885591:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493455616 00000100:00100000:0.0:1787893320.885616:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787893320.885622:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd285c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:3630:x1874741493455616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893320.885653:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd285c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:3630:x1874741493455616:12345-0@lo:400:kworker.0 Request processed in 32us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893320.885659:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787893320.885825:0:20187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493455872 00000100:00100000:2.0:1787893320.885830:0:20187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493455872 00000100:00100000:2.0:1787893320.885849:0:20187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493456384 00000100:00100000:2.0:1787893320.885852:0:20187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493456384 00000100:00100000:2.0:1787893320.885864:0:20187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493456512 00000100:00100000:2.0:1787893320.885866:0:20187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493456512 00000100:00100000:2.0:1787893320.885876:0:20187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493456128 00000100:00100000:2.0:1787893320.885878:0:20187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493456128 00000100:00100000:2.0:1787893320.885889:0:20187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493456640 00000100:00100000:2.0:1787893320.885891:0:20187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493456640 00000100:00100000:2.0:1787893320.885904:0:20187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787893320.885911:0:20187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493456256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893320.886061:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787893320.886069:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493455872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893320.886126:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493455488 00000100:00100000:3.0:1787893320.886130:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493455488 00000100:00100000:3.0:1787893320.886149:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493456000 00000100:00100000:3.0:1787893320.886152:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493456000 00000100:00100000:3.0:1787893320.886163:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787893320.886178:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3630:x1874741493455488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787893320.886194:0:17188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1787893320.886284:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493455872:12345-0@lo:400:kworker.0 Request processed in 215us (1670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893320.886292:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787893320.886307:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787893320.886313:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7ce1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493456384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893320.886343:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7ce1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493456384:12345-0@lo:400:kworker.0 Request processed in 31us (1696us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893320.886348:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787893320.886359:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787893320.886365:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874741493456512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893320.886402:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874741493456512:12345-0@lo:400:kworker.0 Request processed in 38us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893320.886415:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787893320.886426:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787893320.886431:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874741493456128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893320.886458:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874741493456128:12345-0@lo:400:kworker.0 Request processed in 27us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893320.886464:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787893320.886475:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787893320.886482:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1874741493456640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893320.886526:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1874741493456640:12345-0@lo:400:kworker.0 Request processed in 45us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893320.886532:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787893320.886553:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787893320.886560:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3630:x1874741493456000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893320.886589:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3630:x1874741493456000:12345-0@lo:400:kworker.0 Request processed in 30us (1267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893320.886595:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787893320.886738:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7e04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493455360:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787893320.886752:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493455872:0@lo:400:kworker.0 00010000:00080000:1.0:1787893320.886764:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9fe349c00 x1874741493456384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893320.886775:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe349c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493456384:0@lo:400:kworker.0 00000100:00100000:1.0:1787893320.886786:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493455744:0@lo:400:kworker.0 00000100:00100000:1.0:1787893320.888053:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7cd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13b37fca-0eda-4b14-a6ef-4a378c945d17:3630:1874741493455616:0@lo:400:kworker.0 00000100:00100000:1.0:1787893320.888085:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874741493456128:0@lo:400:kworker.0 00010000:00080000:1.0:1787893320.888099:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c8469500 x1874741493456640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893320.888108:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8469500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1874741493456640:0@lo:400:kworker.0 00000100:00100000:1.0:1787893320.888120:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493456000:0@lo:400:kworker.0 00000100:00100000:1.0:1787893320.888131:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe349880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1874741493456512:0@lo:400:kworker.0 00000100:00100000:3.0:1787893320.888540:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493455488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2362us (3259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893320.888549:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1787893320.888656:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787893320.888662:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787893320.888873:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7cd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493455488:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787893320.889296:0:20187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493456256:12345-0@lo:400:kworker.0 Request processed in 3384us (4765us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893320.889306:0:20187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787893320.889366:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493456256:0@lo:400:kworker.0 00000040:00080000:3.0:1787893321.010140:0:17937:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787893321.202124:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787893321.545139:0:20378:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1787893322.225738:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893323.249662:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 43282 lines, 43282 kept, 0 dropped, 0 bad.